Wednesday, May 12, 2021

Tip of the Trade: Clusters with Condor

Clusters and distributed computing can operate in a number of ways. At one
end of the spectrum are full-time dedicated clusters. Alternatively, you can
get distributed power on the cheap if you set up a part-time cluster using
spare cycles on networked desktops.

Condor is suitable for all
types of clustering. It was originally developed for use on
non-dedicated desktop clusters. Not surprisingly, therefore, it is particularly well-suited to those. The
project aims to provide policies and mechanisms to support High Throughput
Computing on distributive resources.

Condor functions as a batch processing system, with a central server that accepts
and queues jobs, serving them out to compute nodes as appropriate. If you’re
using a desktop cluster, you can set policies so jobs run only on idle
machines, and thus can be paused or moved transparently when a machine stops being idle.

Condor is incredibly adaptable — almost any usage policy and preference can
be described — and very versatile, making it suitable for many types of
distributed system. It can also interact with remote Grid systems
using a Globus interface, which requires installing only the Condor-G client
interface, not the server as well.

Condor is straightforward to install and deploy, and the online documentation and support available is great.

Find out more at the many links on the Condor Web page.

This article was first published on ServerWatch.com.

Similar articles

Latest Articles

Database-Tuning Platform Launches and...

PITTSBURGH — A team out of Carnegie Mellon University is launching its automatic database-tuning product today with the help of $2.5 million in funding.   OtterTune,...

Top 10 Professional Services...

Professional services automation (PSA) software aims to offer service-based companies most of the software they will need to run their businesses in one package....

What is Data Aggregation?

Data aggregation is the process where raw data is gathered and presented in a summarized format for statistical analysis. The data may be gathered...

Dell APEX: Our...

One of the missteps IBM made last century was collapsing their sales model, which was services based, to generate a short-term revenue spike. Up...