LavaLite
A small, solid cluster scheduler: fast, reliable, predictable, simple.
Like a Unix tool, LavaLite does one thing and does it right: it schedules jobs on a cluster. Monitoring, metrics, event streams, workflows, whatever you need: build it on top of its API.
LavaLite is an open-source scheduler for HPC clusters. It runs batch jobs and long-running services on Linux hosts, with explicit state, a durable event log and predictable recovery when hosts or daemons fail. It is written in C and licensed under the GPL v2.
Source code 2.0.0 release notes Installation
New in 2.0
- Services. Users start long-running applications
such as Jupyter or code-server on demand with
bservices. Each instance is an ordinary job in its own network namespace, reached through an endpoint on its execution host. - Failure handling. Unresponsive and failing hosts, daemons killed or stopped under load, configuration errors: jobs are kept, resynchronized or rescheduled, and the scheduler keeps running.
- Chaos tested. Hours of load from several users while daemons are killed, frozen and stopped, checking that every job and service reaches its end state.
What it does
- Queues, priorities, host groups, user access control
- CPU, memory, storage and GPU aware scheduling, exclusive hosts
- Multi-host allocations, job arrays, job dependencies
- Token pools for licenses and other shared resources
- Hold, suspend, resume, signal, move between queues
- Job history with
bhist, cgroup v2 enforcement - Restart and recovery of
mbdandsbdwithout job loss
Numbers
Single bsub, one client | ~11,000 jobs/min |
| Job arrays | ~100,000 jobs/min |
bjobs -a, 16,000 jobs | ~270 ms |
bhist, 16,000 jobs | ~130 ms |
Measured with bperf, see the
performance guide.
A look
$ bsub --cpus 4 --nhosts 2 ./simulation.sh Job <1042> is submitted to the default queue. $ bservices -s jupyter Job <1043> http://node07:30001
Get it
git clone https://codeberg.org/lavalitecompute/lavalite cd lavalite ./bootstrap && ./configure && make sudo make install
Linux x86_64 or aarch64, kernel 5.14 or later, cgroup v2. Tested on Rocky Linux 8 and 9 and Ubuntu 24.04. Then follow the installation guide.