AetherGrid, open-source distributed AI orchestrator

Why AetherGrid

AI jobs run for a long time on expensive machines, and machines fail. A job that stalls, runs twice or leaves processes behind wastes GPU hours and delays everything waiting on it. AetherGrid makes the system responsible for those failures, so nobody has to catch them by hand.

Less wasted compute

Jobs are matched to nodes on CPU, memory and VRAM together, and a job that finishes, times out or is cancelled leaves nothing running behind it.

No duplicated or lost work

Each job has one owner, enforced by a lease. If the owner disappears, the job returns to a healthy worker without a person stepping in.

Clear to operate

A dashboard shows nodes, jobs, the event history of each job and a live cluster event feed, so an operator can see what happened and why.

One platform for many customers

Tenant isolation is enforced in the application and in the database, and the tenant is taken from the credential, never from the request.

Upgrades you can trust

Each release is rehearsed against a database from the release before it, so an upgrade is something you have already watched work.

Yours to run and inspect

Open source under the MIT licence and started with Docker Compose. Every route needs an API key, and the reasoning behind each design choice is public in the decision records.