Manas Dalvi

All projects

03Systems

Orbit

Distributed task orchestration engine for reliably executing long-running jobs across isolated worker nodes.

View source on GitHub

Stack

Go · gRPC · Protobuf · PostgreSQL · Docker · Python

In one line

at-least-once delivery

Overview

Orbit is a distributed orchestration engine that schedules and reliably runs background jobs across polyglot, isolated workers — designed around correctness under concurrency and failure. A Go control plane schedules work, Python workers execute it over a typed gRPC contract, and PostgreSQL is the single source of truth.

Architecture

Demo

Demo coming soon

Highlights5

01

Go control plane uses goroutines and channel-based select loops for high-concurrency scheduling with a priority-ordered job queue.

02

Race-free dispatcher on PostgreSQL uses row-level locking and transactional state transitions to guarantee at-least-once delivery.

03

Typed gRPC/Protobuf contract covers registration, leasing, heartbeats, result reporting, and log streaming across languages.

04

Heartbeat-driven reaper recovers zombie workers, expires stale leases, and retries stalled jobs with configurable backoff.

05

Execution isolated in CPU/memory-limited Docker containers via the Docker SDK to prevent cascading failures.

Outcomes

At-least-once
delivery guarantee
Race-free
row-level-lock dispatch
Auto-retry
zombie-worker recovery

Related notes

NextOttoNote