LydianAI distributed inference

Open source first

The first LydianAI release is a distributed training PoC (FedAvg + FastAPI). It’s built to run across real-world mixed machines — including legacy Pascal GPUs.

Repo

Server/coordinator + workers + CLI client. Designed for multi-machine training over Tailscale.

Open GitHub
Typical folders: server/, worker/, client/, common/

Two install paths: NEW vs LEGACY GPUs

Modern GPUs use a current PyTorch stack. Pascal GPUs (GTX 1080/1080 Ti) require pinned legacy wheels and often Python 3.10.

Read install guide

CLI workflow

Start training, monitor rounds, check status/results, and list workers from a single CLI.

CLI reference