#distributed LLM inference

Mesh LLM: Run Any Model Across Multiple Machines With One OpenAI-Compatible API

Mesh LLM is an open-source distributed inference runtime that pools GPUs and memory across machines and exposes the result as a single OpenAI-compatible API — letting you run models too large for any one box using peer-to-peer mesh routing and Skippy stage splits.