Skip to content
Where new products land first

lumabri

P2P swarm for running huge mixture-of-experts models on the colibri engine

Other6d ago
Category
Other
Website
github.com
Language
English
Listed
6d ago
Stars
122
Forks
9

JustVugg/lumabri ↗· C· Apache-2.0· Last commit 1d ago

lumabri runs huge mixture-of-experts models from a swarm of peers using the colibri engine, in pure C with no dependencies. Nothing is downloaded up front: the bytes an inference actually touches arrive from peers on first use and persist in a local mirror, with every MiB verified by sha256. Routed experts execute on the peers that hold their weights, while the local machine keeps only the dense weights, router, and KV cache. Built CPU and SSD first, it produces byte-identical output with or without a GPU, under an Apache-2.0 license.

Like this product?