Repos
Colibri runs 744B-parameter AI models on a 25 GB PC by streaming experts from disk. The real speeds
Colibri, a dependency-free C engine that keeps mixture-of-experts weights on NVMe and loads them on demand, is back on GitHub's daily trending list at about 47K stars. It really does run frontier-size open models on ordinary hardware, but independent tests show giant models crawl well below one token per second.