Get the latest tech news

Pool spare GPU capacity to run LLMs at larger scale

reference impl with llama.cpp compiled to distributed inference across machines, with real end to end demo - michaelneale/mesh-llm

None

Get the Android app