Get the latest tech news
Petals: Run LLMs at home, BitTorrent-style
Petals Run large language models at home, BitTorrent‑style - Generate text with Llama 3.1 (up to 405B), Mixtral (8x22B), Falcon (40B+) or BLOOM (176B) and fine‑tune them for your tasks — using a consumer-grade GPU or Google Colab. - You load a part of the model, then join a network of people serving its other parts.
None
Or read this on Hacker News
