Petals
AssessTools
A peer-to-peer system for distributed inference and fine-tuning of large language models.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by open-source activity, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 7Hacker News·7/23/2026open_sourcePetals lets people run large language models at home
Petals is a distributed inference and fine-tuning system that lets users run parts of large language models on consumer GPUs and share the rest over a peer network, BitTorrent-style. It supports models such as Llama 3.1, Mixtral, Falcon, and BLOOM, with API-like usability and access to lower-level model behavior for customization.