Templar (SN3) Completes Pre-Training of Covenant72B, the Largest Fully Decentralized LLM to Date
Templar, Bittensor Subnet 3, has completed pre-training for Covenant72B, a 72-billion-parameter language model. This is the largest frontier-scale model ever trained in a fully permissionless and decentralized setting. The run was coordinated across a global network of independent GPUs with no central datacenter, no single owner, and no gatekeeping. Pre-training processed roughly 1.2 trillion tokens,…