Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet · HackerPapers discussions

Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet — mentioned by Lichtso

Thu, 29 Oct 2026 19:38:14 GMT

Covenant-72B https://arxiv.org/abs/2603.08163 https://huggingface.co/1Covenant/Covenant-72B

Paper and discussion history. A mention is not an endorsement.

Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet — mentioned by logicchains

Sat, 13 Jun 2026 09:02:36 GMT

It is practical, albeit not as efficient: https://arxiv.org/abs/2603.08163 . But organizing enough people with decent-enough GPUs is the challenge.

Paper and discussion history. A mention is not an endorsement.

Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet — mentioned by logicchains

Sat, 13 Jun 2026 09:01:21 GMT

>I've been contemplating a decentralized model training system for some time using volunteer machines that we all contribute. But, it is astronomically difficult. The communication speeds are untenable. It is already possible: https://arxiv.org/abs/2603.08163 . You don't need to sync so frequently, so it can be done over normal internet, it's just less efficient (takes longer to converge).

Paper and discussion history. A mention is not an endorsement.

Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet — HN submission

Wed, 11 Mar 2026 13:09:49 GMT

Covenant-72B: Pre-Training a 72B LLM with Trustless Peers Over-the-Internet

5 points; 2 discussion replies on HN. Paper and source history. A submission is not an endorsement.