Gossip Learning with Linear Models on Fully Distributed Data — mentioned by synctext

Sun, 01 Oct 2023 12:36:12 GMT

Indeed very half-baked. This must be quite an insult to the inventor of fully decentralised AI. In 2012 Prof. Jelasity invented gradient mining with SGD, https://arxiv.org/pdf/1109.1396 Works reasonably well, you probably also need a ledger like Trustchain for accountability and Sybil protection. Consensus is too costly. This problem is unsolved and actively worked on academia for decades.

Paper and discussion history. A mention is not an endorsement.

Gossip Learning with Linear Models on Fully Distributed Data — mentioned by synctext

Mon, 22 May 2023 07:01:45 GMT

> Apple silicone with its unified memory architecture, GPU and Neural cores is very well placed for local LLMs. Yes, university research from 2011 already showed a privacy focused design to machine learning[1]. But will this be private or public like Wikipedia, Bitcoin and Bittorrent? > Effectively an extension to your own brain. Correct. After 1996 fantasy/visionary publications about this, we now know roughly how to do this. Most difficult problem is who should own it, no corporation in control is desired. That means full decentralisation, federated learning is not enough. But fully…

Paper and discussion history. A mention is not an endorsement.

Gossip Learning with Linear Models on Fully Distributed Data · HackerPapers discussions

Gossip Learning with Linear Models on Fully Distributed Data — mentioned by synctext

Gossip Learning with Linear Models on Fully Distributed Data — mentioned by synctext