One Big Net For Everything · HackerPapers discussions

One Big Net For Everything — mentioned by gwern

Wed, 16 Aug 2023 17:36:21 GMT

This is an old idea dating back to the earliest algorithmic information theory work in the '50s/60s like Ray Solomonoff on universal induction: given a powerful learning algorithm, create AI by encoding all possible data as a binary stream (with no further preprocessing or engineering), and simply predict each successive bit. This leads to AIXI, the compression-as-intelligence paradigm (and online learning / meta-learning), and most recently, the success of self-supervised learning & generative modeling. See for example Burfoot https://arxiv.org/abs/1104.5466 or Schmidhuber…

Paper and discussion history. A mention is not an endorsement.

One Big Net For Everything — HN submission

Sat, 29 Jul 2023 10:36:44 GMT

One Big Net For Everything (2018) [pdf]

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

One Big Net For Everything — HN submission

Thu, 22 Mar 2018 17:49:20 GMT

One Big Net for Everything

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

One Big Net For Everything — HN submission

Tue, 13 Mar 2018 12:50:51 GMT

One Big Net for Everything

3 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.