Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex · HackerPapers discussions

Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex — mentioned by Mageek

Tue, 12 Apr 2022 13:33:13 GMT

An HTM layer is one feedforward layer in a Heirarchical Temporal Memory network. See for example https://arxiv.org/abs/1511.00083 which trains one-layer HTM models. See for example https://timallanwheeler.com/blog/2022/01/09/hierarchical-tem... for a more approachable blog post about the same topic

Paper and discussion history. A mention is not an endorsement.

Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex — mentioned by p1esk

Sun, 02 Jun 2019 21:59:46 GMT

Look into capsules, also [1-3] can give you an idea of what can be explored. Evolving NNs [4] would probably benefit the most from NN primitives research. IMO, the best source of ideas for novel primitives is neocortex [5, 6]. [1] https://arxiv.org/abs/1904.03955 [2] https://arxiv.org/abs/1811.11168 [3] https://arxiv.org/abs/1905.02961 [4] https://www.nature.com/articles/s42256-018-0006-z [5] https://arxiv.org/abs/1610.00161 [6] https://arxiv.org/abs/1511.00083

Paper and discussion history. A mention is not an endorsement.

Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex — mentioned by otoburb

Tue, 17 Nov 2015 23:22:53 GMT

Direct link to the arXiv paper for that want to dive in right away: http://arxiv.org/abs/1511.00083

Paper and discussion history. A mention is not an endorsement.

Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex — HN submission

Thu, 05 Nov 2015 07:28:53 GMT

Why Neurons Have Thousands of Synapses: a Theory of Sequence Memory in Neocortex

68 points; 18 discussion replies on HN. Paper and source history. A submission is not an endorsement.