The Forward-Forward Algorithm: Some Preliminary Investigations · HackerPapers discussions

The Forward-Forward Algorithm: Some Preliminary Investigations — mentioned by ewheeler

Thu, 30 Jan 2025 21:31:04 GMT

While there are some similarities, yes, our brains definitely don't have anything akin to backpropagation, which is the critical mechanism for how current AI models learn. Hinton has some research on a forward-forward learning paradigm [1], which might be closer to how our brains learn (but the artificial implementations are not great yet). He also posits that maybe the purpose of humans' dreams are generating negative data for such a contrastive forward-forward learning mechanism. [1] https://arxiv.org/abs/2212.13345

Paper and discussion history. A mention is not an endorsement.

The Forward-Forward Algorithm: Some Preliminary Investigations — mentioned by robertsdionne

Wed, 10 Jul 2024 21:43:39 GMT

This is “Mortal Computation” coined in Hinton’s The Forward-Forward Algorithm: Some Preliminary Investigations https://arxiv.org/abs/2212.13345.

Paper and discussion history. A mention is not an endorsement.

The Forward-Forward Algorithm: Some Preliminary Investigations — mentioned by pksebben

Thu, 11 Apr 2024 20:25:13 GMT

Here's what I envision (note: impossible with current state of the art) A model that can be incrementally trained (this is the bit we're missing) hosted by a nonprofit, belonging to "we the people" (like wikipedia). The training process could be done a little like wikipedia talk pages are now - datasets are proposed and discussed out in the open and once generally approved, trained into the model. Because training currently involves backpropagation, this isn't possible. Hinton was working on a structure called "forward-forward" that would have overcome this (if it worked) before he decided…

Paper and discussion history. A mention is not an endorsement.

The Forward-Forward Algorithm: Some Preliminary Investigations — mentioned by pksebben

Wed, 21 Jun 2023 17:09:30 GMT

> In May 2023, a colonel in the US Air Force revealed a simulation in which an AI-enabled drone, tasked with attacking surface-to-air missiles but acting under the authority of a human operator, attacked the operator instead. (The US Air Force later denied the story.) This casts a shadow on the reliability of the whole article. While the retraction (they later stated that this was a thought experiment and NOT a simulation) may or may not be true, the current state of AI would suggest that this kind of chain-of-logic problem-solving is likely out of reach. To put this in here without such a…

Paper and discussion history. A mention is not an endorsement.

The Forward-Forward Algorithm: Some Preliminary Investigations — mentioned by born-jre

Tue, 06 Jun 2023 23:04:38 GMT

sounds cool, i wonder if its possible to do similar with "The Forward-Forward Algorithm" by Geoff Hilton maybe on a few add on layers like with lora [0]: https://arxiv.org/pdf/2212.13345.pdf

Paper and discussion history. A mention is not an endorsement.

The Forward-Forward Algorithm: Some Preliminary Investigations — HN submission

Tue, 02 May 2023 06:48:56 GMT

The Forward-Forward Algorithm: Some Preliminary Investigations (2022)

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

The Forward-Forward Algorithm: Some Preliminary Investigations — mentioned by cschmid

Thu, 12 Jan 2023 16:15:34 GMT

The article links to an old draft of the paper (it seems that the results in 4.1 couldn't be replicated). The arxiv has a more recent one: https://arxiv.org/abs/2212.13345

Paper and discussion history. A mention is not an endorsement.

The Forward-Forward Algorithm: Some Preliminary Investigations — HN submission

Wed, 04 Jan 2023 10:27:47 GMT

The Forward-Forward Algorithm, potential alternative to backpropagation

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.