Towards conceptual generalization in the embedding space · HackerPapers discussions

Towards conceptual generalization in the embedding space — mentioned by freediver

Tue, 12 Apr 2022 21:20:17 GMT

I co-authored a paper exploring this topic few years ago, while I was pretty excited about the possiblity of using embeddings for generalization. "Towards conceptual generalization in the embedding space" https://arxiv.org/abs/1906.01873 I still think the approach outlined in the paper (using embeddings to map the physical world) is sound especially for the field of self-driving which is in dire need of generalization, but I've since changed my mind and currently do not believe we can achieve AGI (ever). While embeddings are a great tool for compressing information, they do not provide…

Paper and discussion history. A mention is not an endorsement.

Towards conceptual generalization in the embedding space — mentioned by freediver

Wed, 08 Dec 2021 21:51:05 GMT

This model like its predecessor still lacks the ability to infer within constraints of physical world [1]. It does not have any notion of what a physical world is, and still is, at the end of the day, a statistical model. Attempting to do recreate the entirety of the physical world by describing it in text is an impressive feat, but a futile attempt. It is prone to inference errors that the model itself is not aware of. There are less and less of such errors, but the very inability to tell that what you are outputting is gibberish is one of the biggest problems of these models. In other…

Paper and discussion history. A mention is not an endorsement.