Entailment Semantics Can Be Extracted from an Ideal Language Model — mentioned by genezeta

Sun, 30 Oct 2022 08:05:22 GMT

> This week I saw not one but three striking premonitions for how the scaling maximalism hypothesis might end. > 1. There might not be enough data in the world to make scaling maximalism work. https://arxiv.org/pdf/2209.12407.pdf > 2. There might not be enough available compute in the world to make scaling maximalism feasible. > 3. Some important tasks might simply not scale. https://arxiv.org/abs/2002.06177 Note: scaling maximalism hypothesis -> "that AGI might arise from larger scale without fundamental new innovation"

Paper and discussion history. A mention is not an endorsement.

Entailment Semantics Can Be Extracted from an Ideal Language Model · HackerPapers discussions

Entailment Semantics Can Be Extracted from an Ideal Language Model — mentioned by genezeta