Competition-Level Code Generation with AlphaCode · HackerPapers discussions

Competition-Level Code Generation with AlphaCode — mentioned by YeGoblynQueenne

Sun, 02 Jul 2023 20:59:03 GMT

>> - Image descriptions eg. Be My Eyes: https://www.bemyeyes.com/ Not working yet. From the website: Starting today, you can register for the waitlist in the Be My Eyes app. >> - Customer service chat triage. More specifically? Which company is currently using LLMs for this purpose? >> - helping students learn- eg khan academy, tutor Lily Helping them learn, but what? Per wikipedia: Statements made in certain mathematics and physics videos have been questioned for their technical accuracy.[43] Sounds like using LLMs will just generate more garbage teaching material. >> - Helping create and…

Paper and discussion history. A mention is not an endorsement.

Competition-Level Code Generation with AlphaCode — mentioned by YeGoblynQueenne

Thu, 15 Dec 2022 18:44:02 GMT

Nature paper: https://www.science.org/doi/10.1126/science.abq1158 For those wondering, yes, these are the same results reported in the February 2022 pre-print here: https://arxiv.org/abs/2203.07814 As in the preprint the authors report their system's average ranking as top 54.3% in past competitions but the meat and potatoes of their results are in the reporting of test accuracy, which they don't advertise in the abstract- because it's not that good. From the body of the Nature article: >> With up to 100,000 samples per problem (10@100K), the AlphaCode 41B model solved 29.6% of problems in…

Paper and discussion history. A mention is not an endorsement.

Competition-Level Code Generation with AlphaCode — HN submission

Fri, 09 Dec 2022 09:16:04 GMT

Competition-Level Code Generation with AlphaCode

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Competition-Level Code Generation with AlphaCode — mentioned by sarosh

Thu, 08 Dec 2022 21:56:48 GMT

Heres the Arxiv link with the PDF since the Science link isn't working. https://arxiv.org/pdf/2203.07814v1.pdf *See p. 21 for a list of benchmarks, including the results of a finetuned GPT-3 for coding.

Paper and discussion history. A mention is not an endorsement.

Competition-Level Code Generation with AlphaCode — mentioned by curling_grad

Wed, 30 Mar 2022 00:24:34 GMT

Their paper has results from Codex. (see p. 21) https://arxiv.org/pdf/2203.07814v1.pdf

Paper and discussion history. A mention is not an endorsement.