PaLM 2 Technical Report · HackerPapers discussions

PaLM 2 Technical Report — mentioned by godelski

Wed, 24 May 2023 06:16:47 GMT

> if for each step of improvement you need 10x parameters and 100x training, you quickly run into a brick wall Btw, PALM2 has far fewer parameters than V1. > The largest model in the PaLM 2 family, PaLM 2-L, is significantly smaller than the largest PaLM model but uses more training compute. Our evaluation results show that PaLM 2 models significantly outperform PaLM on a variety of tasks, including natural language generation, translation, and reasoning. These results suggest that model scaling is not the only way to improve performance. From the leak we know that the large version is 340B…

Paper and discussion history. A mention is not an endorsement.

PaLM 2 Technical Report — mentioned by evolve7942

Tue, 23 May 2023 03:25:23 GMT

If you think this is wild, see the PaLM 2 paper with 2.5 pages of 2 column attributions. https://arxiv.org/pdf/2305.10403.pdf

Paper and discussion history. A mention is not an endorsement.

PaLM 2 Technical Report — HN submission

Thu, 18 May 2023 12:49:22 GMT

Palm 2 Technical Report

1 point; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.