ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing · HackerPapers discussionshttps://hackerpaper.kaipfister.de/p/2007.06225/Collected HN comments and submissions linking this paper.enMon, 02 Nov 2026 11:16:22 GMTProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing — mentioned by criticaltinkerhttps://news.ycombinator.com/item?id=28217528urn:hackerpapers:mention:2007.06225:28217528Wed, 18 Aug 2021 03:41:24 GMT<p>First, congratulations to you and the other authors - this is a very informative and accessible paper with impressive results. &gt; On both datasets, we find that synthesis performance scales log-linearly with model size This &quot;scaling law&quot; observation is starting to become a major trend in NLP [1] and other other modalities such as speech recognition [2] and protein structure/function prediction [3]. Do you have any insight or commentary to offer regarding the next step in improving program synthesis? For example, will techniques to scale up model size continue to be a primary focus (eg as in…</p><p><a href="https://hackerpaper.kaipfister.de/p/2007.06225/">Paper and discussion history</a>. A mention is not an endorsement.</p>cs.LG