Unsupervised Evaluation of Code LLMs with Round-Trip Correctness · HackerPapers discussions

Unsupervised Evaluation of Code LLMs with Round-Trip Correctness — mentioned by rramadass

Fri, 24 Jul 2026 10:04:56 GMT

Also see; Unsupervised Evaluation of Code LLMs with Round-Trip Correctness - https://arxiv.org/abs/2402.08699 Code repository for the above - https://github.com/google-deepmind/icml2024-roundtrip-correc... RTCE: RoundTrip Code Evaluation Framework - https://www.emergentmind.com/topics/roundtripcodeeval-rtce

Paper and discussion history. A mention is not an endorsement.

Unsupervised Evaluation of Code LLMs with Round-Trip Correctness — HN submission

Tue, 03 Sep 2024 21:11:48 GMT

Help Finding LLM and Proof Based Refactoring Reference

Recently on HN I came across an LLM paper achieving impressive results on SWE-bench refactoring tasks. In addition to generating the refactoring, it also created a formal proof of equivalence in a special DSL. Now I can't seem to find the paper! So far, I have scrubbed the HN SWE-bench articles from the last 9 months, and tried Google scholar searches for LLM based refactoring with Proofs or DSLs. I am confident that they mention SWE-bench in the abstract, but it does not seem to be mentioned in the HN announcement. I don't remember if it was a custom DSL, or if they used a well known…

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Unsupervised Evaluation of Code LLMs with Round-Trip Correctness — HN submission

Wed, 21 Feb 2024 20:53:25 GMT

Unsupervised Evaluation of Code LLMs with Round-Trip Correctness

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.