A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages · HackerPapers discussions

A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages — mentioned by minetest2048

Tue, 30 Jul 2024 02:53:26 GMT

There is a paper that claims that Julia performs the best in ChatGPT: https://arxiv.org/abs/2308.04477 Chris blog on that: https://www.stochasticlifestyle.com/chatgpt-performs-better-...

Paper and discussion history. A mention is not an endorsement.

A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages — HN submission

Fri, 08 Dec 2023 18:10:30 GMT

A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Languages

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages — HN submission

Thu, 23 Nov 2023 20:17:12 GMT

A Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages — mentioned by PaulHoule

Wed, 25 Oct 2023 22:26:27 GMT

I could swear I saw this the other day but I couldn’t find it in YOShInOn, here is an older paper which gets results like this for C/C++ but does a lot better with R, see Figure 1 https://arxiv.org/pdf/2308.04477.pdf The results of this kind of eval could be across the board, you could pick out a set of examples worse than what I said (Games, C++) or pick one out that is really good (Algorithms, Ruby) There was this one also https://arxiv.org/abs/2310.12357 which showed some pitfalls…. In some case the LLM could say which project the source code was from which meant it had seen it in the…

Paper and discussion history. A mention is not an endorsement.