WizardCoder: Empowering Code Large Language Models with Evol-Instruct · HackerPapers discussions

WizardCoder: Empowering Code Large Language Models with Evol-Instruct — mentioned by meltyness

Fri, 15 Dec 2023 16:14:39 GMT

To that, what can these express, precisely, is an interesting question; so for transformer encoders: https://arxiv.org/abs/2301.10743 Another interesting research topic is the trusted generation of tasks for finetuning https://arxiv.org/abs/2306.08568 And I suppose too running these at the edge is terribly interesting too, if you can find analyses of "quantization" this is a highly active research are, and results are pretty incredible since it cuts resources by huge factors and no one quite knows why. This is one that's easy to dive into with consumer hardware, but don't know any great…

Paper and discussion history. A mention is not an endorsement.

WizardCoder: Empowering Code Large Language Models with Evol-Instruct — mentioned by lhl

Thu, 27 Jul 2023 17:48:54 GMT

While there's some contamination, it's not like the community isn't aware of it. For example, here's this discussion: https://huggingface.co/sahil2801/replit-code-instruct-glaive... This was the HumanEval contamination one dev measured: ``` replit_glaive: 56.71% replit: 7.32% wizard: 4.88% ``` From the WizardCoder paper https://arxiv.org/pdf/2306.08568.pdf you can see that it hits SOTA (for open models) in not just HumanEval and HumanEval+, but also MBPP and DS-1000 as well, so it's not a one off. For those interested in reading more about various considerations for coding models, I highly…

Paper and discussion history. A mention is not an endorsement.