Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding — mentioned by numeri

Mon, 03 Mar 2025 21:33:15 GMT

I've been slightly annoyed by how the Speculative Decoding paper has gotten all the credit for the technique – I first learned about the technique from a paper more than a year older[1], Shallow Aggressive Decoding. They introduce the same method, but apply it to grammatical error correction, meaning the "draft" output is just the input itself. The Speculative Decoding paper tries to emphasize differences between this and their method, saying that theirs is more general, as they apply it to more domains, allowing the draft to come from a smaller model, and extend it to allow sampling. All of…

Paper and discussion history. A mention is not an endorsement.

Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding · HackerPapers discussions

Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding — mentioned by numeri