Generative Speech Coding with Predictive Variance Regularization · HackerPapers discussions

Generative Speech Coding with Predictive Variance Regularization — mentioned by cbhl

Wed, 16 Aug 2023 20:27:51 GMT

The author, Fabrice Bellard, is well-known for his work on QEMU (among other things), but I'd treat the rest of the posts as "idea sharing" at an early stage. For example, while BPG (Better Portable Graphics) didn't take off, the core idea (image formats based on video codecs) can be found in WebP (VP8, VP9) and AVIF (AV1) and HEIF (HEVC/H.265). For this, I'd look at comparable work in the audio codec space, including Lyra (https://arxiv.org/abs/2102.09660) and SoundStream (https://arxiv.org/abs/2107.03312). For text compression, I think it would be novel if you could get a lossy but…

Paper and discussion history. A mention is not an endorsement.

Generative Speech Coding with Predictive Variance Regularization — mentioned by bscphil

Tue, 02 Mar 2021 01:58:00 GMT

Worth noting that the paper itself explicitly says 90ms algorithmic delay. Seems plausible to me that there might be additional processing required on top of that, and then you have to add network transit time... suffice it to say that the vast majority of use cases are going to be better served by Opus, for the time being. > The overall algorithmic delay is 90 ms https://arxiv.org/pdf/2102.09660.pdf

Paper and discussion history. A mention is not an endorsement.

Generative Speech Coding with Predictive Variance Regularization — mentioned by adrianmonk

Tue, 02 Mar 2021 00:48:38 GMT

Definitely a real effect, but it seems like Google accounted for that in their listening tests. The Google blog post links to the Lyra paper[1], and Section 5.2 of the paper says: > To evaluate the absolute quality of the different systems on different SNRs a Mean Opinion Score (MOS) listening test was performed. Except for data collection, we followed the ITU-T P.800 (ACR) recommendation. You can download those ITU test procedures[2], and skimming through that, it does mention making "the necessary gain adjustments, so as to bring each group of sentences to the standardized active speech…

Paper and discussion history. A mention is not an endorsement.