LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition — mentioned by shenberg

Tue, 14 Mar 2023 15:58:13 GMT

It's referred to as distillation in the literature in separate sub-fields (e.g. LRspeech, a paper about low-resource speech-to-text & text-to-speech from Microsoft Research, 2020, uses datasets generated by a large model to train a small one and refers to this as knowledge distillation: https://arxiv.org/abs/2008.03687 )

Paper and discussion history. A mention is not an endorsement.

LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition · HackerPapers discussions

LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition — mentioned by shenberg