Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers · HackerPapers discussions

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers — mentioned by alephnerd

Tue, 17 Sep 2024 03:07:30 GMT

> Care to give some examples In the 2010s they were the leader in NLP and the precursor of LLMs like GPT3/3.5/4/4o Machine Translation with Human Parity (2018) - https://arxiv.org/abs/1803.05567 MT-DNN (2019) - https://arxiv.org/abs/1901.11504 MASS (2019) - https://arxiv.org/abs/1905.02450 VALL-E (2023) - https://arxiv.org/abs/2301.02111 VALL-E 2 (2024) - https://arxiv.org/abs/2406.05370 While OpenAI was the first to monetize an LLM at scale via ChatGPT, it's still the early stages of this field, and there is a lot of innovation that can still be leveraged, especially in non-English language…

Paper and discussion history. A mention is not an endorsement.

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers — mentioned by CSSer

Sat, 11 Feb 2023 23:20:43 GMT

I think your last point may hold for this genre of music but not necessarily for pop. Pop musicians are extremely versatile. They sort of have to be to stay relevant. Take Ariana Grande for example. She could sing basically anything in any style you want[0], but you may not even have to ask her because we have efficient zero-shot voice cloning now[1]. Before you wonder if this will work for music, check out this video of AI generated Eminem track[3]. [0] https://www.youtube.com/watch?v=ss9ygQqqL2Q [1] https://arxiv.org/pdf/2301.02111.pdf [2] https://aka.ms/valle (demos from one) [3]…

Paper and discussion history. A mention is not an endorsement.

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers — mentioned by syntaxers

Tue, 10 Jan 2023 07:46:50 GMT

On your first point, there's some really good results from this paper: Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers https://arxiv.org/abs/2301.02111 Website with examples: https://valle-demo.github.io/ For your second question, Apple is already rolling out AI-narrated audiobooks. See: https://arstechnica.com/gadgets/2023/01/apple-rolls-out-ai-n...

Paper and discussion history. A mention is not an endorsement.

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers — HN submission

Mon, 09 Jan 2023 18:42:16 GMT

Neural Codec Language Models Are Zero-Shot Text to Speech Synthesizers

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.