Fast Timing-Conditioned Latent Audio Diffusion — mentioned by zaptrem

Mon, 03 Mar 2025 20:26:45 GMT

There are! Audio models are actually quite similar to image models, but there are a few key differences. First, is the autoencoder needs to be designed much more carefully as human hearing is insanely good and music requires orders of magnitude more spatial compression (image AEs do 8X8 downsampling, audio AEs need to do thousands of times downsampling). Second the model itself needs to be really good at placing lyrics/beats (similar to placing text in image diffusion): a sixth finger in an image model is fine, but a missed beat can ruin a song. That's why language model approaches (which…

Paper and discussion history. A mention is not an endorsement.

Fast Timing-Conditioned Latent Audio Diffusion — mentioned by emadm

Tue, 13 Feb 2024 15:58:05 GMT

This is part of a paper on the prior version of the model: https://x.com/stableaudio/status/1755558334797685089?s=20 https://arxiv.org/abs/2402.04825 Which outperforms similar music models. The pace is accelerating and even better ones are coming with far greater cohesion and... stuff. Will be quite the year for music.

Paper and discussion history. A mention is not an endorsement.

Fast Timing-Conditioned Latent Audio Diffusion · HackerPapers discussions

Fast Timing-Conditioned Latent Audio Diffusion — mentioned by zaptrem

Fast Timing-Conditioned Latent Audio Diffusion — mentioned by emadm