HackerPapers

arXiv:2309.03926cs.SD

Large-Scale Automatic Audiobook Creation

Brendan Walsh, Mark Hamilton, Greg Newby, Xi Wang, Serena Ruan, Sheng Zhao, Lei He, Shaofei Zhang, Eric Dettinger, William T. Freeman, Markus Weimer

Abstract

An audiobook can dramatically improve a work of literature's accessibility and improve reader engagement. However, audiobooks can take hundreds of hours of human effort to create, edit, and publish. In this work, we present a system that can automatically generate high-quality audiobooks from online e-books. In particular, we leverage recent advances in neural text-to-speech to create and release thousands of human-quality, open-license audiobooks from the Project Gutenberg e-book collection. Our method can identify the proper subset of e-book content to read for a wide collection of diversely structured books and can operate on hundreds of books in parallel. Our system allows users to customize an audiobook's speaking speed and style, emotional intonation, and can even match a desired voice using a small amount of sample audio. This work contributed over five thousand open-license audiobooks and an interactive demo that allows users to quickly create their own customized audiobooks. To listen to the audiobook collection visit \url{https://aka.ms/audiobook}.

arXiv comments
Journal reference
DOI
Subjects
cs.SDSound cs.AIArtificial Intelligence cs.DCDistributed, Parallel, and Cluster Computing cs.DLDigital Libraries cs.LGMachine Learning eess.ASAudio and Speech Processing

On Hacker News

Linked by 2 identifiable commenters in 2 comments across 2 threads, from Sep 2023 to Oct 2023. Found in 1 HN submission from Jun 2024 to Jun 2024. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments2 threads

    • Other discussion: https://news.ycombinator.com/item?id=37637812 Link to audiobooks: https://marhamilresearch4.blob.core.windows.net/gutenberg-pu... Paper: https://arxiv.org/abs/2309.03926

      zuiView on HNParent context

    • Possibly a misleading title, the paper [1] is mostly of Microsoft affiliated authors, with one member of PG. [1] https://arxiv.org/pdf/2309.03926.pdf edit: I'm not sure what's particularly exciting about this paper otherwise, it just seems like they parsed the PG html format and…

      iwonthecaseView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.