Music Generation

Do Music Generation Models Encode Music Theory?
Music foundation models possess impressive music generation capabilities. When people compose music, they may infuse their …
Megan Wei, Michael Freeman, Chris Donahue, Chen Sun
arXiv PDF BibTeX Sound 🔊
Adaptive Accompaniment with ReaLchords
Jamming requires coordination, anticipation, and collaborative creativity between musicians. Current generative models of music produce …
Yusong Wu, Tim Cooijmans, Kyle Kastner, Adam Roberts, Ian Simon, Alexander Scarlatos, Chris Donahue, Cassie Tarakajian, Shayegan Omidshafiei, Aaron Courville, Pablo Samuel Castro, Natasha Jaques, Cheng-Zhi Anna Huang
arXiv PDF BibTeX
V2Meow: Meowing to the Visual Beat via Video-to-Music Generation
We propose V2Meow, a video-to-music generation system capable of producing high-quality music audio for a diverse range of video input …
Kun Su, Judith Yue Li, Qingqing Huang, Dima Kuzmin, Joonseok Lee, Chris Donahue, Fei Sha, Aren Jansen, Yu Wang, Mauro Verzetti, Timo I. Denk
arXiv PDF BibTeX Music Samples
SingSong: Generating Musical Accompaniments from Singing
We present SingSong, a system that generates instrumental music to accompany input vocals, potentially offering musicians and …
Chris Donahue, Antoine Caillon, Adam Roberts, Ethan Manilow, Philippe Esling, Andrea Agostinelli, Mauro Verzetti, Ian Simon, Olivier Pietquin, Neil Zeghidour, Jesse Engel
arXiv PDF BibTeX 🔊 Examples
Piano Genie
We present Piano Genie, an intelligent controller which allows non-musicians to improvise on the piano. With Piano Genie, a user …
Chris Donahue, Ian Simon, Sander Dieleman
arXiv PDF BibTeX Code 🕹️ Demo Video Blog