Machine Learning

Local Deployment of Large-Scale Music AI Models on Commodity Hardware
We present the MIDInfinite, a web application capable of generating symbolic music using a large-scale generative AI model locally on …
Xun Zhou, Charlie Ruan, Zihe Zhao, Tianqi Chen, Chris Donahue
arXiv PDF BibTeX 🕹️ Demo
Do Music Generation Models Encode Music Theory?
Music foundation models possess impressive music generation capabilities. When people compose music, they may infuse their …
Megan Wei, Michael Freeman, Chris Donahue, Chen Sun
arXiv PDF BibTeX Sound 🔊
Adaptive Accompaniment with ReaLchords
Jamming requires coordination, anticipation, and collaborative creativity between musicians. Current generative models of music produce …
Yusong Wu, Tim Cooijmans, Kyle Kastner, Adam Roberts, Ian Simon, Alexander Scarlatos, Chris Donahue, Cassie Tarakajian, Shayegan Omidshafiei, Aaron Courville, Pablo Samuel Castro, Natasha Jaques, Cheng-Zhi Anna Huang
arXiv PDF BibTeX
V2Meow: Meowing to the Visual Beat via Video-to-Music Generation
We propose V2Meow, a video-to-music generation system capable of producing high-quality music audio for a diverse range of video input …
Kun Su, Judith Yue Li, Qingqing Huang, Dima Kuzmin, Joonseok Lee, Chris Donahue, Fei Sha, Aren Jansen, Yu Wang, Mauro Verzetti, Timo I. Denk
arXiv PDF BibTeX Music Samples
Anticipatory Music Transformer
We introduce anticipation: a method for constructing a controllable generative model of a temporal point process (the event process) …
John Thickstun, David Hall, Chris Donahue, Percy Liang
arXiv PDF BibTeX 🔊 Examples Code
It's Raw! Audio Generation with State-Space Models
Developing architectures suitable for modeling raw audio is a challenging problem due to the high sampling rates of audio waveforms. …
Karan Goel, Albert Gu, Chris Donahue, Christopher Ré
arXiv PDF BibTeX 🔊 Examples Code
Adversarial Audio Synthesis
Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of …
Chris Donahue, Julian McAuley, Miller Puckette
arXiv PDF BibTeX 🔊 Examples Code 🕹️ Demo Notebook
Piano Genie
We present Piano Genie, an intelligent controller which allows non-musicians to improvise on the piano. With Piano Genie, a user …
Chris Donahue, Ian Simon, Sander Dieleman
arXiv PDF BibTeX Code 🕹️ Demo Video Blog
Semantically Decomposing the Latent Spaces of Generative Adversarial Networks
We propose a new algorithm for training generative adversarial networks that jointly learns latent codes for both identities (e.g. …
Chris Donahue, Zachary C. Lipton, Akshay Balsubramani, Julian McAuley
arXiv PDF BibTeX Code 🕹️ Demo
Dance Dance Convolution
Dance Dance Revolution (DDR) is a popular rhythm-based video game. Players perform steps on a dance platform in synchronization with …
Chris Donahue, Zachary C. Lipton, Julian McAuley
arXiv PDF BibTeX Code Dataset 🕹️ Demo