A research project exploring the role of machine learning in the process of creating art and music.
Photo credit: Music Hackspace Last month we released Magenta RealTime 2 (MRT2) , our state-of-the-art open live music model and real-time neural synthesis engine. When developing MRT2, our priority was to create a model that was flexible, controllable and powerful enough for anyone to build their own instruments with it. In the month since the release, we’ve had a lot of fun engaging with the…
We’re excited to share Magenta RealTime 2 (MRT2), a state-of-the-art open model and efficient real-time inference engine that enables you to build and play AI musical instruments on your laptop! To get started, download the apps on your MacBook (requires Apple Silicon). Plugin Bundle (MacOS) View on GitHub Models Unlike other large generative music models that work offline to turn a prompt into a…
View on GitHub Discuss on Discord Get the plugin Six months ago we released The Infinite Crate , a DAW plugin that brings the Lyria RealTime music model into Digital Audio Workstations (DAWs) to improve the sampling workflow for producers. Since its release it’s been used by some of our favorite artists — including a wonderful showcase with Daito Manabe in Tokyo — and was featured as an exciting…
Today we’re launching Lyria Camera , an app that uses Lyria RealTime to make music with your camera. By combining Gemini’s image understanding and the Lyria RealTime API , Lyria Camera generates a musical score that adapts to your environment on the fly. It works by translating the visual scene into musical descriptors via Gemini , producing prompts like Reflective piano, cityscape calm . The…
Today, we’re excited to launch Space DJ, a web application from Magenta that turns music exploration into an interactive journey through a constellation of sounds. You pilot a spaceship through a galaxy where each star represents a musical genre. As you navigate this universe, Space DJ uses the Lyria RealTime API to generate a continuous stream of music that reflects your position and selections…
🎵 Get the plugin 📖 Learn more Live Generative Music in your DAW Today, we’re happy to share The Infinite Crate , a DAW plugin prototype that integrates the Lyria RealTime API directly into your favorite music software. Use text prompts to steer a continuously evolving stream of music and feed the audio directly into your DAW for sampling, live performance, or a backing track to jam with.…
Magenta RealTime Today, we’re happy to share a research preview of Magenta RealTime (Magenta RT), an open-weights live music model that allows you to interactively create, control and perform music in the moment. Colab Demo 📝 Paper GitHub Code Model Card Magenta RT is the latest in a series of models and applications developed as part of the Magenta Project. It is the open-weights cousin of Lyria…
Lyria RealTime API Lyria team For the last few years, we have continued to explore how different ways of interacting with generative AI technologies for music can lead to new creative possibilities. A primary focus has been on what we refer to as “ live music models ”, which can be controlled by a user in real-time. Lyria RealTime is Google DeepMind’s latest model developed for this purpose, and…
TL;DR: Magenta Studio , first released in 2019, has been updated to more seamlessly integrate with Ableton Live. No functionality has changed, there are only UI changes and internal fixes. Please download and enjoy! If you’re new to Magenta Studio, please read our previous post about what it is and how it works. What’s New In the previous version of Magenta Studio, the Max for Live (M4L) plugin…
Tl;dr: Dan Deacon worked with Google’s latest music AI models to compose the preshow music. Check out the MusicLM demo in the AI Test Kitchen app . Read on for more details about our collaboration with Dan Deacon. Dan Deacon’s I/O Performance On several occasions, we have had the pleasure of working with musicians that perform at Google I/O. This is an opportunity for us to bring our latest…