Google’s Instrument Playground Uses AI to Create Abstract Musical Clips Inspired by Over 100 Instruments

Google has launched a new generative AI experiment called Instrument Playground, which allows users to create abstract musical clips inspired by over 100 instruments from around the world. This tool, designed by Simon Doury, an Artist in Residence at Google Arts & Culture Lab, leverages Google’s MusicLM, a text-to-music AI model that became publicly available in May.

How It Works

Instrument Playground starts by asking for a simple prompt containing the name of a musical instrument, optionally preceded by an adjective like "upbeat," "strange," or "gloomy." The system then generates a 20-second audio clip as a starting point for your composition. These clips are often abstract and may not include the specific sound of the instrument you entered but rather capture the essence or feeling of the prompt.

Key Features

• Instrument Selection: Choose from over 100 instruments, including lesser-known ones like the veena from India, dizi from China, or mbira from Zimbabwe.
• Adjective Prefixes: Precede your instrument with adjectives to suggest different styles. For example, "moody tuba" or "romantic violin."
• Abstract Compositions: The results are often abstract and may not be what you expect. For instance, "angry tuba" might sound more like a synthesized pipe organ with tuba aspirations, while "strange didgeridoo" could evoke an ominous section of a Hans Zimmer score.
• Limited Adjectives: Some adjectives, such as "quirky" or "psychedelic," are rejected for unspecified reasons. The system also disallows prompts referencing specific artists.

Advanced Composition

Once you have a clip you like, you can further refine it using the following options:

• Ambient: Adjust the overall atmosphere of the clip.
• Beat: Modify the rhythm and tempo.
• Pitch: Change the pitch of the sounds.

For more complex compositions, an advanced mode opens up a sequencer to layer and loop up to four tracks. This allows you to create a more unique and personalized musical piece. Once you’re satisfied, you can download your creation as a .wav file.

Getting Started

Google has provided a holiday-themed example to inspire users. If you’re ready to dive in, visit Instrument Playground and log in with your Google account to start composing.

Technical Underpinnings

• MusicLM: The backbone of Instrument Playground is MusicLM, a powerful text-to-music AI model. It uses deep learning techniques to generate musical clips based on textual prompts.
• Abstract Generation: The system focuses on creating abstract compositions that capture the emotional or stylistic essence of the input rather than literal instrument sounds.
• User Interaction: The interface is designed to be user-friendly, allowing non-experts to experiment with music creation.

Conclusion

Instrument Playground offers a unique and creative way to explore the intersection of AI and music. Whether you’re a seasoned musician or just curious about what an "angry tuba" might sound like, this tool provides a fun and accessible entry point into generative music.