Yes, jellyfish DJ’d the “opening set” at #
GoogleIO# this year. 🪼Let’s dive in 🌊
We partnered with Monterey Bay Aquarium to build a generative music experiment where moon jellies, live-streamed from their home at the aquarium, controlled music made by Lyria 3.
The jellies were tracked by a lightweight object detection model running on a tiny Coral NPU housed on a Synaptics Coralboard — the same type of object detection model used to power conservation efforts in the Great Barrier Reef.
The Coralboard sent the jellies’ coordinates to our music generation engine. Each quadrant of the screen represented an instrument — drums, bass, chords or melody. The number of jellies in each quadrant determined the weighting of those sounds, translating their movements into music.