New Generation Interactive Audio Player: Stems, Mixes and Formats
I just thought that it would be great to have a FOSS app for interactive playback. Why should listening to recorded music remain a static, one-way street where you are locked into a single pre-baked stereo bounce?
Imagine an open multi-track format (or an open container, like a zipped archive containing Ogg Vorbis or FLAC streams alongside a manifest) that enables you to play a song while actively controlling the balance and mix of each individual track in real time.
Deconstructing the Mix
Instead of collapsing everything down to two channels before release, songs would be packaged as discrete stems:
- Drums:
- Kick, snare, hi-hats, and percussion buses that can be muted, leveled, or swapped.
- Bass:
- Electric, synth, or acoustic basslines providing the rhythmic foundation.
- Keys & Synths:
- Pianos, synthesizers, atmospheric pads, and sequenced textures.
- Vocals:
- Isolated lead vocals separated from backing harmonies, allowing you to sing along or analyze vocal arrangements.
- Guitars & Arrangements:
- Rhythm guitars, leads, horn sections, or incidental sound design.
Interactive Control & Live Remixing
The beauty of this architecture is that every song would ship with a default preset mix curated by the artist, but the listener retains full control to adjust and customize that balance on the fly:
- Custom Balances: Turn down the guitar solo to hear the subtle bass groove underneath, or boost the synths for a more electronic feel.
- Karaoke & Practice: Mute the lead vocal track completely so you can sing along, or mute the drum track so you can jam along on your own kit.
- Swapping Alternate Takes: Eliminate the standard studio drums and enable an alternate drum take that the artist recorded specifically for the release. Or bring up alternate arrangements that were left out of the primary mix.
Structured Manifest & Metadata
To make this work seamlessly, the archive would include a lightweight configuration manifest (zipped alongside the audio stems). This manifest defines everything the player needs:
- Descriptive names and UI icons for each track so you can instantly recognize and control faders.
- Precise technical metadata for each stem, including tempo (BPM), length, bitrate, sample rate, and stereo positioning.
- Alternative track definitions so third-party stems or community remixes can be cleanly slotted in without breaking the original composition.
Tip
Time-stretching and pitch-shifting capabilities would make this the ultimate practice tool—allowing musicians to slow down complex passages without altering pitch or degrading audio fidelity.
Music should not be a frozen artifact once it leaves the mastering console. Giving listeners the keys to the multi-track mix turns every song into a living, participatory experience. It would honestly be the best audio player ever!