Calling Joe Six-Track

Posted on Leave a commentPosted in 2017 Workgroup Topic Proposals

How can we help the average Joe record and distribute immersive audio?

360° cameras are on the rise; let’s spec out some affordable and easy-to-use 360° (or even spherical) audio systems.

Some components to explore:

  • The listening experience: What is the thriller app?
  • Playback systems: Binaural? Multichannel? Head-tracking? Vibration enhanced? Scaled?
  • Transmission systems: What are the file/transport format requirements?
  • Mixing systems
  • Composing and synthesizing systems
  • Recording systems

I’ve listed these in reverse to imagine the payoff so we can identify ways to get there.

As a background question, what are some Joe-friendly ways to record and distribute immersive audio today? I’ve tried software to make “AC3” DVDs and DTS CDs, the Zoom H2N 5-mic recorder’s stereo mixdown, in-ear mics, and spatializer plugins, but none has really curled my mustache.

David Battino

Sound Egg Joe
A $2,000 Sound Egg seems to do the trick, but there’s gotta be a better way.

From Audinary to Visionary

Posted on 2 CommentsPosted in 2016 Workgroup Topic Proposals

YouTube is now the largest music-streaming service. Facebook lets you post videos, but not audio. Many musicians get around this by posting non-moving movies consisting of a stereo music track and a picture of an album cover. But what if music could become the foundation for dynamic, compelling video? That could make the whole audio chain more popular.

Imagine a visualizer driven by a combination of audio metadata, DSP, and artificial intelligence…perhaps even influenced by other sensor inputs. Instead of wiggling wireframes, this system could approach cinematic storytelling. And not just in video, but AR and VR as well.

What hooks could we add to audio files to generate more immersive visuals? What are the opportunities in production and delivery? And why are people who imagine the future called visionaries?

Footnote: Creative Labs did some groundbreaking work on music visualization back in 1999 with Lava/Oozic. The system used a proprietary file format and web player, and it died around the dot-com crash, but there were some ambitious ideas in there.

Singing with Your Thumbs

Posted on Leave a commentPosted in 2015 Workgroup Topic Proposals

What could replace ringtones as the next big personalized audio upgrade?

I think Peter Drescher heard the future back in 2007 when he wrote “Singing With Your Thumbs: How To Make User Interfaces Musical.” (If you’re lucky, the little JavaScript audio player I wrote to present his examples will still work.)

In the article, Peter, who’s also a two-time BBQ speaker, shares his insights on adding warmth and personality to devices through evocative sound. In the emerging Internet of Things, imagine how much further that could go if devices not only sung beautifully, but also harmonized with each other and the environment.

Peter Drescher
Who says there’s no sound in space?

That Droning Sound

Posted on 3 CommentsPosted in 2015 Workgroup Topic Proposals

What’s the hottest new consumer technology? Helicopter drone video. What’s the worst thing about helicopter drone video? That droning sound. (Or no sound at all.) Imagine…

  • A drone-mounted mic that cancels the propeller sound, producing pristine soundtracks
  • A ring of drone-mounted speakers that follow you around, for mobile surround sound (“wingtones”)
  • An app that synthesizes music from silent drone video

More practically, future noise cancellation algorithms will offer numerous opportunities for adding sound and music to previously hostile environments. What are some scenarios that would encourage that development?

Party Drone
The 450-watt flying party speaker. Just need four more. (Click for video.)

Social Stereo

Posted on 2 CommentsPosted in 2013 Workgroup Topic Proposals

It saddens me to see two people sharing a single set of earbuds, one lonely channel per listener. What if there were an app that let one person broadcast music to the mobile devices of nearby friends? Add voice and text chat, plus some ways to monetize the service through DSP plug-ins, hardware add-ons, and referral fees for promoting music.

What are the requirements, and what types of businesses could result?

Failing that, how about some really immersive headphones?