home  previous   next 
The Fourteenth Annual Interactive Audio Conference
PROJECT BAR-B-Q 2009
brainstorming graphic

Group Report: Mobile Infra-Structure

   
Participants: A.K.A "1 Plus 1 Equals 11"

Devon Worrell, Intel

Oren Williams, Dolby Laboratories
Wayne Chen, DTS Inc. Ajay Kanji, IDT Inc.

Dan Bogard, IDT Inc.

Niel Warren, Apple

Jim Rippie, Invisible Industries

 

 

Facilitator: Linda Law, The Fat Man
 

Brief statement of the problem(s) on which the group worked:

There is an over-all lack of efficient and effective methods to collaborate across multiple devices and resources.

Users currently do not have a means to discover resources in the immediate area to create an improved audio experience either through better post processing capabilities, better speakers, more speakers, other collaborators, or optimization of the audio environment.

Performance or collaboration has been compromised because the content is either limited to the location where the actual file resides or current means for sharing is limited to a small set of other devices (eg: 1 notebook to 1 cell phone), additionally the current methods are still cumbersome and sometimes ineffective.  Otherwise, the content must be physically copied to the other device.  This has limitations in that the rendering is affected by the individual settings of each device and there is not a cohesive method to share the same experience or synchronize the performance without more detailed actions to “coordinate” the settings within the various devices. 

Methods for discovery of the commonalities necessary for the collaborative audio experiences are lacking.  There are few common formats, even fewer common interchange and limited discovery or resource tools available.  These barriers cross several market and application levels.  Different hardware devices must be able to communicate seamlessly, but too many proprietary systems create obstacles to this goal.

General Obstacles & Challenges Discussed

  • Synchronization challenges
    • Lack of common format – Dolby, DTS, Sample Rates, Channels
    • Discovery capabilities
      • Multiple connections choices: Peer to Peer, Wireless – 802.11, Bluetooth, WiFi
      • No mechanism to recognize the “goodness” of a device (speaker capabilities, mic arrays, processing capability, power source, fidelity)
    • Language and protocols across markets have no true commonality
  • Minimal bidirectional communication and control systems
  • Common network (discovery and control, streaming)
  • Product differentiation (marketing)
  • Coordinating all the different market spaces (PC, CE, automotive, etc.)
  • Who is the master device?
  • Security
  • User Error

Two devices > 1 device (If you solve the problems discussed, you get opportunities for…)

  1. Playing songs from one device on the other device using “best” capabilities available
  2. Use the both devices’ speaker to optimize experience
  3. Sharing of resources allows processing to be done on the system with optimal power, faster processor, or higher fidelity.  Appropriate selection of the computing resource can provide conservation of energy for one or more devices (transitory, content is retained only for duration of the broadcast or stream)
  4. Collaboration would now be easier– e.g. song writing, performance, etc… because bi-directional streaming with synchronization would be possible.
  5. Mo’ loudness via the multiplication of audio renderers
  6. Many cell phone users coming together to make a concert or mass conference
  7. More immersive experience, depth, constellating (openness to meaningful, connections to data)
  8. Moving from space to space, with auto-streaming to nearby devices with sound shaped for personal listening environment as you move.
  9. Customizing your Personalized Sound: content is tuned to your listening preferences.
  10. Share settings – EQ, etc… 
    1. Content is streamed from source A to receiver B and system configures to the equivalent settings of source A for receiver B.
    2. Automotive application – discovery of additional speakers & speaker position, tunes the vehicle to drivers preference (rental car)
  11. Usage of available microphones
    1. Custom tuning to the room acoustics
    2. Interactivity in a presentation/conference with people’s device(laptop’s speakers and mic)
  12. Music discovery
    1. Hear on radio or other source then device finds it when available. 
    2. Collaboration to synchronization with another device, other information is made available, such as the sources “favorites list”, where, when, how…
    3. Collaborative Genius List – Is there a way to synch and discover commonalities/differences between libraries
  13. Send data to the other device but get it back improved (content is now retained in the receiving device)
  14. Multiple devices can be physically linked to create better audio system
  15. Add subwoofer – pocket sub! Shakers – motion devices

 

A brief statement of the group’s solutions to those problems.

By the intrinsic portability of the majority of the base resource units (smart phones, portable music players), being a wireless solution is the desired goal.

Explicitly just like having multiple devices, in the application level, the sum of the parts make up much more than the individual.  There are a variety of solutions which exist for the mosaic of platforms, applications, and communication protocols.  Issues arise that within each level, no one solution stands out as being the ideal to realize the desired end result.

Some of the possible steps to address the solution:

  1. You need to be able to discover the available resources in the area
  2. Once the resources are discovered, you must then be able share the information (bi-directionally)
  3. During playback, there needs to be a method to coordinate the playback/performance/collaboration
  4. Control decisions must be made to define the framework of how devices will interact and integrate

Potential Components to the Mosaic

  • Mechanisms of Discovery
    • WiDi,
    • Bon Jour, HDMI: EDID/SAD (861e), AVC, descriptor based XMLs,
    • Bluetooth as transport
      • Low power, secure, already exist in most devices and across market spaces
  • Mechanisms of streaming/sharing
    • VOIP protocol for data streaming?  (802.1Qav)
      • It is real time
      • Multiple site transmission
      • Efficient
  • Methods of Synchronization
    • 802.1AS, NTP would be appropriate starting points for creation of an effective synch method.
    • Plesiochronous was also a proposed option, but the team did not believe that this would be a feasible solution since it is only pseudo synchronization.
  • Control device(s)
    • Will need to initiate an initial “hello” to setup
    • Will need to determine direction of communication and resource usage assignment
    • Will need to maintain the coordination of the activity of the Mosaic
  • Behaviors, Tokens, and Certificates within each of the facets of the mosaic.
    • How devices will interact
    • Automatic behaviors
    • Security within the system
    • Meta-data about the system, resources, user information, etc…

Items from the brainstorming lists that the group thought were worth reporting:
Pure unadulterated BRAIN STORMING – the unrestrained stream… (let the goodness flow)
Two devices > 1 device

  • Take up more space
  • Better “step” stool – taller?
  • More Displays
  • Acoustic changes hold them near each other against each other
  • Dock them
  • Take multiple devices apart, build one
  • Hat with spinner – surround sound propeller hat reinvented

Other reference material:

Outline of topics the Workgroup discussed and are material to the refinement of the final report.

    • Interconnectivity
      • 802.11
      • Bluetooth
    • Information format
      • DTS
      • Dolby
      • Sample rate, bit size
    • We have content but does not work in bidirectional way with other devices. This needs to work without transferring files.
    • Question
      • Why can’t I walk up to a system and share its audio and processing capabilities to shared advantage without transferring files
    • Given
      • I have my content and devices
    • Problem
      • I run into situations with devices that have audio capabilities but can not use both devices to optimize the experience
    • Mission
      • We will optimize listening experiences using the audio capabilities of all available devices
    • Brain storming
      • Two devices > 1 device
        • Take up more space
        • Play songs from one device on the other device using “best” capabilities available
        • Use the both devices’ speaker to optimize experience
        • Share the processing power to dump processing on more processing rich device
          • Conserve energy for one device
        • Sync audio for interaction/creation
        • Collaboration – song writing, performance
        • More volume
        • May cell phone users make concert
        • More immersion, depth, constellating ( openness to meaningful, connections to data)
        • Moving from space to space, device auto streams to nearby devices
        • Sound shaped for listening environment as you move around
        • Personalized sound – your hearing, preferences
        • Custom tuning to room acoustics
          • Use mics – additional mics advantage
        • Better stool – taller?
        • More Displays
        • Acoustic changes hold them near each other against each other
        • Dock them
        • Music discovery – hear on radio then device finds it when available
        • Share settings – EQ, etc…
        • Application uses the devices to tune the settings for the environment
        • Send data to the other device but get it back improved
        • When a device finds sound at other device, also note location – knows  where it is available
        • Take multiple devices apart, build one
        • Add subwoofer – pocket sub!
        • Shakers – motion devices
        • Automotive apps – automatically shares more speakers, tunes to vehicle, sharable vehicle profile
        • Hat with spinner – surround sound propeller hat reinvented
        • Interactivity in a presentation/conference with people’s device(laptop’s speakers and mic)
      • Obstacles – challenges
        • Common formats – Dolby, DTS, Sample Rates, Channels
        • Synchronization
        • Discovery capabilities
          • Peer to Peer – Wireless – 802.11, Bluetooth, WiFi
          • Today there is no mechanism to recognize the “goodness” of a device (speakers, mic, processing, power, fidelity)
          • Language - protocol
        • Bidirectional communication and control
        • Common network (discovery and control, streaming)
        • Product differentiation (marketing)
        • Coordinating all the different market spaces (PC, CE, automotive, etc.)
        • Who is the master device?
        • Security
      • Solutions
        • Mechanisms of discovery
          • WiDi, HDMI as discovery mechanism
          • Bluetooth as transport
            • Low power, secure, already exist in most devices and across market spaces
        • VOIP protocol for data streaming
          • It is real time
          • Multiple site transmission
          • Efficient
        • Synchronization
          • 802.1as
        • Master device
          • Will need to do an initial “hello” to setup a new device
        • Tokens and certificates with information and specified time line
          • How devices will interact
          • Automatic behaviors

    section 5


next section

select a section:
1. Introduction
2. Executive Summary
3. Hear, There, and Everywhere
4. Dick and Jane Tracy plug into the Matrix
5. Mobile Infra-Structure
6. Re-imagining Operating System/Hardware Services for Applications
7. Schedule & Sponsors