SlideShare a Scribd company logo
1 of 58
Audio Rendering
 & Ambisonics
Audio Rendering
• A single file format contains complete
  (3D?) soundfield data
• At the playback end, the system reproduces
  it to the best of its ability
• Analogous to a Postscript file/printer.
• No 1:1 channel:speaker mapping
• Ambisonics is an example
Ambisonics
• The result of experiments by several
  researchers:
• Professor Fellgett at University of Reading
• Michael Gerzon, Mathematical Institute,
  Oxford
• and others
Michael A Gerzon
Michael A Gerzon
Michael A Gerzon

• 1945–1996
Michael A Gerzon

• 1945–1996
• A true genius, at the level of Blumlein
Michael A Gerzon

• 1945–1996
• A true genius, at the level of Blumlein
• Developed technologies that are still ahead
  of their time:
Michael A Gerzon

• 1945–1996
• A true genius, at the level of Blumlein
• Developed technologies that are still ahead
  of their time:
  • Ambisonics; lossless digital coding; etc
Ambisonics

• Arose out of experiments with four-mic
  tetrahedral arrays
• Led to the development of the Soundfield
  mic
• SFM extends Blumlein into 3D
Ambisonic Advantages




• Apparent movement of sound source
• Ambisonics uses more than just level to provide
  localisation cues – listener position independent
Beyond level-only
          localisation




• Phase-shift panning: localisation by L/R phase
  relationships
Ambisonic Advantages
• In Ambisonics, each location has its own
  combination of level and phase
  relationships.
• Head Related Transfer Functions (HRTF)
  are not considered.
• Decoder is configured to match the
  speaker array in the room – original design
  goal.
Soundfield Microphone
     Principles
• Mid-Side recording
  captures a stereo
  stage (with a good
  sense of depth)
• Omni (L+R) and
  figure-8 (L-R)
Soundfield Microphone
     Principles
• SFM extends this into
  three dimensions
• Omni (sum of all
  directions) “W”
• Three figure-8s at right
  angles “X”, “Y”, “Z”
Soundfield Microphone
    Capsule Array
• Tetrahedral array of
  capsules as close as
  possible
• Circuitry for coincidence
  compensation
• Coincident up to about      Original
  10kHz                        SFM
                              Design
Other SFM Designs


• Tetramic from Core Sound
  …and several others
A-format to B-format



• Capsule signals
  converted to sum &
  difference signals
B-Format:
   The Studio Format
• W = Left + Right + Front + Back
       (+ Up + Down)
• X = Front – Back
• Y = Left – Right
• Z = Up – Down
Halliday/Nimbus
        mic array

• Generates B-Format
  directly
• Omni and two
  figure-8 mics
Transmission

• B-Format thought not suitable for
  transmission as it is not stereo-compatible.
• Is this still a valid problem?
• Could B-Format be carried on DVD? BRD?
Ambisonics
• Two original methods of
  transmission:
Ambisonics
• Two original methods of
  transmission:
 • B-Format (the studio
    format):
    sum & difference channels.
Ambisonics
• Two original methods of
  transmission:
 • B-Format (the studio
    format):
    sum & difference channels.
 • UHJ stereo-compatible
    matrix:
    (typically 2-channel UHJ).
2-channel Transmission
• Matrixing system based on UD-4
• BBC Matrix H, HJ
• UHJ (“Universal HJ”)
• Convert B-Format into a 2-channel format
• Stereo/mono compatible
• Decode at the listening end to suit room
2-Channel Decoder
• Requires the
  listener to have a
  decoder at home
• One more item to
  buy – probably not
  supplied with the
  audio system
Benefits of
Playback-end decoding
• One single source (disc, file etc) the same
  for all applications
• Decoder is configured for the playback
  environment:
  • Number and position of speakers etc
Disadvantages of
Playback-end decoding
• Decoders are needed ‘out there’.
• People have to use them, and set them up
  correctly.
• May be easier with software-based playback
  systems.
The Other Side
       of Ambisonics

• Ambisonics was conceived originally as a
  method of accurately capturing and
  reproducing a natural acoustic event.
The Misconception




• “Ambisonics requires recording with
   a special microphone/array.”
The Misconception

• Almost no commercial music can be picked
  up live with a single microphone
• So what use is Ambisonics?
• Luckily, there are other methods besides a
  special microphone.
Ambisonic Mixing
Ambisonic Mixing
• The vast majority of
  popular music is mixed
  from multitrack.
Ambisonic Mixing
• The vast majority of
  popular music is mixed
  from multitrack.
• Ambisonic panpots predate
  the Soundfield Microphone
Ambisonic Mixing
• The vast majority of
  popular music is mixed
  from multitrack.
• Ambisonic panpots predate
  the Soundfield Microphone
• Ambisonics is particularly
  good at this: for example,
  it’s isotropic.
Ambisonics is
           good at…
• Ambisonics specialises in accurate
  localisation
• Suggests that if you take care of
  localisation, envelopment will take care of
  itself.
• Is this true?
Ambisonic Mixing:
       Principles

• Multitrack environment
• Conventional recording techniques
  (may add an SFM if helpful)
• Ambisonics is used at the Mixing stage
Ambisonic Mixing:
      Principles
• Mono/stereo sources
• B-Format panpots
• B-Format bus
• Record the mix (3- or 4-channel B-Format)
• Monitor the mix (decoder fed by B-format
  bus)
Ambisonic Mixing
        System
• Ambisonic
  Mixing System
  designed to
  allow
  conventional
  consoles to do
  Ambisonics
Ambisonic Mixing System
Ambisonic Mixing Today:
   DAW Support
• DAW needs to have true multichannel
  architecture – not all do!
• Most popular:
  Steinberg Cubase & Nuendo (VST);
  Apple Logic Pro & Soundtrack Pro 2 (AU);
  Audio Mulch & Plogue Bidule (VST)
• Pro Tools is NOT (really) supported
DAW Plug-ins
       for Ambisonics
• Panners, decoders, reverb etc
  implemented as plug-ins
• VST is the most popular
• Audio Units (Apple) also available (B2X)
• First Order Ambisonics recommended
  (higher orders also available)
Some DAW Plug-ins
  for Ambisonics
• Daniel Courville’s B2X suite (Mac only)
• University of York (Mac/Win)
• Gerzonic (Bidule/Audiomulch)
• Bruce Wiggins (Reverb)
• Swiss Centre for Computer Music
  (Max/MSP)
• Visual Virtual Microphone
Some Current Tools

• Daniel
  Courville’s
  B2X
• Apple Audio
  Unit and VST
  plugins
Some Current Tools


• Swiss Centre for
  Computer Music
• VST plugins
Some Current Tools

• University of York
• VST Plugins
• Also higher-order designs
Future Tools?


• Manipulate sounds in
  3D space in a virtual
  world?
Ambisonic Application:
  Large-scale PA
• Funktion One:
  Tony Andrews
• Chemical Brothers,
  Glastonbury Festival
• London’s Millennium
  Dome central show
• Sancho Panza at the
  Glade Festival
Replay & Monitoring
     Observations
• Goal: Wide, accurate listening area
  (or a wide area with a good experience).
• Ideally all speakers are the same.
• Ideally all speakers are full range.
• Speakers should have wide dispersion.
• To a point, more speakers are better
  (decoder must support them).
Degrees of Freedom
• Position virtual sources at any angle around
  the listener (including height)
• Position sounds at a distance with radius
  vector, level and reverb combinations
• Sounds can be stationary or move
• Create a complete synthetic soundfield,
  either like or unlike reality
Artistic Freedom
• Some people feel that direct virtual sources
   should occupy the front stage and only
   ambience behind the listener – NO!
• Place sounds anywhere that you think is
   valid (including the above).
• Mix of a live concert might be like the
   above; in the studio, anything goes.
• If it sounds right, it is right.
Surround Sound offers:
• More freedom to create a sonic
  environment for the listener
• A more immersive experience
• More listener involvement
• Re-creating a real acoustic space/
  performance
• Creating virtual acoustic spaces
Ambisonics offers:
• Better efficiency than 5.1, 7.1, 10.2 etc
• More accurate rendering of source position
• Side and rear images (and height)
• Device-independent rendering: image
  quality is a function of the replay system
• Replay system to suit the environment
If Ambisonics is so
       wonderful…
• Why isn’t everyone using it?
• The old stories…
• Public Domain!
• A lot of people are…
• Free tools and systems
• Some development needed (Pro Tools etc)
Ambisonic Recordings
 www.ambsonia.com
More Resources
at ambisonic.net
Ambisonics Today

• Ambisonics has never been as accessible
• Most tools are free
• You can develop your own
• But what about replay on existing surround
  systems – eg 5.1 home theatre?
Spatial Sound 3: Audio Rendering and Ambisonics

More Related Content

What's hot

What's hot (15)

Verilog 모듈 연결하기
Verilog 모듈 연결하기Verilog 모듈 연결하기
Verilog 모듈 연결하기
 
Space odyssey interpretation
Space odyssey interpretationSpace odyssey interpretation
Space odyssey interpretation
 
Shot size handout
Shot size handoutShot size handout
Shot size handout
 
Developing and optimizing a procedural game: The Elder Scrolls Blades- Unite ...
Developing and optimizing a procedural game: The Elder Scrolls Blades- Unite ...Developing and optimizing a procedural game: The Elder Scrolls Blades- Unite ...
Developing and optimizing a procedural game: The Elder Scrolls Blades- Unite ...
 
Conventions Of Music Videos
Conventions Of Music VideosConventions Of Music Videos
Conventions Of Music Videos
 
Media key terms editing
Media key terms editingMedia key terms editing
Media key terms editing
 
Documentary Making 101
Documentary Making 101Documentary Making 101
Documentary Making 101
 
Basic Documentary Genres Outline
Basic Documentary Genres OutlineBasic Documentary Genres Outline
Basic Documentary Genres Outline
 
Music & Film
Music & FilmMusic & Film
Music & Film
 
GCSE Film Studies - Sound
GCSE Film Studies - SoundGCSE Film Studies - Sound
GCSE Film Studies - Sound
 
Cinematography
CinematographyCinematography
Cinematography
 
Bohemian Rhapsody Music Video Analysis
Bohemian Rhapsody Music Video Analysis Bohemian Rhapsody Music Video Analysis
Bohemian Rhapsody Music Video Analysis
 
Future Directions for Compute-for-Graphics
Future Directions for Compute-for-GraphicsFuture Directions for Compute-for-Graphics
Future Directions for Compute-for-Graphics
 
Introduction to factual programming
Introduction to factual programmingIntroduction to factual programming
Introduction to factual programming
 
Zedroid - Android (5.0 and later) on Zedboard
Zedroid - Android (5.0 and later) on ZedboardZedroid - Android (5.0 and later) on Zedboard
Zedroid - Android (5.0 and later) on Zedboard
 

Viewers also liked

Spatial Sound parts 1 & 2
Spatial Sound parts 1 & 2Spatial Sound parts 1 & 2
Spatial Sound parts 1 & 2Richard Elen
 
Ambisonics: Getting the Best Surround Around
Ambisonics: Getting the Best Surround AroundAmbisonics: Getting the Best Surround Around
Ambisonics: Getting the Best Surround AroundRichard Elen
 
UCSD_SRC Presentation
UCSD_SRC PresentationUCSD_SRC Presentation
UCSD_SRC PresentationMelisa Tallis
 
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...Robert Ballon
 
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...奈良先端大 情報科学研究科
 
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」 SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」 IGDA Japan SIG-Audio
 
Speech recognition
Speech recognitionSpeech recognition
Speech recognitionCharu Joshi
 
Life Beautiful Monday
Life Beautiful MondayLife Beautiful Monday
Life Beautiful MondayPentiux
 
ETICS- quality certification of open source cloud software, OW2con'12, Paris
ETICS- quality certification of open source cloud software, OW2con'12, ParisETICS- quality certification of open source cloud software, OW2con'12, Paris
ETICS- quality certification of open source cloud software, OW2con'12, ParisOW2
 
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...OW2
 
Portland Front Yard Gardens
Portland Front Yard GardensPortland Front Yard Gardens
Portland Front Yard Gardensgardenmam
 
Ocelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, ParisOcelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, ParisOW2
 
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...OW2
 
Cloud workload guidelines
Cloud workload guidelinesCloud workload guidelines
Cloud workload guidelinesJen Wei Lee
 
Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10OW2
 

Viewers also liked (20)

Spatial Sound parts 1 & 2
Spatial Sound parts 1 & 2Spatial Sound parts 1 & 2
Spatial Sound parts 1 & 2
 
Ambisonics: Getting the Best Surround Around
Ambisonics: Getting the Best Surround AroundAmbisonics: Getting the Best Surround Around
Ambisonics: Getting the Best Surround Around
 
3 D Sound
3 D Sound3 D Sound
3 D Sound
 
UCSD_SRC Presentation
UCSD_SRC PresentationUCSD_SRC Presentation
UCSD_SRC Presentation
 
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
 
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
 
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」 SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
 
Speech recognition
Speech recognitionSpeech recognition
Speech recognition
 
Life Beautiful Monday
Life Beautiful MondayLife Beautiful Monday
Life Beautiful Monday
 
Tech talk: PHP
Tech talk: PHPTech talk: PHP
Tech talk: PHP
 
9000420886
90004208869000420886
9000420886
 
ETICS- quality certification of open source cloud software, OW2con'12, Paris
ETICS- quality certification of open source cloud software, OW2con'12, ParisETICS- quality certification of open source cloud software, OW2con'12, Paris
ETICS- quality certification of open source cloud software, OW2con'12, Paris
 
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
 
Portland Front Yard Gardens
Portland Front Yard GardensPortland Front Yard Gardens
Portland Front Yard Gardens
 
Ayora 2010
Ayora 2010Ayora 2010
Ayora 2010
 
Star Animation I
Star Animation IStar Animation I
Star Animation I
 
Ocelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, ParisOcelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, Paris
 
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
 
Cloud workload guidelines
Cloud workload guidelinesCloud workload guidelines
Cloud workload guidelines
 
Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10
 

Similar to Spatial Sound 3: Audio Rendering and Ambisonics

Future Proof Surround Sound Mixing using Ambisonics
Future Proof Surround Sound Mixing using AmbisonicsFuture Proof Surround Sound Mixing using Ambisonics
Future Proof Surround Sound Mixing using AmbisonicsBruce Wiggins
 
COMP 4010 Lecture5 VR Audio and Tracking
COMP 4010 Lecture5 VR Audio and TrackingCOMP 4010 Lecture5 VR Audio and Tracking
COMP 4010 Lecture5 VR Audio and TrackingMark Billinghurst
 
Location Audio
Location AudioLocation Audio
Location AudioJohn Grace
 
Tutorial for Wavepad
Tutorial for WavepadTutorial for Wavepad
Tutorial for WavepadQobboo
 
Surround Sound
Surround SoundSurround Sound
Surround SoundSid_007007
 
Music production
Music productionMusic production
Music productionjcklp1
 
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4StanfordComputationalImaging
 
Audio production
Audio productionAudio production
Audio productionJack-Tanner
 
Confrontation Audio GDC 2009
Confrontation Audio GDC 2009Confrontation Audio GDC 2009
Confrontation Audio GDC 2009slantsixgames
 
Multitrack Workflow for Cinema/Video
Multitrack Workflow for Cinema/VideoMultitrack Workflow for Cinema/Video
Multitrack Workflow for Cinema/VideoFilmTVsound
 
WebRTC, RED and Janus @ ClueCon21
WebRTC, RED and Janus @ ClueCon21WebRTC, RED and Janus @ ClueCon21
WebRTC, RED and Janus @ ClueCon21Lorenzo Miniero
 
Interactive Voice Con
Interactive Voice ConInteractive Voice Con
Interactive Voice ConDru Wynings
 
audio-production-1231352387673755-2.ppt
audio-production-1231352387673755-2.pptaudio-production-1231352387673755-2.ppt
audio-production-1231352387673755-2.pptKeshvanSugumaran1
 

Similar to Spatial Sound 3: Audio Rendering and Ambisonics (20)

Future Proof Surround Sound Mixing using Ambisonics
Future Proof Surround Sound Mixing using AmbisonicsFuture Proof Surround Sound Mixing using Ambisonics
Future Proof Surround Sound Mixing using Ambisonics
 
COMP 4010 Lecture5 VR Audio and Tracking
COMP 4010 Lecture5 VR Audio and TrackingCOMP 4010 Lecture5 VR Audio and Tracking
COMP 4010 Lecture5 VR Audio and Tracking
 
Audios in Unity
Audios in UnityAudios in Unity
Audios in Unity
 
Location Audio
Location AudioLocation Audio
Location Audio
 
Tutorial for Wavepad
Tutorial for WavepadTutorial for Wavepad
Tutorial for Wavepad
 
Surround Sound
Surround SoundSurround Sound
Surround Sound
 
Music production
Music productionMusic production
Music production
 
Surround sount system
Surround sount systemSurround sount system
Surround sount system
 
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
 
Audio production
Audio productionAudio production
Audio production
 
Audio production
Audio productionAudio production
Audio production
 
Confrontation Audio GDC 2009
Confrontation Audio GDC 2009Confrontation Audio GDC 2009
Confrontation Audio GDC 2009
 
Multitrack Workflow for Cinema/Video
Multitrack Workflow for Cinema/VideoMultitrack Workflow for Cinema/Video
Multitrack Workflow for Cinema/Video
 
WebRTC, RED and Janus @ ClueCon21
WebRTC, RED and Janus @ ClueCon21WebRTC, RED and Janus @ ClueCon21
WebRTC, RED and Janus @ ClueCon21
 
Chapter Seven
Chapter SevenChapter Seven
Chapter Seven
 
Interactive Voice Con
Interactive Voice ConInteractive Voice Con
Interactive Voice Con
 
Digital audio
Digital audioDigital audio
Digital audio
 
Digital audio
Digital audioDigital audio
Digital audio
 
05 audio
05 audio05 audio
05 audio
 
audio-production-1231352387673755-2.ppt
audio-production-1231352387673755-2.pptaudio-production-1231352387673755-2.ppt
audio-production-1231352387673755-2.ppt
 

Recently uploaded

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 

Recently uploaded (20)

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 

Spatial Sound 3: Audio Rendering and Ambisonics

  • 1. Audio Rendering & Ambisonics
  • 2. Audio Rendering • A single file format contains complete (3D?) soundfield data • At the playback end, the system reproduces it to the best of its ability • Analogous to a Postscript file/printer. • No 1:1 channel:speaker mapping • Ambisonics is an example
  • 3. Ambisonics • The result of experiments by several researchers: • Professor Fellgett at University of Reading • Michael Gerzon, Mathematical Institute, Oxford • and others
  • 6. Michael A Gerzon • 1945–1996
  • 7. Michael A Gerzon • 1945–1996 • A true genius, at the level of Blumlein
  • 8. Michael A Gerzon • 1945–1996 • A true genius, at the level of Blumlein • Developed technologies that are still ahead of their time:
  • 9. Michael A Gerzon • 1945–1996 • A true genius, at the level of Blumlein • Developed technologies that are still ahead of their time: • Ambisonics; lossless digital coding; etc
  • 10. Ambisonics • Arose out of experiments with four-mic tetrahedral arrays • Led to the development of the Soundfield mic • SFM extends Blumlein into 3D
  • 11. Ambisonic Advantages • Apparent movement of sound source • Ambisonics uses more than just level to provide localisation cues – listener position independent
  • 12. Beyond level-only localisation • Phase-shift panning: localisation by L/R phase relationships
  • 13. Ambisonic Advantages • In Ambisonics, each location has its own combination of level and phase relationships. • Head Related Transfer Functions (HRTF) are not considered. • Decoder is configured to match the speaker array in the room – original design goal.
  • 14. Soundfield Microphone Principles • Mid-Side recording captures a stereo stage (with a good sense of depth) • Omni (L+R) and figure-8 (L-R)
  • 15. Soundfield Microphone Principles • SFM extends this into three dimensions • Omni (sum of all directions) “W” • Three figure-8s at right angles “X”, “Y”, “Z”
  • 16. Soundfield Microphone Capsule Array • Tetrahedral array of capsules as close as possible • Circuitry for coincidence compensation • Coincident up to about Original 10kHz SFM Design
  • 17. Other SFM Designs • Tetramic from Core Sound …and several others
  • 18. A-format to B-format • Capsule signals converted to sum & difference signals
  • 19. B-Format: The Studio Format • W = Left + Right + Front + Back (+ Up + Down) • X = Front – Back • Y = Left – Right • Z = Up – Down
  • 20. Halliday/Nimbus mic array • Generates B-Format directly • Omni and two figure-8 mics
  • 21. Transmission • B-Format thought not suitable for transmission as it is not stereo-compatible. • Is this still a valid problem? • Could B-Format be carried on DVD? BRD?
  • 22. Ambisonics • Two original methods of transmission:
  • 23. Ambisonics • Two original methods of transmission: • B-Format (the studio format): sum & difference channels.
  • 24. Ambisonics • Two original methods of transmission: • B-Format (the studio format): sum & difference channels. • UHJ stereo-compatible matrix: (typically 2-channel UHJ).
  • 25. 2-channel Transmission • Matrixing system based on UD-4 • BBC Matrix H, HJ • UHJ (“Universal HJ”) • Convert B-Format into a 2-channel format • Stereo/mono compatible • Decode at the listening end to suit room
  • 26. 2-Channel Decoder • Requires the listener to have a decoder at home • One more item to buy – probably not supplied with the audio system
  • 27. Benefits of Playback-end decoding • One single source (disc, file etc) the same for all applications • Decoder is configured for the playback environment: • Number and position of speakers etc
  • 28. Disadvantages of Playback-end decoding • Decoders are needed ‘out there’. • People have to use them, and set them up correctly. • May be easier with software-based playback systems.
  • 29. The Other Side of Ambisonics • Ambisonics was conceived originally as a method of accurately capturing and reproducing a natural acoustic event.
  • 30. The Misconception • “Ambisonics requires recording with a special microphone/array.”
  • 31. The Misconception • Almost no commercial music can be picked up live with a single microphone • So what use is Ambisonics? • Luckily, there are other methods besides a special microphone.
  • 33. Ambisonic Mixing • The vast majority of popular music is mixed from multitrack.
  • 34. Ambisonic Mixing • The vast majority of popular music is mixed from multitrack. • Ambisonic panpots predate the Soundfield Microphone
  • 35. Ambisonic Mixing • The vast majority of popular music is mixed from multitrack. • Ambisonic panpots predate the Soundfield Microphone • Ambisonics is particularly good at this: for example, it’s isotropic.
  • 36. Ambisonics is good at… • Ambisonics specialises in accurate localisation • Suggests that if you take care of localisation, envelopment will take care of itself. • Is this true?
  • 37. Ambisonic Mixing: Principles • Multitrack environment • Conventional recording techniques (may add an SFM if helpful) • Ambisonics is used at the Mixing stage
  • 38. Ambisonic Mixing: Principles • Mono/stereo sources • B-Format panpots • B-Format bus • Record the mix (3- or 4-channel B-Format) • Monitor the mix (decoder fed by B-format bus)
  • 39. Ambisonic Mixing System • Ambisonic Mixing System designed to allow conventional consoles to do Ambisonics
  • 41. Ambisonic Mixing Today: DAW Support • DAW needs to have true multichannel architecture – not all do! • Most popular: Steinberg Cubase & Nuendo (VST); Apple Logic Pro & Soundtrack Pro 2 (AU); Audio Mulch & Plogue Bidule (VST) • Pro Tools is NOT (really) supported
  • 42. DAW Plug-ins for Ambisonics • Panners, decoders, reverb etc implemented as plug-ins • VST is the most popular • Audio Units (Apple) also available (B2X) • First Order Ambisonics recommended (higher orders also available)
  • 43. Some DAW Plug-ins for Ambisonics • Daniel Courville’s B2X suite (Mac only) • University of York (Mac/Win) • Gerzonic (Bidule/Audiomulch) • Bruce Wiggins (Reverb) • Swiss Centre for Computer Music (Max/MSP) • Visual Virtual Microphone
  • 44. Some Current Tools • Daniel Courville’s B2X • Apple Audio Unit and VST plugins
  • 45. Some Current Tools • Swiss Centre for Computer Music • VST plugins
  • 46. Some Current Tools • University of York • VST Plugins • Also higher-order designs
  • 47. Future Tools? • Manipulate sounds in 3D space in a virtual world?
  • 48. Ambisonic Application: Large-scale PA • Funktion One: Tony Andrews • Chemical Brothers, Glastonbury Festival • London’s Millennium Dome central show • Sancho Panza at the Glade Festival
  • 49. Replay & Monitoring Observations • Goal: Wide, accurate listening area (or a wide area with a good experience). • Ideally all speakers are the same. • Ideally all speakers are full range. • Speakers should have wide dispersion. • To a point, more speakers are better (decoder must support them).
  • 50. Degrees of Freedom • Position virtual sources at any angle around the listener (including height) • Position sounds at a distance with radius vector, level and reverb combinations • Sounds can be stationary or move • Create a complete synthetic soundfield, either like or unlike reality
  • 51. Artistic Freedom • Some people feel that direct virtual sources should occupy the front stage and only ambience behind the listener – NO! • Place sounds anywhere that you think is valid (including the above). • Mix of a live concert might be like the above; in the studio, anything goes. • If it sounds right, it is right.
  • 52. Surround Sound offers: • More freedom to create a sonic environment for the listener • A more immersive experience • More listener involvement • Re-creating a real acoustic space/ performance • Creating virtual acoustic spaces
  • 53. Ambisonics offers: • Better efficiency than 5.1, 7.1, 10.2 etc • More accurate rendering of source position • Side and rear images (and height) • Device-independent rendering: image quality is a function of the replay system • Replay system to suit the environment
  • 54. If Ambisonics is so wonderful… • Why isn’t everyone using it? • The old stories… • Public Domain! • A lot of people are… • Free tools and systems • Some development needed (Pro Tools etc)
  • 57. Ambisonics Today • Ambisonics has never been as accessible • Most tools are free • You can develop your own • But what about replay on existing surround systems – eg 5.1 home theatre?

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  5. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  6. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  7. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  8. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. Contrasts B-Format and UHJ. Three points (one main which comes up with slide). Go through as far as possible.\n
  22. Contrasts B-Format and UHJ. Three points (one main which comes up with slide). Go through as far as possible.\n
  23. Contrasts B-Format and UHJ. Three points (one main which comes up with slide). Go through as far as possible.\n
  24. \n
  25. \n
  26. \n
  27. \n
  28. \n
  29. Conventional mic-based view of Ambisonics. Just the one point, on long enough to say it. Slide comes up complete.\n
  30. \n
  31. “Why is Ambisonic Mixing important?” Say this and then click to bring up point 1: Because most music is done that way. Isotropic = gives equal precedent from sounds coming from all directions - important for artificial soundfields. ‘AMG’ is us of course. 3 points. An old picture of RE.\n
  32. “Why is Ambisonic Mixing important?” Say this and then click to bring up point 1: Because most music is done that way. Isotropic = gives equal precedent from sounds coming from all directions - important for artificial soundfields. ‘AMG’ is us of course. 3 points. An old picture of RE.\n
  33. “Why is Ambisonic Mixing important?” Say this and then click to bring up point 1: Because most music is done that way. Isotropic = gives equal precedent from sounds coming from all directions - important for artificial soundfields. ‘AMG’ is us of course. 3 points. An old picture of RE.\n
  34. \n
  35. \n
  36. \n
  37. \n
  38. \n
  39. \n
  40. \n
  41. \n
  42. \n
  43. \n
  44. \n
  45. \n
  46. \n
  47. \n
  48. \n
  49. \n
  50. \n
  51. \n
  52. \n
  53. \n
  54. \n
  55. \n
  56. \n