Seeing Sound: Visualizing the Spatial Behavior of Surround Audio

Presented at the 2025 AES European Convention in Warsaw by Pavel Smokotnin, RTW

Thomas Valter

June 04, 2025 5 min reading time

As surround and immersive formats continue to replace stereo in cinema, broadcast, and music production, new tools are needed to help audio professionals understand the spatial behavior of complex mixes. At the 2025 AES European Convention in Warsaw, RTW’s software engineer Pavel Smokotnin introduced a novel visualization approach to tackle exactly this challenge: The Polarscope.
Before we dive in, please note that this article covers a research project. The Polarscope is a conceptual prototype and is not available as a commercial product yet.

 

The Problem: Stereo Tools Fall Short in a Surround World

Traditional stereo analysis tools – such as vectorscopes – work well for two-channel mixes but fall short when applied to multichannel formats like 5.1 or 7.1. With multiple audio sources spread across space, detecting phase errors, spatial coherence, and directional balance becomes far more complex.
 

Pavel’s research asks: 

"What if we could adapt these familiar visualization tools to support surround and even immersive audio?"
 

 


Newsletter

Sign up to learn about new blog posts!
 

 
 

 

The Method: A Spatial Vectorscope for Surround

Inspired by the classic vectorscope, Pavel developed an algorithm that visualizes interchannel correlations using a spatially aware coordinate system. Each speaker’s position is treated as a vector in space, and the signal levels are used to calculate real-time shapes on screen.

In stereo, a shared signal forms a vertical line, while polarity inversion creates a horizontal one. The new method extends this concept to surround layouts, where signal combinations form distinct geometric shapes that reflect spatial attributes such as:

  • Image width and depth
  • Front/rear energy balance
  • Channel delay mismatches
  • Phase problems or mirror symmetry

This makes it possible to “see” how the mix behaves in space—with different shapes indicating issues or affirming spatial coherence.

 

Real-World Examples: What the Shapes Reveal

Using a custom software tool and test signals, Pavel demonstrated several key patterns:

  • Perfect channel symmetry forms clean vertical lines.
  • Polarity inversions or delay mismatches tilt or distort those lines.
  • Uncorrelated noise produces a “cloud” shape, revealing spread and depth.
  • Real program material, like dialogue scenes, narrows the shape toward the center channel, while storm scenes form diffuse shapes that follow sonic motion.

Importantly, these visual cues correspond to human perception, offering a new way for mixing engineers and QC operators to detect and optimize spatial behavior.

In the following video you can directly follow what is described. The montage shows the underlying movie with 5.0/5.1 audio and the recorded Polarscope measurement sequence in one.

The Meridian Movie from Netflix Open Content with superimposed display of the Polarscope measurement
 

This video is based on the Meridian movie provided by Netflix Open Content, available under the Creative Commons Attribution 4.0 International Public License.
RTW has added the Polarscope measuring sequence of the 5.1 audio done with a TouchMonitor 5. The modified video is also available under this license.



 

Interesting time points are:
 

0:00
0:50
3:25
3:30
 

Intro music
Pure dialog in the office
Road noise
Internal monologue with background Music
 

4:22
5:08
5:20
5:28
 

Storm surrounds outside the car
Nature quite noise
Phone call on the side
Thunder
 

6:30
8:05
10:06
 

Sea waves on the right and thunders in the background
Suspicious surround music
Correlated signals in the channels (wind instrument)
 

   Download this video (approx. 761.9 MB)
 

 

The following video contains the Polarscope measurement sequence in full resolution
 

The Polarscope prototype demonstrated using an RTW TouchMonitor 5

 

   Download this video (ca. 54.1 MB)
 
 

Comparison to RTW’s SSA Tool

Pavel’s approach complements RTW’s Surround Sound Analyzer (SSA), which visualizes momentary loudness across speaker positions using a pentagon-style layout. While the SSA focuses on loudness distribution, the proposed method reflects phase and correlation dynamics, offering a different yet compatible insight into spatial structure.

 

Looking Ahead: Toward Immersive and 3D Visualization

One of the key strengths of this method is its flexibility. It isn’t limited to flat surround layouts like 5.0 or 5.1—it can be adapted for vertical audio layers used in immersive formats like 7.1.4 or 9.1.6. There’s even potential for true 3D spatial visualization using XYZ coordinates, allowing engineers to “map” the perceived audio field.

 

Conclusion

With immersive audio on the rise, engineers need tools that match the complexity of the formats they work with. Pavel Smokotnin’s surround visualization algorithm marks an important step forward—bridging the gap between what we hear and what we can see.

Read the white paper at the AES E-Library.

Pavel Smokotnin, Research and Development, RTW, presents his approach at the AES