Nokia makes first phone call with 3D spatial audio
How does the 3GPP Immersive Video and Audio Services (IVAS) codec work to enable spatial audio over cellular networks?
The 3GPP Immersive Video and Audio Services (IVAS) codec works by extending the existing Enhanced Voice Services (EVS) codec to support spatial audio over cellular networks1. This enables the transmission of stereo and immersive audio, which was not possible with the previous communication codecs that focused on improved compression efficiency and higher audio bandwidth for monaural signals only2.
The IVAS codec offers support for various audio formats beyond stereo, including multi-channel audio (5.1, 5.1.2, 5.1.4, 7.1, 7.1.4), scene-based audio (Ambisonics up to 3rd order), metadata-assisted spatial audio (MASA), and object-based audio1. It is optimized for services that require efficient compression of spatial audio, making it suitable for use in mobile networks.
As a mobile communication codec, IVAS can operate at bit rates as low as 13.2 or 24.4 kbit/s and with very low latency. This makes it possible to deliver lifelike spatial acoustic experiences in various scenarios, such as conference calls and video conferences, while maintaining efficient use of the network resources3.
By enabling spatial audio over cellular networks, the IVAS codec allows callers to hear sound spatially in real-time, providing a more immersive and natural listening experience during calls. This can potentially reduce listening effort and fatigue during telephone conversations and enhance communication overall.
Which existing apps currently offer spatial audio, and on what devices is this feature supported?
Several popular apps currently offer spatial audio support, including Apple Music, Netflix, Disney+, HBO Go, Hulu, and of course, Apple TV+. These apps support spatial audio on compatible devices such as iPhones, iPads, and the Apple TV 4K. Additionally, spatial audio is available on select Sonos products, such as the Sonos Arc, Sonos Beam Gen 2, and Sonos Era 300, for use with Apple Music.
To use spatial audio, you need an iPhone 7 or later, or one of the following iPad models: iPad Pro 12.9‑inch (3rd generation or later), iPad Pro 11‑inch, iPad Air (3rd generation or later), iPad (6th generation or later), or iPad mini (5th generation or later). You also need to have iOS 14 or iPadOS 14 or later installed on your device, as well as the latest firmware on your AirPods Pro or AirPods Max.
Spatial audio is not supported on any Mac model or any Apple TV models, but you can use AirPods or other compatible headphones with an iPhone or iPad to take advantage of the spatial audio feature4.
What are the anticipated benefits of 5G Advanced, the upcoming upgrade to 5G networks?
5G Advanced, the upcoming upgrade to 5G networks, is anticipated to bring several benefits, including faster speeds, improved energy efficiency, more accurate cellular-based positioning, and more3. This next-generation technology is expected to enhance connectivity, communication, experiences, and productivity.
One of the key features of 5G Advanced is the Immersive Video and Audio Services (IVAS) codec, which enables 3D spatial audio. This technology allows callers to hear sound spatially in real-time, providing a more immersive and lifelike audio experience compared to the current monophonic calls. The IVAS codec could be implemented in a "vast majority" of smartphones with at least two microphones, making it widely accessible.
In addition to improved audio quality, 5G Advanced also aims to enhance network sustainability by introducing energy-saving features for devices and networks5. It will explore end-to-end energy-saving opportunities that benefit devices and networks, as well as improve features for RedCap and study ambient IoT as a new device type5.
5G Advanced will also support uncrewed aerial vehicles and non-terrestrial networks (NTN), such as satellite communications6. This will be the first time that terrestrial and satellite communications are combined under one standard, opening up new opportunities for connectivity in remote and rural areas.
Furthermore, 5G Advanced is expected to play a major role in the development and growth of the metaverse by providing the high-speed, low-latency connectivity required to support immersive and interactive experiences. It will enable real-time collaboration, support high-quality content, enable new applications and services, and expand the metaverse beyond the gaming industry.
Overall, 5G Advanced is set to deliver enhanced performance, improved efficiency, and new capabilities, paving the way for innovative services and applications that will transform the way we live, work, and communicate.