Katherine_K
Member
In a recent press release, Samsung announced its collaboration with Google to develop a 3D spatial audio technology called IAMF (Immersive Audio Model and Formats). The technology was adopted by the Alliance for Open Media (AOM) in October 2023.
IAMF, as an abbreviation for "Immersive Audio Model and Formats," aims to address the challenges of incorporating 3D audio into home audio devices. Despite the numerous advantages of 3D audio, its implementation in consumer audio devices has been limited due to technological constraints. Samsung Research Institute engineer Hwang SungHee noted that 3D audio information from audiovisual content is often misinterpreted by home audio systems, such as TV speakers or soundbars, resulting in a limited audio experience.
To overcome this limitation, Samsung and Google collaborated to develop an audio solution. According to Samsung, if device manufacturers can access 3D audio data, they can adjust the sound in audio devices, allowing users to experience immersive audio through standard TV speakers or speakers in their homes.
IAMF boasts three key features: vertical audio, AI-based scene analysis, and audio customization. Engineer Nam WooHyun explained that this technology makes sound increasingly "directional," enabling listeners to hear sounds from the front, back, sides, above, and below. For example, viewers can hear the sound of birds flying overhead when using this technology on their TVs. "I hope users can get a sense of being there, and I want to continue this research until 3D audio is applied to Samsung smartphones," Nam WooHyun expressed.
In addition, IAMF utilizes AI and deep learning technology for scene analysis, emphasizing key elements of content, such as background music, sound effects, or dialogues in specific scenes of movies or TV shows.
Regarding audio customization, IAMF allows users to freely adjust sound effects based on their preferences, whether it's scene audio or character dialogues. The official demonstration showcased a scenario where users watching a sports game could choose to emphasize the commentary or the ambient sounds.
Samsung emphasizes that IAMF is the first open-source audio technology standard adopted by the Alliance for Open Media. This means that businesses and individual creators across the industry can adopt and expand the use of this technology.
IAMF, as an abbreviation for "Immersive Audio Model and Formats," aims to address the challenges of incorporating 3D audio into home audio devices. Despite the numerous advantages of 3D audio, its implementation in consumer audio devices has been limited due to technological constraints. Samsung Research Institute engineer Hwang SungHee noted that 3D audio information from audiovisual content is often misinterpreted by home audio systems, such as TV speakers or soundbars, resulting in a limited audio experience.
To overcome this limitation, Samsung and Google collaborated to develop an audio solution. According to Samsung, if device manufacturers can access 3D audio data, they can adjust the sound in audio devices, allowing users to experience immersive audio through standard TV speakers or speakers in their homes.
IAMF boasts three key features: vertical audio, AI-based scene analysis, and audio customization. Engineer Nam WooHyun explained that this technology makes sound increasingly "directional," enabling listeners to hear sounds from the front, back, sides, above, and below. For example, viewers can hear the sound of birds flying overhead when using this technology on their TVs. "I hope users can get a sense of being there, and I want to continue this research until 3D audio is applied to Samsung smartphones," Nam WooHyun expressed.
In addition, IAMF utilizes AI and deep learning technology for scene analysis, emphasizing key elements of content, such as background music, sound effects, or dialogues in specific scenes of movies or TV shows.
Regarding audio customization, IAMF allows users to freely adjust sound effects based on their preferences, whether it's scene audio or character dialogues. The official demonstration showcased a scenario where users watching a sports game could choose to emphasize the commentary or the ambient sounds.
Samsung emphasizes that IAMF is the first open-source audio technology standard adopted by the Alliance for Open Media. This means that businesses and individual creators across the industry can adopt and expand the use of this technology.
