Tag Archives: Applied Research

Next Month MP3 Creators Debut Flexible Rendering Technology For New Immersive Audio Experience

Fraunhofer will be at CES 2025 from January 6-January 8, 2025 at the Fraunhofer suite in the Venetian Hotel.

A person sitting at a desk with a computer

Description automatically generated

December 31, 2024, Erlangen, Germany — Fraunhofer Institute for Integrated Circuits (Fraunhofer IIS), a leading developer of advanced audio technologies, including mp3 and AAC, will present at CES 2025 upHear Flexible Rendering, a ground-breaking audio technology that greatly simplifies high-quality immersive sound experiences on consumer audio reproduction devices, including loudspeakers, soundbars, and TVs. upHear Flexible Rendering enhances and distributes sound flexibly to all available speakers for a spectacular enveloping immersive audio effect at all times.

upHear Flexible Rendering for Effortless Flexibility: Expand Setups from Stereo to Immersive 

upHear Flexible Rendering belongs to Fraunhofer’s upHear range of audio processing technologies. They enhance the sound quality of content from voice signals to immersive audio masterpieces and provide pristine audio pickup as well as faithful reproduction from classic stereo setups to complex scenarios with multiple devices. The upHear Flexible Rendering technology automatically combines wireless speakers for the best possible experience, supporting new immersive audio formats as well as providing first-class upmixing for legacy content.

What Makes This Technology Impressively Different

With upHear Flexible Rendering, everything is adjustable: Adding or removing a speaker from the system is no trouble due to its automatic adaptation to the current playback situation. Its inherent flexibility provides the option for effortless system growth making it very budget-friendly. All systems upgraded with upHear Flexible Rendering achieve enhanced immersion for an extraordinary sound experience. “Currently, users can only connect to one smart speaker at a time or to a fixed setup per room.

With the upHear technology, you now have the flexibility to conveniently combine any number of speakers into an immersive speaker cluster wherever you want. Party music in the kitchen? Transform your living room into a movie theatre? Operas in the bathroom? It is all possible without a fuss,” said Sebastian Meyer, Product Manager upHear, Fraunhofer IIS.

Fraunhofer Demos will be available at CES 2025 –

  • Speaker Repositioning: Smart speakers will be distributed in the room playing immersive music. The upHear Flexible Rendering technology will make it possible to add/remove speakers and to reposition them. The upHear algorithm optimizes the sound image based on the current setup. Visitors will be able to try out repositioning for themselves. The wireless speaker setup also uses the Fraunhofer Communication Codec LC3plus for ultra-low-latency wireless audio transmission.
  • upHear Microphone Processing Technologies: Through live calls, Fraunhofer will show how they make life easier: An “office” in the suite will show advanced AI-based technologies such as Echo Control, Noise Reduction, and the latest feature: Voice Isolation, which is the highlight of the Microphone Processing area. Users can create a “fingerprint” of their voice in seconds, which makes it possible to remove all sounds but their voice from a call for a truly personalized live call experience for better conferencing. 
  • Demo Audio Samples: Check out upHear demos at: https://comm-demos.iis.fraunhofer.de/upHear_20240808/index.html
  • upHear Mobile Audio: Fraunhofer’s virtualization platform opens the door to true spatial playback experiences on headphones. It works from a multitude of sources, from legacy stereo to current immersive formats. Thanks to the minimum resource requirements of the low-complexity rendering, it can run on DSPs for any audio device class, be it headphones, mobile devices, home audio systems, or even a low-power XR devices.

upHear is available immediately. For more information, see: www.uphear.com, and https://www.audioblog.iis.fraunhofer.com/tag/uphear.

Fraunhofer Audio Codecs to be presented at CES 2025 –

  • xHE-AAC: The stereo codec for broadcast and streaming provides DASH/HLS streaming at 12-320+ kbit/s, a new anchor loudness feature, mandatory loudness and dynamic range control, improved speech quality, and stereo imaging. The technology is already used by Netflix, Facebook stories, and Instagram Reels. xHE-AAC is natively supported on the latest Amazon, Android, Microsoft, and Apple products and operating systems.
  • LC3plus Lossless: Video calls, music, and gaming are best enjoyed with wireless headphones and microphones that deliver perfect audio quality and long battery life. With LC3plus, sound reaches users in perfect quality and the new LC3plus Lossless switches seamlessly between lossless and lossy modes of operation. It works with all features of LC3plus, including low-delay and superior robustness thanks to Advanced Packet Loss Concealment. LC3plus is on the Japan Audio Society’s list of codecs whose implementation opens the door for device manufacturers to use the prestigious High-Res Audio Wireless logo. Fraunhofer IIS will demonstrate integrations into the AKG N5 Hybrid Earbuds, a HyperX gaming headset, a Sony streaming microphone, and a headphone prototype by BEStechnic.
    • MPEG-H Audio: Next Generation Audio system for streaming and broadcast applications with advanced personalization and accessibility options. Fraunhofer will showcase devices by globally leading CE manufacturers with MPEG-H Audio support, which is required for Brazil’s upcoming broadcast standard DTV+. Here, the technology helps Globo, TV Cultura, and other major providers to deliver customizable immersive sound experiences with a high degree of accessibility. Viewers can choose between different languages and commentators or select a version with enhanced dialogue.

For the Silo, Karen Thomas/ Eva Yutani.

A black text on a white background

Description automatically generated

About Fraunhofer IIS Audio & Media Technologies
Fraunhofer IIS is part of Fraunhofer-Gesellschaft, Europe’s leading applied research organization. The global leader in advanced technologies for audio coding and moving picture production. Almost all computers, mobile phones, and consumer electronic devices available today are equipped with technologies from Erlangen and are used by billions of people around the world every day. The creation of mp3, co-development of AAC as well as HE-AAC prove how Fraunhofer IIS has been innovating the audio sector for over 30 years. The current generation of compelling audio technologies includes Fraunhofer Symphoria for automotive 3D audio, EVS for phone calls with crystal-clear audio quality, xHE-AAC, which is used by major streaming services such as Netflix, by Facebook stories, and by Instagram Reels. MPEG-H Audio delivers personalized immersive sound for broadcast and streaming, which lets viewers adjust dialogue volume to suit their personal preferences.

University Of Maryland Will Investigate AI Limitations Via Army Research Grant

COLLEGE PARK, MD: University of Maryland College of Information Studies (UMD iSchool) researchers, led by principal investigator Dr. Susannah Paletz, have been awarded a three-year $616,700 usd grant funded by the Army Research Office (ARO), overseen by ARO Program Manager Dr. Edward Palazzolo. This project examines how teams of intelligence analysts can work together and with artificial intelligence (AI). AI has the potential to support intelligence analysts in reviewing potentially hundreds of thousands of source documents, pulling out key findings, and assembling them into actionable intelligence. AI can also aid in the flow of information and projects among members of the intelligence team, improving the efficiency and accuracy of their work.

“AI-driven technology has sometimes been touted as a replacement for human intelligence,” said Dr. Adam Porter, the project’s co-principal investigator, professor at the UMD Department of Computer Science, and Executive and Scientific Director of the Fraunhofer USA Center for Experimental Software Engineering (CESE). “In practice, however, AI doesn’t always work, or gives limited or biased answers. Human oversight is still required, and it’s therefore critical that we deeply understand how humans and AI can work best together.”

The Human-Agent Teaming on Intelligence Tasks project coordinated through the iSchool will focus on two particular research areas; 1.) how interactive AI agents, such as chatbots, have the ability to mitigate or exacerbate the communication and coordination problems that can occur with shift handovers of intelligence work, such as inaccuracy blindness and overlooking potentially relevant information, and 2.) examining how humans could potentially deal with these blind spots, biases, or inaccuracies. 

The research team plans to develop an experimental infrastructure to help test team cognition challenges within the work completed by intelligence analysts consisting of task-relevant input materials, such as mission descriptions and source documents, activity recording tools, experimental monitoring capabilities, and different AI supports for human analysts, such as chatbots offering advice on a particular task. 

“We want to develop a task that can raise the problems with asynchronous team cognition in intelligence tasks, but is simple enough to be used by research participants with minimal training,” said Dr. Susannah B.F. Paletz, research professor at the UMD iSchool, and affiliate at the UMD Applied Research Laboratory for Intelligence and Security (ARLIS). 

Susannah Paletz
Dr. Susannah B.F. Palletz


This task will substantially increase insight into the strengths and weaknesses of AI technology to support intelligence tasks, help shed light on how and when human analysts can safely place their trust in AI technology, and how they can proactively identify problems in AI-generated input. It will also aid teams of humans, including asynchronous teams, working together in situations that include AI-generated input.

“This basic research is an important step in the early process of learning how humans and agents can collaboratively become a single team with considerably greater capacity and productivity than human only teams,” Palazzolo said. “Moreover, this research has broad implications into the work of many teams focused on knowledge work and information management such as medical teams involved in shift work, collaborative software development teams, and research teams.”

In addition to Porter, the Fraunhofer USA team also includes Dr. Madeline Diep, Senior Scientist, and Jeronimo Cox, Software Developer, at Fraunhofer USA CESE. The Fraunhofer USA team will lead the effort to create configurable AI agents used in the experimental tasks, and a data collection and analysis infrastructure for capturing and understanding participant behaviors.

The UMD iSchool team includes graduate students Tammie Nelson, a fourth year PhD student, Melissa Carraway, incoming first year PhD student, and Sarah Valhkamp, incoming first year PhD, in Information Science.

The grant proposal team includes UMD Office of Research Administration Contract Manager, Stephanie Swann; iSchool Business Manager, Jacqueline Armstrong; and former iSchool Business Manager, Lisa Geraghty.

Outside of UMD, Dr. Aimee Kane, the Harry W. Witt Faculty Fellow and an Associate Professor of Management in the Palumbo-Donahue School of Business at Duquesne University, will be a consultant and an intellectual contributor on this project.

ARO is an element of the U.S. Army Combat Capabilities Development Command’s (CCDC) Army Research Laboratory. The Human-Agent Teaming on Intelligence Tasks project (grant no. W911NF-20-1-0214) is slated to run through June 30, 2023. For the Silo, Mia Hinckle.

Record-Breaking Global Mobility Grounded By COVID-19 Pandemic

With global travel almost at a standstill, the latest results of the Henley Passport Index offer disturbing insight into the indiscriminate havoc caused by the COVID-19 pandemic. Since its inception in 2006, the index has provided the authoritative annual ranking of global passport strength. Travel freedom has increased dramatically over the period in 2006, a citizen could travel to 58 destinations on average without a visa from the host nation; 14 years later, this number has almost doubled to 107. 

The first ranking of the new decade published in January this year conclusively confirmed that overall, people were the most globally mobile than we had ever been in the history of humankind, with the top-ranking passport (Japan) offering its holders access to a record-breaking 191 destinations without requiring a visa in advance. Just three months later, the picture looks very different indeed.

Australia's Coronavirus Travel Bans Feed Old Fears
The result of the latest travel ban in Australia. Image: jacobinmag.com

Japan’s passport continues to hold the top spot on the Henley Passport Index as we enter the second quarter of 2020, but the reality is that current stringent travel restrictions mean that most non-essential travel for Japanese nationals is heavily curtailed.

This is true for almost every country of course, as more travel bans are implemented daily, and ever-more stringent coronavirus lockdown regulations are imposed by governments worldwide. With 3.5 billion people, nearly half the global population, presently living in voluntary or mandatory confinement, the latest results from the index — which is based on exclusive data from the International Air Transport Association (IATA) — raise challenging questions about what travel freedom and global mobility really mean, both currently and in a deeply uncertain post-pandemic future.

Dr. Christian H. Kaelin, Chairman of Henley & Partners and the inventor of the passport index concept, points out that in an unprecedented global health emergency such as this, relative passport strength becomes temporarily meaningless. “A Swiss citizen can, in theory, travel to 185 destinations around the world without needing a visa in advance, but the last few weeks have made it apparent that travel freedom is contingent on factors that occasionally can be utterly beyond our control. This is, of course, something that citizens of countries with weak passports in the lower ranks of the index are all too familiar with. As public health concerns and security rightfully take precedence over all else now, even within the otherwise borderless EU, this is an opportunity to reflect on what freedom of movement and citizenship essentially mean for those of us who have perhaps taken them for granted in the past.”

Q&A: New travel ban shakes up airlines, passengers - NEWS 1130
Image: citynews1130.com

The future of international mobility after COVID-19

Commenting on the latest Henley Passport Index, bestselling author and the Founder and Managing Partner of FutureMap, Dr. Parag Khanna, says the combined effect of the COVID-19 pandemic on public health, the global economy, and social behavior could lead to much deeper shifts in our human geography and future distribution around the world. “This may seem ironic given today’s widespread border closures and standstill in global transportation, but as the curtain lifts, people will seek to move from poorly governed and ill-prepared ‘red zones’ to ‘green zones’ or places with better medical care. Alternatively, people may relocate to places where involuntary quarantine, whenever it strikes next, is less torturous.

In the US, both domestic and international migration were surging before the pandemic, with Gen-Xers and millennials shifting to cheaper, second-tier cities in the Sun Belt or abroad to Latin America and Asia in search of an affordable life.

Once quarantines lift and airline prices stand at rock bottom, expect more people across the globe to gather their belongings and buy one-way tickets to countries affordable enough to start fresh.”

This is supported by emerging research and analysis commissioned by Henley & Partners, which suggests that despite freedom of movement currently being restricted as a temporary measure, there is a risk that this will negatively affect international mobility in the long run. Political science researchers Uğur Altundal and Ömer Zarpli of Syracuse University and the University of Pittsburgh, respectively, note that public health concerns have historically been used to justify restricting mobility, but governments usually adopt travel restrictions temporarily, in response to short-term health needs. Until now, health security has not been a significant determinant or requirement when negotiating visa waivers, but Altundal and Zarpli warn that “increasing public health concerns due to the outbreak of COVID-19 may change thisthe quality and level of health security of a country could be a significant consideration for visa waivers in future”. The unprecedented and overwhelming focus on health security and pandemic preparedness we now see may change the face of global mobility forever.

On the other hand, Prof. Simone Bertoli, Professor of Economics at CERDI, Université Clermont Auvergne in France, says that the necessity of international collaboration in fighting the pandemic could ultimately reduce current barriers to international mobility. “Humanity is confronted with a truly global challenge against which no country ­— irrespective of its level of income — can fully protect itself. This pandemic could therefore trigger renewed and more intense international cooperation, something that has (so far) not happened with the other main global challenge that the world is currently facing, namely climate change.”

No Official Travel Ban In The U.S., But Isn't It Time To Self-Ban?

Brexit, travel bans, and changing timelines

The chaos caused by the COVID-19 pandemic has cast further doubt on the timeline for the implementation of the UK’s post-Brexit immigration system, according to Madeleine Sumption, Director of the Migration Observatory at the University of Oxford. The UK, currently in 7th place on the Henley Passport Index, with citizens theoretically able to access 185 destinations without acquiring a visa in advance, was set to end free movement with the EU in January 2021. However, as Sumption says, “The UK can only implement its new immigration system when the post-Brexit ‘transition period’ is over, and if this is extended to give negotiators more time to discuss trade and other issues, we may not be seeing the end of free movement with the EU quite yet.”

In the US, also in 7th place on the Henley Passport Index, the impact of travel bans implemented at the beginning of the year appear to have been compounded by the pandemic, according to Greg Lindsay, Director of Applied Research at NewCities. “For the children of a rising global middle class with more and more options, this pandemic may prove to be the tipping point in terms of choosing educational destinations. When the world gradually recovers with China, South Korea, and Singapore already succeeding in slowing the outbreak through effective quarantines don’t be surprised if the best and brightest take coronavirus responses into consideration when deciding on their future options.”

A unique hedge against volatility in an uncertain future

Commenting on the ever-expanding growth and popularity of the investment migration industry, Dr. Juerg Steffen, CEO of Henley & Partners, says: “We believe that in the post COVID-19 environment, investment migration will take on a dramatically enhanced importance for both individual investors and sovereign states. Acquiring alternative residence or citizenship will act as a hedge against the significant macro-economic volatility that is predicted, creating even more sovereign and societal value across the world.” For the Silo, by Sarah Nicklin.

Supplemental

Global Headlines for Q2 2020: growth in travel freedom over past decade

  • Japan retains its top spot on the Henley Passport Index, with a visa-free/visa-on-arrival score of 191. Over the past decade its travel freedom score has increased by 31 points: in 2010, the country was ranked 6th worldwide, with a visa-free/visa-on-arrival score of 160.
  • Singapore continues to hold onto 2nd place, with a visa-free/visa-on-arrival score of 190. Over the past decade Singapore’s travel freedom score has increased by 35 points: in 2010, the country was ranked 11th worldwide, with a visa-free/visa-on-arrival score of 155.
  • Germany remains in 3rd place, with access to 189 destinations compared to the 161 destinations its passport holders were able to access a decade ago. It shares 3rd position with South Korea, which has increased its travel freedom score by 38 points: in 2010, South Korea was ranked 13th worldwide, with a visa-free/visa-on-arrival score of 151.
  • The UK is currently ranked 7th on the index, with a visa-free/visa-on-arrival score of 185. Over the past decade the UK’s travel freedom score has increased by 19 points: in 2010, the country was ranked 1st worldwide, with a visa-free/visa-on-arrival score of 166.
  • The US is also currently ranked 7th on the index, with a score of 185. Over the past decade, the US’s travel freedom score has increased by 26 points: in 2010, the country was ranked 7th worldwide, with a visa-free/visa-on-arrival score of 159.
  • The UAE has seen the biggest increase in travel freedom over the past 10 years. In 2010, the country was ranked 65th worldwide, with a visa-free/visa-on-arrival score of 64. It is now ranked 18th, with a score of 171  which means the country has added a remarkable 107 visa-free travel destinations over that period.