Skip to main content

Researchers create artificially intelligent ears for cars to improve road safety

For drivers, there are times when it feels as if that fast-approaching emergency vehicle, with its siren blaring, has come from nowhere. On a packed multi-lane street or at a busy junction, its sudden appearance can confuse a driver into making the wrong move when trying to clear the way, making matters worse for the response vehicle as it tries to reach its destination.

In such cases, an earlier warning about the vehicle’s approach, including where it’s coming from, would allow the driver to make better and safer decisions.

The scenario is one of several that inspired researchers at the Fraunhofer Institute for Digital Media Technology (IDMT) in Oldenburg, Germany, to create an A.I.-based solution that allows cars to listen, and respond to, their surroundings.

The technology uses a microphone placed inside a modified roof fin. This links to a control unit containing software that powers the system. The software uses a library of different noises and computer algorithms that enable it to recognize the acoustic signature of specific sounds while discarding irrelevant background noise. The team used a wide range of archived noises to train the algorithms that power the platform.

Fraunhofer IDMT also designed its own so-called “beamforming algorithms” that allow the technology to dynamically locate moving sound sources such as a siren on an approaching emergency vehicle.

With today’s vehicles built to keep external noise out, and booming sound systems that ensure you hear nothing but the audio you’re listening to, the technology would offer an efficient way to alert drivers to important events nearby, including anything from approaching emergency vehicles to children playing in the street.

The researchers point out that the system could be made to be so sensitive that it would even be able to pick up the sound of a nail in a tire tapping on the road surface, enabling it to alert the driver to the potential danger. Other unusual noises from the vehicle could also be recognized, allowing the system to keep tabs on the car’s condition.

Autonomous vehicles

The researchers point out that the technology would also be useful for autonomous vehicles.

“Despite the huge potential of such applications, no autonomous vehicle has yet been equipped with a system capable of perceiving external noises,” Danilo Hollosi, head of the Acoustic Event Recognition group at Fraunhofer IDMT, said in a release.

The equipment is still under development but the team hopes to have something ready for commercialization within the next five years.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
Ford and VW close down Argo AI autonomous car unit
An Argo AI autonomous car on the road.

Autonomous-car specialist Argo AI is closing down after Ford and Volkswagen, Argo's main backers, ended support for the Pittsburgh-based company.

First reported by TechCrunch and later confirmed by the two auto giants, some of the 2,000 workers at Argo will transfer to Ford and Volkswagen, while others without an offer will receive a severance package. Argo’s technology is also set to end up in the possession of the two companies, though at this stage it’s not clear how it might be shared.

Read more
Nvidia’s Drive Concierge will fill your car with screens
An interior view of Nvidia's Drive Concierge in-car infotainment system, showing various in-car displays in use.

At Nvidia’s GTC show today, the company announced two new systems in its in-car computing efforts, including a new product that could outfit your vehicle with an array of AI-powered screens and dashboards.

The first announcement is a new in-car infotainment system that includes graphics and visuals for drivers alongside game and movie streaming for passengers. Dubbed Drive Concierge, Nvidia says it will make driving “more enjoyable, convenient and safe.”

Read more
Cruise’s robot taxis head to Arizona and Texas
A passenger getting into a Cruise robotaxi.

Cruise’s autonomous cars are heading to Texas and Arizona before the end of this year.

The General Motors-owned company plans to launch ridesharing pilots in Austin and Phoenix in what will be its first expansion of the service outside of San Francisco.

Read more