Skip to main content

Social robots taught to ask for clarification when confused about a command

social robot question socialrobot
Nick Dentamaro / Brown University
Robots already work the front desk in some hotels, run cash registers at a few fast food restaurants, and clean up around the house for us. Though they’ve been programmed to receive to commands, they rarely engage in meaningful, dynamic communications with us like other people do. But if social robots are ever going to truly catch on, they’ll need to learn to communicate and pick up on social cues.

A team of researchers from Brown University are working to instill this social competence into robots, recently developing an algorithm that allows them to perform tasks better by collaborating with people.

Recommended Videos

In the study, conducted by Brown’s Humans to Robots Laboratory, the robots were programmed to ask for clarification. When a person told the robot to grab a certain object, the robot could ask “Which one?” if the command was ambiguous. This communication allowed the robot to perform tasks 25 percent faster and 2.1 percent more accurate than a state-of-the-art baseline, according to the research, which will be presented at the International Conference on Robotics and Automation in Singapore this spring.

Reducing Errors in Object-Fetching Interactions through Social Feedback

The goal for the Brown lab at this point is less about creating flawless machines than it is about creating machines that can catch and correct their mistakes.

“It is very hard to go from 90 percent accuracy to 99.9 percent accuracy,” Stefanie Tellex, computer science professor and lead researcher, told Digital Trends. “Yet 90 percent accuracy means the robot will fail on one in ten interactions. If it is interacting with you every day, that means it will fail every single day. With our technology though, the robot will automatically detect the failure and ask questions.

“Using this feedback loop, a failure isn’t the end of the story,” she added. “It can ask a question, and recover.”

The question-asking algorithm is a step forward for Tellex and her team, which previously created an algorithm that could respond to verbal and gesture commands from people. However, the new system does becomes confused when asked to retrieve an object among many other similar objects on the table. The algorithm still worked surprisingly well for untrained participants though, who even assumed it could understand and respond to complex phrases that it wasn’t programmed to comprehend.

“We envision robots assisting astronauts in space,” Tellex said, pointing out that the research was funded in part by NASA. She also thinks these machines could help workers here on Earth from the assisting patients at hospitals to people at home.

Dyllan Furness
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
The best portable power stations
EcoFlow DELTA 2 on table at campsite for quick charging.

Affordable and efficient portable power is a necessity these days, keeping our electronic devices operational while on the go. But there are literally dozens of options to choose from, making it abundantly difficult to decide which mobile charging solution is best for you. We've sorted through countless portable power options and came up with six of the best portable power stations to keep your smartphones, tablets, laptops, and other gadgets functioning while living off the grid.
The best overall: Jackery Explorer 1000

Jackery has been a mainstay in the portable power market for several years, and today, the company continues to set the standard. With three AC outlets, two USB-A, and two USB-C plugs, you'll have plenty of options for keeping your gadgets charged.

Read more
CES 2023: HD Hyundai’s Avikus is an A.I. for autonomous boat and marine navigation
Demonstration of NeuBoat level 2 autonomous navigation system at the Fort Lauderdale International Boat Show

This content was produced in partnership with HD Hyundai.
Autonomous vehicle navigation technology is certainly nothing new and has been in the works for the better part of a decade at this point. But one of the most common forms we see and hear about is the type used to control steering in road-based vehicles. That's not the only place where technology can make a huge difference. Autonomous driving systems can offer incredible benefits to boats and marine vehicles, too, which is precisely why HD Hyundai has unveiled its Avikus AI technology -- for marine and watercraft vehicles.

More recently, HD Hyundai participated in the Fort Lauderdale International Boat Show, to demo its NeuBoat level 2 autonomous navigation system for recreational boats. The name mashes together the words "neuron" and "boat" and is quite fitting since the Avikus' A.I. navigation tech is a core component of the solution, it will handle self-recognition, real-time decisions, and controls when on the water. Of course, there are a lot of things happening behind the scenes with HD Hyundai's autonomous navigation solution, which we'll dive into below -- HD Hyundai will also be introducing more about the tech at CES 2023.

Read more
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more