Skip to main content

Controller? What controller? You fly this drone with your facial expressions

Ready—Aim—Fly! Hands-Free Face-Based HRI for 3D Trajectory Control of UAVs
Whether it’s first-person controls that place you in the virtual cockpit of your drone or experiments using brain control interfaces, engineers are exploring all kinds of ways of controlling unmanned aerial vehicles. Roboticists at British Columbia’s Simon Fraser University have stumbled upon an alternative control system, however — and it involves getting users to “throw” drones off on a set trajectory by pulling a series of funny faces.

The project’s official title is Ready-Aim-Fly. This describes the three separate phases required to achieve successful flight. In the “Ready” stage, the modified Parrot Bebop drone learns the user’s face by asking them to hold a neutral expression. You then have to program in a trigger face which is distinct from your neutral expression. The “Aim” phase involves the drone beginning to fly, while making sure that it keeps the user centered in its camera view. The user can then line up their desired trajectory and move away from the drone in order to increase how far it will fly — a bit like pulling the string back on a catapult. Finally, the “Fly” stage sees the drone perform its programmed trajectory.

Ready-aim-fly!

It’s possible to use your expressions to make the drone travel in a straight line, or return to the user like a boomerang. In tests, the Ready-Aim-Fly system was used to dispatch the drone on flights of close to 150 feet outdoors. In all, the idea is pretty darn wacky, but we kind of love the concept of being able to harness recent breakthroughs in image recognition (and particularly facial recognition) in order to issue non-verbal commands to a robot.

“The demo is cute and small scale, but we are serious about this interface,” Richard Vaughan, one of the researchers on the project, told Digital Trends. “The important part is that the robot flies in a parabola, as if it was an object being thrown. People are really good at throwing things, so the interaction is easy to learn in one demonstration. The ability to place a drone in 3D from a quick interaction is new and powerful. With a little practice, one can send the robot over a building, or onto its roof, in a couple of seconds of aiming. The user carries no special equipment and doesn’t need their hands free. Since we did this work, we are now able to read facial expressions very accurately — using the same techniques as the iPhone X animated emojis — so we can send off the robot with a big smile.”

A paper describing the project, titled “Ready-Aim-Fly! Hands-Free Face-Based HRI for 3D Trajectory Control of UAVs,” was presented at the Institute of Electrical and Electronics Engineers Canadian Conference on Computer and Robot Vision.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Watch this incredible drone fly-through of Man City’s Etihad Stadium
watch this incredible fpv drone video of man citys stadium city

Soccer giant Manchester City this week secured the English Premier League title, beating archrival Manchester United into second place.

As part of the celebrations, the club has offered its fans -- as well as anyone with an interest in drone photography -- a stunning fly-through of its modern, 55,000-seat Etihad Stadium.

Read more
DJI drone contest invites your best impossible shot
dji air 2s drone one camera sensor news specs price lifestyle 1 of 4

Drone giant DJI has launched a new contest to put your flying skills and creativity to the test, with the winner offered its recently released first-person-view (FPV) drone.

Called the “Impossible Shot Challenge,” the name of the contest gives you a good idea about the kind of entries the company is hoping to receive, though whether your air-based artistry is up to it remains to be seen.

Read more
DJI could drop a new drone this week. Here’s what to expect
dji could drop a new drone this week heres what to expect air 2s pre launch photo

Though not confirmed by the company itself, DJI is expected to unveil an update to its popular Mavic Air 2 drone this week.

The new drone is expected to be called the Air 2S, and while the name suggests an incremental update rather than a major design overhaul, there will still be some notable improvements. The news comes courtesy of OsitaLV, a reliable leaker who called it right with, for example, DJI’s FPV drone and the Osmo Pocket 2 camera.

Read more