Skip to main content

Eye-tracking glasses reveal what master pianists look at while they play

What Does a Pianist See? | Eye Tracking - Episode 1
Ever wanted to experience what it is like to be a master pianist tickling the ivories? A new video gives a sense of what that might feel like, while also demonstrating a few fundamental differences between a true master and a very good student.

The video is an experiment using a pair of wearable eye-tracking glasses made by Tobii Pro, the global leader in eye-tracking research. Entitled “What Does a Pianist See?” it’s the first episode in a new online video series designed to show how the technology — that is able to show exactly where people are looking when they perform actions — can be used as a training (or learning) tool.

Recommended Videos

“The big difference we found with the expert pianist is that they stay looking in the center,” Patrick Adelman, co-founder of the video maker Fractal Media, told Digital Trends. “They don’t need to look at where their fingers are moving all the time. On the other hand, the student’s eyes constantly go all over the keyboard to find where her fingers needed to go. The same is true when you look at how they read sheet music and whether or not they need to keep looking at the music, then down at the keyboard.”

Breaking that down in terms of figures, the expert pianist spent approximately 83 percent of the time looking at sheet music, compared to the “novice” who spent 58 percent of the time looking at the music. The expert also scanned ahead vertically and horizontally, meaning that they were able to mentally stay a few steps ahead.

Piano playing is not the only use-case made possible by Tobii Pro’s eye-tracking wearable, of course.

“This product is really the first time that it’s been possible to take eye-tracking technology out of the lab and into real contexts,” Mike Bartels, U.S. Research Director for Tobii Pro, told Digital Trends. “Because of that, we’re seeing a lot of interest in fields like sports research. You can’t tell much about how a basketball player shoots free throws if they’re sitting in a laboratory; you have to have them actually on the court. Other applications include media research, where traditionally you’d have to bring people to a research facility to study how they pay attention to adverts, for example. Now we can send this technology home with people, so they can wear it while they’re going about their daily lives. If you want to capture natural behavior, you have to allow people to be in natural contexts, rather than being tested in a lab.”

Whether eye-tracking glasses eventually become mainstream technology remains to be seen, but it’s certainly a fascinating demonstration of how tech can reveal valuable insights about a range of disciplines.

Now if you will excuse us, we have some piano practice to get back to!

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The best portable power stations
EcoFlow DELTA 2 on table at campsite for quick charging.

Affordable and efficient portable power is a necessity these days, keeping our electronic devices operational while on the go. But there are literally dozens of options to choose from, making it abundantly difficult to decide which mobile charging solution is best for you. We've sorted through countless portable power options and came up with six of the best portable power stations to keep your smartphones, tablets, laptops, and other gadgets functioning while living off the grid.
The best overall: Jackery Explorer 1000

Jackery has been a mainstay in the portable power market for several years, and today, the company continues to set the standard. With three AC outlets, two USB-A, and two USB-C plugs, you'll have plenty of options for keeping your gadgets charged.

Read more
CES 2023: HD Hyundai’s Avikus is an A.I. for autonomous boat and marine navigation
Demonstration of NeuBoat level 2 autonomous navigation system at the Fort Lauderdale International Boat Show

This content was produced in partnership with HD Hyundai.
Autonomous vehicle navigation technology is certainly nothing new and has been in the works for the better part of a decade at this point. But one of the most common forms we see and hear about is the type used to control steering in road-based vehicles. That's not the only place where technology can make a huge difference. Autonomous driving systems can offer incredible benefits to boats and marine vehicles, too, which is precisely why HD Hyundai has unveiled its Avikus AI technology -- for marine and watercraft vehicles.

More recently, HD Hyundai participated in the Fort Lauderdale International Boat Show, to demo its NeuBoat level 2 autonomous navigation system for recreational boats. The name mashes together the words "neuron" and "boat" and is quite fitting since the Avikus' A.I. navigation tech is a core component of the solution, it will handle self-recognition, real-time decisions, and controls when on the water. Of course, there are a lot of things happening behind the scenes with HD Hyundai's autonomous navigation solution, which we'll dive into below -- HD Hyundai will also be introducing more about the tech at CES 2023.

Read more
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more