Skip to main content

Apple patent suggests future Macs could use eye tracking to go hands-free

Eye tracking is a feature that has been on Windows PCs for a while, but it looks like Apple might also be considering it sometime in the future. A patent called “Gaze detection in a 3D mapping environment” includes mentions which hint that one day you might be able to ditch your mouse and look at your Mac in a completely different way.

The patent was originally filed in September 2017 and initially describes a mixed modality interface for receiving three-dimensional maps of at least one body part of a user, then eventually transmitting the image to a computer. As part of a series of other filings, it also describes how a 3D sensor can pick up a user’s gaze and segment it to extract coordinates, and then have that gaze identified to a movement on the screen.

“There is additionally provided, in accordance with an embodiment of the present invention an apparatus including a sensing device configured to receive an image including an eye of a user, and a computer configured to identify, based the image of the eye, a direction of a gaze performed by the user … to perform an operation on content presented in the region,” explains the patent.

Curiously, the patent dives a bit deeper and explains that a would-be tracking system can also pick up the movements of a user’s other body parts, including the head, torso, and limbs. These can then be inputted to a computer or another device, which can help the user select any icons and other user interface elements (as seen above.)

It is something which Apple wants to address to set itself apart from current interfaces, according to the patent.

“Many different types of user interface devices and methods are currently available. Common tactile interface devices include a computer keyboard, a mouse, and a joystick. Touchscreens detect the presence and location of a touch by a finger or other object within the display area. Infrared remote controls are widely used, and wearable hardware devices have been deployed,” explains the patent.

Any Mac with these tracking features would very much be appreciated. Apple’s latest devices have featured more internal changes, rather than the revolutionary changes seen in the past. As usual, patents don’t usually hold up to be true, but it might be worth dreaming for and go nicely with the future Mac of 2021.

Editors' Recommendations

Arif Bacchus
Arif Bacchus is a native New Yorker and a fan of all things technology. Arif works as a freelance writer at Digital Trends…
Intel chips held back the 15-inch MacBook Air, Apple says
Apple's 15-inch MacBook Air placed on a desk.

Apple’s 15-inch MacBook Air is a surprisingly good laptop, and its positive reception might make you wonder why Apple didn’t launch it sooner. Well, we just got the answer from Apple itself, and it turns out the fault apparently lies with Intel.

That interesting tidbit was revealed by Laura Metz, Director of Product Marketing at Apple, and Thomas Tan from Apple’s enterprise product marketing team. Speaking to Inc, the pair explained that Apple silicon was the driving force in creating the 15-inch MacBook Air.

Read more
Major leak reveals every secret Mac Apple is working on
Apple's John Ternus stands next to an image of the 15-inch MacBook Air at Apple's Worldwide Developers Conference (WWDC) in June 2023.

At Apple’s Worldwide Developers Conference (WWDC) in early June, the focus was almost entirely on the company’s Vision Pro headset. But Apple has plenty more up its sleeve, according to a new report, which has spilled the beans on every single Mac we can expect to see in the coming months.

The report comes from journalist Mark Gurman, who accurately predicted a plethora of details about the Vision Pro before it was announced. Now, he says Apple has a few surprise Mac announcements in store for late 2023 or early 2024.

Read more
Apple may soon eliminate the notch from your Mac and iPhone
An Apple MacBook laptop with the macOS Ventura background wallpaper and the notch seen at the top of the display.

So many Apple devices have the divisive notch cutout these days that the feature has almost become its own brand, yet it continues to stir disapproving glances and attempts to hide it wherever it's seen. Apple could now be on the brink of eliminating it for good.

That’s because the company recently filed a patent in Europe outlining how future Apple devices, from Macs to iPhones, could do away with the notch once and for all, giving you a borderless experience that’s unbroken around the screen. It’s a grand idea, and Apple thinks it knows how to make it work.

Read more