Skip to main content

The Apple Vision Pro can now be controlled only by your mind

Mark has ALS but can use the Vision Pro via Synchron's Stentrode.
Mark has ALS but can use the Vision Pro via Synchron's Stentrode. Synchron

The Apple Vision Pro is already incredibly easy to use, largely thanks to its lack of controllers. You just look at a control and tap your index finger to your thumb to select.

But hand gestures aren’t always easy or possible for the millions of people worldwide who have paralysis of the upper limbs. Synchron recently announced a spatial computing breakthrough that lets users of the Stentrode BCI (brain computer interface) implant control an Apple Vision Pro.

Recommended Videos

A demo of the technology was posted in a YouTube video, using the example of a person named Mark with amyotrophic lateral sclerosis (ALS), which prevents movement of his hands. But thanks to the BCI, he can now use a mixed-reality headset. Since the Vision Pro uses eye-tracking to move the cursor, Synchron’s BCI only needs to detect the intention to make small hand gestures.

Synchron Brain Computer Interface + ChatGPT | Powered by OpenAI

Mark played Solitaire, browsed and watched videos on Apple TV, and sent text messages, selecting words with Synchron’s BCI and Vision Pro software.

This advancement follows an equally impressive demonstration of Mark using a text chat interface that speeds up interaction with the help of ChatGPT. Synchron posted a YouTube video that shows how it works.

Sychron was pioneering BCI work long before Neuralink. The Stentrode was the first BCI implanted in humans, and clinical trials began in 2022. Synchron uses well-established techniques like stents and endovascular surgery. While Neuralink is impressive, allowing the equivalent of mouse control via its BCI, it requires opening the skull.

BCI hardware tends to get the most attention, but software and integration with external devices is essential to creating a more comfortable and functional experience, as proven by this new example.

Availability of this technology is quite limited with clinical trials still in progress for both. That means it could be several years before thought control of computers becomes widespread. While the news of breakthroughs like this are exciting, more time and thorough testing over years is needed to ensure safety.

Alan Truly
Alan Truly is a Writer at Digital Trends, covering computers, laptops, hardware, software, and accessories that stand out as…
ChatGPT can now generate images for free using Dall-E
ChatGPT results on an iPhone.

Since its launch last September, OpenAI's Dall-E 3 image generator has only been available to its Plus, Teams, and Enterprise subscribers. Now, nearly a year later, Dall-E is accessible to the rest of us — just with some stringent restrictions.

https://twitter.com/OpenAI/status/1821644904843636871

Read more
Microsoft might be building its own Vision Pro rival
Microsoft HoloLens 2

Posts on X are popping up reporting that Microsoft has signed a development and supply contract with Samsung Display for micro-OLED displays.

The information originates from a Korean tech site, The Elec, which claims that Microsoft wants "hundreds of thousands" of these displays for an XR device designed for gaming and media consumption. In other words, a competitor for the Vision Pro -- or rather, another competitor for the Vision Pro.

Read more
The Vision Pro 2 could gain this huge upgrade to visuals
Apple Vision Pro display model.

The tandem OLED technology used in the 2024 iPad Pro models could be used in a future Vision Pro. LG and Samsung have prototyped micro versions of the tandem displays, essentially shrinking them down for use in headsets such as the Vision Pro.

A report, originating from the Korean site Sisa Journal as picked up by MacRumors, mentions that it's unknown whether LG and Samsung are planning to mass produce these displays right now.

Read more