Skip to main content

Google’s ARCore platform can now track faces, boasts improved memory

Google is continuing to improve its augmented reality platform, ARCore, and has released an update for Android and iOS that adds facial augmentation and improves the existing Cloud Anchors that allowed for AR object permanence.

That sounds complicated, but it’s less complex than it initially seems. The new addition, Augmented Faces, allows users to attach fun effects to their faces that follow their movements and react to their expressions in real time. The technology is similar to iOS’s Animojis and Memojis — except with a key difference. While iOS’s in-built AR effects require a depth-sensing camera (the TrueDepth selfie lens on the latest iPhones), ARCore’s new feature is able to recreate this effect without the need for advanced hardware. To achieve this, Augmented Faces lays a 3D mesh over your face with 468 individually tracked points — with each point corresponding to a specific point on the AR effect. Basically, think of Snapchat’s filters, but better.

The second major part of this update consists of improvements to ARCore’s Cloud Anchors. Introduced in May 2018, Cloud Anchors allow for a certain amount object permanence between devices. Essentially, draw an arrow on a wall with an Android device, and a friend on an iPhone will be able to see it. That may seem minor, but imagine being able to leave a breadcrumb trail of AR directions for a friend while you’re out, or view AR models of spacecrafts together.

This sort of social AR experience is something Google is eager to explore, and this update makes the existing cloud anchors more robust and efficient. More angles are processed when the anchor is created, making steadier and more realistic — so elements are less likely to come loose from their anchor and drift across your screen.

Outside of exceptions like Pokémon Go or Harry Potter: Wizards Unite, it’s probably fair to say augmented reality plays little role in most people’s lives. Part of the reason for that is, well, it doesn’t really have much use yet. However, Google’s recent addition of AR directions to Google Maps — which uses your phone’s camera and screen to overlay directions on the real world — shows what’s possible with augmented reality. This update for ARCore may not be the most exciting update so far — but it’s a big step along the road to AR becoming from commonplace in our lives. If you’re eager to check out what’s currently possible in AR, check out our list of the best AR apps for Android and iOS.

Editors' Recommendations

Mark Jansen
Mark Jansen is an avid follower of everything that beeps, bloops, or makes pretty lights. He has a degree in Ancient &…
Own an iPhone, iPad, or MacBook? Install this critical update right now
IOS 16.4.1 UPDATE.

Apple has released software updates for iPhones and iPads that are light on features, but they are critically important from a security perspective. The updates — iOS 16.4.1 and iPadOS 16.4.1 — started rolling out on Friday, but you should install them on your iPhone and iPad as soon as possible to protect your devices from attacks.

In its official release note, Apple says the updates patch two security flaws that “may have been actively exploited.” Now, Apple doesn’t disclose security issues before conducting thorough research, both in-house and in collaboration with cybersecurity experts. In a nutshell, when Apple publicly announces a security flaw, and it comes with a “Critical Vulnerability” badge, you should grab the fix as soon as Apple makes them available.

Read more
Control Center on the iPhone is a mess — here’s how Apple can fix it
Someone holding an iPhone 14. The display is turned on and showing the Control Center.

The clock keeps ticking down to Apple’s Worldwide Developers Conference (WWDC) on June 5. This is where we expect Apple to unveil its headliner mixed reality headset, as well as the usual slew of software updates for iPhone, iPad, Apple Watch, and Mac.

Though it was originally rumored that iOS 17 would primarily focus on bug fixes and improvements, a later report said it could bring some “highly requested features from users.” And this week, there was another report that suggests iOS 17 will be bringing some big changes to the Control Center.

Read more
I created the perfect iPhone home screen — and you can too
iPhone 14 Pro with custom home screen icons and widgets

With iOS 14, Apple began to open the floodgates for software customization on the iPhone. For the first time, you could add widgets to the home screen and even change app icons to custom ones without the need for a jailbreak. And iOS 16 gave us some more customization options in the form of the lock screen, although the interface for that is su-par, to say the least.

While I see a lot of people still use a stock grid layout on their home screen, I took some time when iOS 14 first came out to customize my iOS experience. I enjoy that it’s not just a boring grid of stock icons — having custom icons and widgets really mix things up a bit and gives me a more informative home screen.

Read more