Skip to main content

As AR heads to Google search, Lens learns to translate, add tips, and more

Riley Young/Digital Trends

Computer vision puts the camera to use when you’re at a loss for words — but Google Lens can soon do more than just reverse search for similar items or details about what’s in that photo. During I/O on Tuesday, May 7, Google demonstrated new search capabilities powered by the camera and expanded Lens skills for calculating tips, translating text, and more.

During the keynote, Aparna Chennapragada, Google’s vice president for the camera and augmented reality products, demonstrated how Google’s search results can use AR to bring 3D models into the room with you, without leaving the search results. A new “view in 3D button” pops up in the search results whenever 3D content is available.

Recommended Videos

Besides allowing users to look around the 3D object from every angle, the update will also bring that 3D item into AR, mixing the model with the content from your camera to see the object in front of you. Chennapragada says the tool will be helpful for tasks such as research along with shopping.

The camera feature for search is expected to arrive later in May. Partners like NASA, New Balance, Samsung, Target, Visible Body, Volvo, Wayfair, and others will be among the first to have their 3D content pop up in the search results.

As search becomes more camera-heavy, Google Lens is moving beyond simply searching with a camera. At a restaurant, Lens can soon scan the menu, highlight the most popular dishes, bring up photos and even highlight reviews from other diners using Google Maps. The camera first has to differentiate between the different menu options before matching the text with relevant results online. At the end of the meal, Lens will calculate the tip or split the bill with friends when pointing the camera at the receipt.

Google Lens is also gaining the ability to verbally translate text. While earlier versions could use Smart Text to highlight text to copy or translate, Lens can soon read the text out loud or overlay the translated text over the original image in more than 100 languages. Alternately, Lens can also use text-to-speech in the original language, a feature that could be helpful for those with vision or reading difficulty.

The text-to-speech feature is launching first inside Google Go, a lightweight app designed for new smartphone users. Chennapragada says that the team managed to fit those languages onto just over 100KB of space, allowing the app to run on budget phones.

“Seeing is often understanding,” Chennapragada said. “With computer vision and AR, the camera is turning into a powerful visual tool to understand the world around you.”

Lens will also gain a handful of new features as part of partnerships. Readers of Bon Appetit, for example, can scan a recipe page to see a video of the dish being created. In June, Lens will uncover hidden details about paintings at San Fransisco’s de Young Museum.

The updates join a growing list of features for Google Lens like the ability to look up the artist behind a piece of artwork, shop for similar styles, or find the name of that flower you spotted. Google Lens, which has now been used more than a billion times, is available inside Google Assistant, Photos, and directly in the native camera app on a number of Android devices.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
GoPro launches ultralight, affordable Hero 4K Camera for $199
The 2024 GoPro hero is frozen in ice.

GoPro enthusiasts have a new camera to consider after the company introduced its miniature, ultralight 4K Hero late last week. It is the company's smallest and most affordable offering, costing just $199.

The Hero is waterproof and combines GoPro's simplest user interface with 4K video, 2x slo-mo at 2.7K resolution, and 12-megapixel photos. It is available on retail shelves around the world and online at GoPro's website.

Read more
The best camera phones in 2024: our top 9 photography picks
A person holding the Samsung Galaxy S24 Ultra and Xiaomi 14 Ultra.

In the past decade or so, cameras on smartphones have evolved so much that they can pretty much replace a standalone digital camera for most people. The results you can get on some of the best smartphones these days are just so impressive, and being able to be with you at all times means you'll never miss a moment.

But what if you want the best possible camera phone money can buy? A camera that won't let you down no matter what you're taking a picture of? You've come to the right place. Here are the very best camera phones you can buy in 2024.

Read more
An ace photographer is about to leave the ISS. Here are his best shots
The moon and Earth as seen from the ISS.

NASA astronaut Matthew Dominick is preparing to return to Earth after spending seven months living and working aboard the International Space Station (ISS).

After arriving at the orbital outpost, Dominick -- who is on his first mission to space -- quickly earned a reputation for being an ace photographer. He's been using the facility’s plethora of high-end cameras and lenses to capture amazing shots from his unique vantage point some 250 miles above Earth. Sharing his content on social media, the American astronaut has always been happy to reveal how he captured the imagery and offer extra insight for folks interested to know more.

Read more