Skip to main content

Snapchat's latest patent filing suggests Stickers are coming to AR

Snapchat
dennizn/123RF
Snapchat’s stickers allow users to place colorful virtual drawings on photos and video — but a recently published patent application suggests that Snap Inc. is also working on an augmented reality version that places two-dimensional stickers on a camera feed in real time. The patent, filed in 2015 when Snap Inc. was still Snapchat, but only published last week on May 4, describes a method for placing virtual objects from a large database into camera data from a smartphone or pair of virtual reality goggles.

The patent application tackles the idea of a sticker-like database for two-dimensional virtual objects, and simplifies the process so that it doesn’t require so much computing power. The system would mix GPS data and a set of images of the location provided by the user to generate depth estimates. That “structure facade data” helps place a two-dimensional “sticker object” pulled from a large library of similar graphics in a realistic way, the patent suggests.

The patent filing appears to tackle still objects and adds moving virtual objects to the scene. Using user-snapped photos simplifies the process of depth mapping, while the database of stickers is pre-designed to be placed into scenes mapped with the camera. The GPS determines where you are looking so the processor can focus on just the direction you are viewing. That potentially translates into a virtual reality system that doesn’t require so much processing power, theoretically making it accessible across a number of devices.

The patent documents says the system could work with mobile phones or from augmented reality helmets, visors, or glasses — the paperwork even includes what appears to be a drawing of an updated Spectacles that would work with the virtual reality system.

Many filed applications for patents don’t ever actually make it to reality, but the paperwork gives us a glimpse into what Snapchat has been researching. Snapchat’s stickers are one of the app’s popular features, now imitated on other apps, and the paperwork suggests a similar sticker database could make it possible for anyone to create an augmented reality scene.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Twitter CEO claims platform had best day last week
A stylized composite of the Twitter logo.

Twitter CEO Linda Yaccarino tweeted on Monday that despite the current fuss over Meta’s new and very similar Threads app, Twitter had its largest usage day last week.

Subtly including the name of Meta’s new app, which launched to great fanfare last Wednesday, Yaccarino did her best to sing Twitter’s praises, tweeting: “Don’t want to leave you hanging by a thread … but Twitter, you really outdid yourselves! Last week we had our largest usage day since February. There’s only ONE Twitter. You know it. I know it.”

Read more
Meta brings cartoon avatars to video calls on Instagram and Messenger
Meta's cartoon avatars for Instagram and Messenger.

The pandemic was supposed to have made us all comfortable with video calls, but many folks still don’t particularly enjoy the process.

Having to think about what to wear, or how our hair looks, or even fretting about puffy eyes following another bout of hay fever can sometimes be a bit much, even more so if it’s an early-morning call and your brain is still in bed.

Read more
Twitter is now giving money to some of its creators
A lot of white Twitter logos against a blue background.

Some Twitter users are now earning money via ads in the replies to their tweets.

New Twitter owner Elon Musk announced the revenue-sharing program in February, and on Thursday some of those involved have been sharing details of their first payments.

Read more