Skip to main content

Lip reading could be the future of unlocking your smartphone

ZTE ZMax Pro
Julian Chokkattu/Digital Trends
Between fingerprints, face recognition, audio commands, and good old PIN numbers, passwords, and patterns, there is no shortage of ways to unlock your smartphone. Now, a team of researchers at Hong Kong Baptist University have added yet another way: Lip reading.

At first blush, using lip movement to authenticate a device might just seem like another frivolous method to accomplish something we already do on our devices every day easily enough, but there is actually a very strong case to be made for the idea, as the project’s leader Cheung Yiu-ming explained to the South China Morning Post.

Recommended Videos

“You can use English, Cantonese, or Putonghua,” the computer science engineer explained. “You can even mimic a bird chirping.”

Many forms of authentication rely on language, or numbers, or a complex software interface. What makes lip reading different is that anyone, anywhere can say a word or make a motion with their mouth. What makes it even more ingenious is that no two people will speak or move in exactly the same way.

“An imposter reading the same phrase would still be rejected by the system,” Cheung said, adding that, like other biometrics technologies, the user will have to demonstrate the triggering action multiple times so that the system can build a number of accepted responses on which to base a tolerance.

Right now, Cheung says his team of three has achieved a level of 90 percent accuracy and one of the major roadblocks to wide-scale implementation would be guaranteeing functionality in a variety of different lighting conditions. While the system should be harder to fool with a video recording than the way in which facial recognition prompts can be breached with a photograph, Cheung did not address that potential exploit.

The university has reportedly patented the technology and is exploring options for commercialization. Cheung says he hopes it could be ready for public use with another year of development.

Adam Ismail
Former Digital Trends Contributor
Adam’s obsession with tech began at a young age, with a Sega Dreamcast – and he’s been hooked ever since. Previously…
The future of blood oxygen monitoring lies with your phone’s camera
Measuring SpO2 with smartphone camera and flash

Smartphones are already capable of some neat health-centric tricks. From step counting and sleep tracking to measuring pulse and respiration rate, the phone in your pocket is quite a powerful-health monitoring machine. Now, a team of scientists from the University of Washington is looking to add blood oxygen level measurement to that bag of tricks.

In a paper published inNJP Digital Medicine, the team details what it calls the “first clinical development validation on a smartphone camera-based SpO2 sensing system.” To put it simply, the team developed an algorithm and proved that smartphones could measure the blood oxygen saturation level to the same baseline level as approved by the Food and Drug Administration (FDA) for over-the-counter pulse oximeters.

Read more
What is vapor cooling? The fascinating tech keeping your smartphone cool
Cooper-based vapor cooling chamber used in a custom Xiaomi Mi Mix 4 smartphone.

Vapor cooling, synonymous with "vapor chamber" and "vapor chamber cooling," has been a common buzzword in the laptop industry for almost a decade. And like many things borrowed from laptop-makers, the term has also funneled down to the segment of performance-oriented smartphones in the last few years. Vapor cooling is among the most widely used smartphone technologies, and it helps with the dissipation of excessive heat generated during stressful workloads.

When we run a resource-hungry app or game on our smartphones — or record a video for a long duration — the phone's processor must do a lot of work to compensate for those things. Vapor cooling is one way to address it, and it's quickly becoming much more prominent in devices. But how exactly does vapor cooling work, and does it even matter? That's what I wanted to find out.
How vapor chamber cooling works
AeroActive Cooler 6 on the ROG Phone 6 Andy Boxall/Digital Trends

Read more
The Nothing Phone 1 thinks your smartphone should be a brash, distracting toy
Someone holding the Nothing Phone 1, showing the front of it and its display.

Carl Pei, former founder of OnePlus and now the face of the Nothing brand, has been hyping up the company's Nothing Phone 1 for what feels like ages. You'd think the smartphone world has seen it all, but Nothing has a brilliant plan to bring the fun back to phones. No, it's not with foldables. It's also not mini phones, nor is it the camera-centric madness that has gripped both Western and Eastern smartphone brands.

With the Nothing Phone 1, Pei wants to bring back beeps and bloops to your smartphone in an attempt to make your phone the most distracting thing in your life (more so than it is already), and it's not exactly clear Nothing has something here.
Making your phone the center of attention

Read more