Skip to main content

Gesture-recognition system can translate sign language into text — and back again

KinTrans Inclusive Communication Inclusive Community
Voice-based dictation tools may be old news from in terms of technology, but not everyone is able to fully take advantage of them. For deaf people who use signing as their primary means of communication, available options are far more limited. That’s even more frustrating when you consider the challenges that may confront a person trying to converse with folks who are not proficient in signing.

A Dallas-based startup is setting out to set things right, though. Called KinTrans, the team has developed smart tech capable of translating sign language into voice and text, and voice taken to text or sign language automatically.

Recommended Videos

The results allow signers and non-signers to communicate together in their own languages, effectively, effortlessly, and instantaneously.

“What makes this technology exciting is the ability to open up conversations between signers and speakers in the marketplace, workplace, schools, health care, and civic centers,” Catherine Bentley, cofounder and business development officer at KinTrans, told Digital Trends. “Traditionally, communicating in these settings has been difficult; requiring friends or family who sign and interpret, or professional interpreters on-site or off-site through video, and even using pen and paper. None of these dependencies are scalable — plus they lack privacy and independence for the signer.”

KinTrans’ tech relies on a 3D camera which tracks the movement of a signer’s hands and body when they sign out words. When requested, it can then translate the signed words into written English (or, currently, Arabic, although additional languages will follow in the future). Alternatively, voice can be translated into signed words communicated by an animated avatar on the screen. According to its creators, the system is already able to recognize thousands of signed words with an accuracy of around 98 percent.

At present, Bentley said that a beta version has been rolled out, and is being used in a variety of service and point-of-sale environments. This is available in both American Sign Language and Arabic Union Sign Language.

“As KinTrans grows, other uses and applications will be developed so that it becomes a standard deaf communication platform, hosting millions of conversations in a variety of public and private settings, online and offline,” she said.

Sign us up!

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The best portable power stations
EcoFlow DELTA 2 on table at campsite for quick charging.

Affordable and efficient portable power is a necessity these days, keeping our electronic devices operational while on the go. But there are literally dozens of options to choose from, making it abundantly difficult to decide which mobile charging solution is best for you. We've sorted through countless portable power options and came up with six of the best portable power stations to keep your smartphones, tablets, laptops, and other gadgets functioning while living off the grid.
The best overall: Jackery Explorer 1000

Jackery has been a mainstay in the portable power market for several years, and today, the company continues to set the standard. With three AC outlets, two USB-A, and two USB-C plugs, you'll have plenty of options for keeping your gadgets charged.

Read more
CES 2023: HD Hyundai’s Avikus is an A.I. for autonomous boat and marine navigation
Demonstration of NeuBoat level 2 autonomous navigation system at the Fort Lauderdale International Boat Show

This content was produced in partnership with HD Hyundai.
Autonomous vehicle navigation technology is certainly nothing new and has been in the works for the better part of a decade at this point. But one of the most common forms we see and hear about is the type used to control steering in road-based vehicles. That's not the only place where technology can make a huge difference. Autonomous driving systems can offer incredible benefits to boats and marine vehicles, too, which is precisely why HD Hyundai has unveiled its Avikus AI technology -- for marine and watercraft vehicles.

More recently, HD Hyundai participated in the Fort Lauderdale International Boat Show, to demo its NeuBoat level 2 autonomous navigation system for recreational boats. The name mashes together the words "neuron" and "boat" and is quite fitting since the Avikus' A.I. navigation tech is a core component of the solution, it will handle self-recognition, real-time decisions, and controls when on the water. Of course, there are a lot of things happening behind the scenes with HD Hyundai's autonomous navigation solution, which we'll dive into below -- HD Hyundai will also be introducing more about the tech at CES 2023.

Read more
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more