Skip to main content

Nuance's Nina virtual assistant gets better with time, and a little human help

nuance nina assistant sddefault resized  1
You might know Nuance, the natural voice and AI lab headquartered on the outskirts of Boston, from its popular Dragon NautrallySpeaking transcription software for PC. But what you might not know is that the firm’s conversational AI, which powers the customer service platforms of 6,500 companies around the globe, handles billions of transactions every year. And it is now capable of more.

On Thursday, Nuance launched a new version of Nina, its AI-powered, cross-platform assistant melding of machine smarts and human intelligence. From a customer perspective, it is just like any other AI-powered voice assistant — Nina can respond to questions (think the status of a pizza order, for example) and walk you through a conscripted list of choices. But unlike Apple’s Siri, Amazon’s Alexa, and Microsoft’s Cortana, Nina is sharp enough to know when it can’t answer a question — and to throw it to a human specialist who can.

Recommended Videos

“The advantage of AI is, they’re always available,” Robert Weiderman, Nuance’s executive vice president and general manager, told Digital Trends. “Unlike a human, they never have a bad night — you can self-service 24/7.”

Amazon Echo deal

Here’s how it works: Nuance’s data engineers use Nina Coach, an automated learning tool, to train it on a business’ ins and outs. Once it has gotten a handle on the basics, it goes to work, fielding between 80 to 90 percent of customer calls, SMS messages, and texts from chat platforms like Facebook Messenger.

“General-purpose assistants like Alexa and Siri know a little about a lot,” Weiderman said. “Nina can go deep.”

When Nina is unsure about a question, it will consult help — human help. In those rare cases, Nuance’s AI tries to match customers to reps with relevant expertise. Then, it provides those reps with a transcript and history of the conversation, and a list of likely answers in order of confidence. The call center staffer’s choice is recorded, analyzed, and folded back into what Weiderman calls the “semantic brain” — Nina’s collective intelligence.

“It’s just like people,” Weiderman said. “Kids learn to have conversations, go to high school and college, get a doctorate, and become an expert in something. Nina’s the same way — it has a learning loop will eventually create 100 percent confident answers.”

Weiderman sees it as a way to free up hands in customer support centers, and to help businesses prioritize the most important — and difficult — requests without impacting other customers’ experience. With Nuance’s infrastructure up and running, call center agents can service three to six customers at a time, Weiderman said.

“You can turn on support for messaging, but you can’t control the volume that’s going to come at you,” he said. “The days when company’s could control how consumers spoke with them is going away. First the web came along, and you could call or go to the website. And now there’s chat apps like Facebook Messenger, Line, and Kik, and Internet of Things devices like Amazon’s Echo.”

“Nina’s able to support a growing number of channels, including voice, mobile and Internet of Things devices like Alexa,” he said.

Human-augmented intelligence is just the tip of Nina’s iceberg. Nuance also announced asynchronous messaging, which lets customers start a conversation with a business’s assistant on one platform and pick it up later, on another. You can text a credit card company about an erroneous charge via Facebook Messenger, for example, and get status updates via SMS every hour until the problem is resolved.

Nina’s also gaining the ability to transition customers to digital channels. If you call a company’s support center and Nuance’s automated system can’t find the answer to your question, you’ll get two options: Wait for a human agent, or continue the conversation on a digital channel like Facebook Messenger.

“We don’t expect text message conversations to be instantaneous,” Weiderman said. “And when you’re dealing with something like an insurance claim, it can take days of back and forth to get the paperwork in order.”

Nuance rolled out the new Nina features to ICBC Bank, one of the largest in China, in 2012. More than a billion users interact with its support via messaging app WeChat, Weiderman said, accounting for 85 percent of all customer service requests.

“We’re adding cognitive, data-driven machine learning to our products,” Weiderman said. “We’re the only vendor combining the tooling, intelligence, and analytics of natural language processing and cognitive technologies […] to deliver automated and assisted solutions targeted to enterprise needs.

Kyle Wiggers
Former Digital Trends Contributor
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
I record interviews for work. These are my favorite free recorder apps
The iPhone 14 Pro and Google Pixel 7 Pro's voice recording apps running together.

The Voice Recorder app on a phone (left) and the Voice Memos on another phone Andy Boxall / Digital Trends

Before you head to the app store on your phone to buy a voice-recording app, take a moment to consider the apps that may already be installed on your phone. Why? In my experience, they're likely all you really need. I’ve recorded interviews and voice-overs for work for years, and I’ve found the two best examples come preinstalled on your phone already, so they’re entirely free to use.

Read more
The best Samsung Galaxy Z Fold 5 cases: 10 best ones so far
Two Galaxy Z Fold 5 phones next to each other -- one is open and one is closed.

Samsung’s next-generation foldable is here with the Samsung Galaxy Z Fold 5. This iteration has some notable improvements, including a new hinge design that eliminates the gap from previous generations when the device was folded. You also get a 6.2-inch HD+ Dynamic AMOLED 2X display on the outside while having a 6.7-inch QXGA+ Dynamic AMOLED 2X display on the inside, with both screens having a 120Hz refresh rate. In other words, they're about as nice as you could ask for.

The Galaxy Z Fold 5 is made with premium materials, and the triple-lens camera system packs in a 50MP main shooter, 10MP telephoto with 3x optical zoom, and a 12MP ultrawide lens. There’s a 10MP selfie camera on the front cover, and a 4MP camera on the inner display. You also get a Snapdragon 8 Gen 2 for Galaxy chip inside for the best performance and power efficiency.

Read more
Google Pixel Tablet just got its first big discount and it’s worth a look
Google Pixel Tablet on its charging dock.

Tablets are a dime-a-dozen these days, with offerings from all the great brands including Apple, Samsung, Lenovo, and more. So, if you really want to stand out in a sea of similar tech, you need to do things a little differently. That's what Google's Pixel Tablet offers. How? It comes with a unique speaker dock that can be used to both charge the device and offer room-filling sound -- almost like a smart speaker add-on. Better yet, when your Pixel Tablet is docked it benefits from the Hub Mode, turning the device into a smart display, with digital photo frame support, smart home controls, and hands-free Google functionality. Of course, it could set you back at full price, normally $499 unless you find it included in a roundup of the best Google Pixel deals. Well, guess what? Thanks to a Best Buy Google Pixel Tablet deal, you can get it today for $439 and save $60. Hurry, though, it's part of Best Buy's recent 48-hour sale so it won't stick around for long.

Why you should buy the Google Pixel Tablet
Okay, okay, so in our Google Pixel Tablet review, Joe Maring did give it less than stellar remarks, but he called out its reliable fingerprint sensor, comfortability during use and excellent speaker dock. Honestly, how many tablets come with a matching speaker dock that transforms the entire experience? This tablet also marks a "lot of firsts" for Google, as it's the first tablet from the company in nearly five years, the first Android tablet in eight years, and can be converted into a smart home display with the speaker dock. All of which are notable milestones.

Read more