Skip to main content

Microsoft patent describes ’emotional’ AI that produces personalized responses

microsoft emotional assistant patent cortana 1
Artificially intelligent voice assistants like Apple’s Siri and Google’s eponymous Google Assistant are powerful time-savers, but you won’t mistake one for a human anytime soon — their responses tend to be a little robotic. However, researchers are hard at work on more personalized, life-like assistants, and Microsoft may be at the forefront.

A patent filed by Microsoft in November 2015 and granted in May, titled “Emotionally Connected Responses from a Digital Assistant,” describes an AI-powered companion that has the ability to respond to reminders, calendar entries, and other tasks in a highly specific, contextually appropriate way.

“Personalized or digital assistants are increasingly becoming popular and are continuously becoming more personalized,” the patent states. “For example, digital assistants have unique voices, names, etc. Additional personality dimensions are constantly sought out in an effort to increase connections with users.”

Amazon Echo

Microsoft’s two-pronged solution includes “personalized messages” to certain “inputs,” and canned responses during “predetermined events.” If you feed the assistant what Microsoft describes as “exemplary emotional inputs” — “I love you,” for example, or “Will you be my girlfriend” —  it’ll respond with a “personalized message,” potentially in the form of  “unique handwriting.” If, on the other hand, it’s your birthday, a holiday, or an anniversary (a “predetermined event”), the assistant will acknowledge the special day in question.

Microsoft isn’t the only firm experimenting with highly personalized, emotional AI. According to the MIT Technology Review, retail giant Amazon is working on “significant” language processing upgrades to Alexa, its voice assistant, that may allow it to accurately detect the emotion in your voice. It’s also said to be developing an advanced language model that would be able to comprehend “ambiguous requests” — the sort of vague questions that throw the current version of Alexa for a loop.

More recently, Amazon introduced tools that make Alexa sound “more like a human.” The new Speech Synthesis Markup Language lets developers of “skills” — third-party apps that extend Alexa’s capabilities — add pauses, change the pronunciation of words, add audio snippets, spell out words, and insert special words and phrases.

The Google Home is powered by Google Assistant. Julian Chokkattu/Digital Trends

Google, meanwhile, enlisted the help of Google Doodle head Ryan Germick and ex-Pixar animator Emma Coats to help give the Google Assistant “character.” They programmed the Assistant with a “relatable childhood,” and added “humorous” responses that would make it sound “conversational.”

“There have been studies that show that it doesn’t necessarily matter if you instantly click with someone,” Coats said in an interview with Fast Company. “One thing we do is to make the character as entertaining as we possibly can so that you want to spend time with it.”

Kyle Wiggers
Former Digital Trends Contributor
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
Voice actors seeing an increasing threat from AI
best podcast apps for android microphone in radio station broadcasting studio

Voice actors are the latest creatives to feel the heat from artificial intelligence (AI).

According to a Motherboard report this week, those providing their voices for content such as ads, gaming titles, and animations have been noticing how clients are increasingly asking them to sign contracts that hand over the rights to their voice so that AI can be used to create a synthetic version.

Read more
Microsoft invests billions in ChatGPT maker OpenAI
Microsoft HQ 2

Microsoft revealed on Monday that it’s making a further investment in OpenAI, the company behind the much-talked-about AI-powered chatbot ChatGPT.

In a statement on its website, the computer giant described the move as a “multiyear, multibillion-dollar” investment, declining to offer more specific financial details. Recent reports, however, have suggested that Microsoft’s investment, which follows two others in 2019 and 2021, could be worth in the region of $10 billion.

Read more
This AI can spoof your voice after just three seconds
man speaking into phone

Artificial intelligence (AI) is having a moment right now, and the wind continues to blow in its sails with the news that Microsoft is working on an AI that can imitate anyone’s voice after being fed a short three-second sample.

The new tool, dubbed VALL-E, has been trained on roughly 60,000 hours of voice data in the English language, which Microsoft says is “hundreds of times larger than existing systems”. Using that knowledge, its creators claim it only needs a small smattering of vocal input to understand how to replicate a user’s voice.

Read more