Future AI assistants like Siri could be trained by Joey from ‘Friends’

...

The artificial intelligence on our phones and computers doesn’t have a face. Talking to Siri, Cortana, Alexa, or most recently Google’s Assistant can be fun, but these disembodied virtual assistants are just voices, leaving us talking to our devices and looking bit weird. Researchers at the University of Leeds have been looking into an alternative to this, by taking a TV show character and making them into a virtual avatar capable of speaking new phrases and sentences, which could be the template for training natural, interactive AI avatars of the future.

That TV show character? Who else but Joey Tribbiani from Friends. Stepping beyond a simple computer generated character, the trick here is the reborn Joey will speak in the same manner as the original. The virtual Joey is trained by using original Joey’s phrases, speech patterns, face movements, and intonation; resulting in a new Joey ready to say whatever the AI driving him wants him to, while still sounding and looking like Joey. At least, that’s the potential, but as you can see from the demo video it’s a work in progress.

Related: Computer writes new Friends scripts, and they’re funny for all the wrong reasons

It’s very complex work. To train virtual Joey, all the above aspects of his character must be mapped, and new short sentences created for him to speak. The computer system must then match synthesized Joey-speak to the movement of his mouth, blend the two together, and place the virtual Joey-mouth onto his face, and at the same time use face tracking to align movement and expression.

The result is Joey telling someone off-screen, in a bathroom, that he likes pizza and cheese. It’s something that never happened in the show, and didn’t require a reshoot with actor Matt le Blanc. Additionally, just to make it all even more challenging, because he isn’t standing in front of the team reciting lines, Joey’s speech must be taken from the catalog of Friends shows, and all the background noise must be removed first.

The render isn’t perfect, but the team that created it is working to improve it. More excitingly, the method can be used to “virtually immortalize” any character, and interact with us, or with other avatars. Once perfected, uses could go beyond giving Siri and Cortana a celeb’s speech, face and body, and into creating new content using these avatars. Whether that’s an episode of Friends without any of the actual actors appearing in it, virtual representations of a long-since-departed individuals relaying messages seemingly from the after-life, or ultimately training artificially intelligent systems to move, emote, and sound just like us.

Categories
APPLICATIONS
0 Comment

Leave a Reply

Captcha image


RELATED BY

  • 5300c769af79e

    Can You Hack Nexus 6P, 5X? Google Might Have $200K for You

    The Project Zero Prize contest encourages hackers to find a vulnerability or bug chain knowing only the device's phone number and email address.Any unused bugs will be considered for Android Security Rewards and other eligible programs at Google.
  • 5300c769af79e

    FAA Doesn't Want You Using, Charging, or Storing Galaxy Note 7s on Planes at the Moment

    In light of exploding Galaxy Note 7 devices that have forced Samsung to issue a global recall, the Federal Aviation Administration (FAA) is advising device owners to not use them while flying on airplanes.That means not only do they not want you using your Note 7 while in flight, but they don’t want you charging it or storing it in baggage.
  • 5300c769af79e

    Softbank Buying ARM For $32 Million

    What you l In a move to bolster its Internet of Things (IoT) push, Softbank announced plans to buy mobile chip designer ARM holdings for $32 million.The company's proposed acquisition of ARM Holdings will be its most valuable at $32 billion.
  • 5300c769af79e

    Crossy Road gets party-mode multiplayer on Android

    Developer Hipster Whale found a ton of early success with Crossy Road, and now new content releases like today’s content update are helping the studio keep it relevant for a mobile-gaming industry worth $34.While you can get the multiplayer mode right now on Android, it won’t hit iOS until May.