Proof of Concept Can Hold Natural Conversations, Swap Faces and Replicate Anyone’s Voice with Only 30 Minutes of Audio
LOS ANGELES, Calif. – November 19, 2020 – Today, Digital Domain announces “Douglas,” the most realistic real-time autonomous digital human in the world. Currently in development, Douglas was designed to break down the barriers in human-to-machine interactions, yielding conversations that feel natural and easy. With unmatched facial realism, Douglas is chameleon-like in its ability to switch faces, providing future customers with even more flexibility when it hits the market in 2021.
“Everywhere you look you see virtual assistants, chatbots and other forms of AI-based communication interacting with people,” said Darren Hendler, director of Digital Humans Group at Digital Domain. “As companies decide to expand past voice-only interactions, there’s going to be a real need for photorealistic humans that behave in the ways we expect them to. That’s where Douglas comes in.”
Douglas uses numerous types of machine learning and Digital Domain R&D to reproduce the most common mannerisms people expect to see in a lifelike digital human. By focusing on language processing, expressions, vision tracking and more, Douglas can do everything from leading conversations to remembering people. And because Douglas’ response rate is currently the same as Alexa and Siri, these conversations have a natural flow, removing the long pauses that slow other autonomous digital humans down.
While perfect for any project that requires facial realism, Douglas will be especially helpful to companies who need an avatar to answer questions or help customers with repetitive tasks. The current version can already connect to any chatbot or assistant system, bringing a friendly face and an emotionally intelligent response to real-time interactions. Once finished, this technology can be easily deployed online, in meeting platforms or in kiosks around the globe.
Douglas is the latest technology built off the likeness of Senior Director of Software R&D, Dr. Doug Roble, which has already led to several advancements in both real-time digital humans and AI facial capture. By comparing Douglas to the real-life Roble, Digital Domain has been able to advance the realism of their design as they prepare the technology for wider use.
To create Douglas, Roble submitted to over a hundred hours of performance capture, including a live book reading that logged his voice and expressions. A neural rendering tool was also trained by taking photos of Roble in a variety of lighting conditions. From this data, the tool can now deliver levels of realism that would have been impossible to achieve before with traditional techniques, including replicating the mannerisms of another person with only few expressions. In recent months, the team has begun swapping out faces and trying on new voices, an edit that only requires 30 minutes of audio or 10 minutes of video.
"Douglas has introduced a level of realism unseen before in the autonomous human world, even before it comes to market," said Daniel Seah, chief executive officer of Digital Domain. “As Digital Domain continues to expand our R&D into facial capture and autonomous behavior, we’ll be able to extend these innovations out to consumers and tech partners who are looking to enhance virtual human capabilities beyond simple voice recognition applications."
Digital Domain is scheduling demos now and is interested in all opportunities around Douglas including investments, partnerships and client work. To schedule a call (or talk to Douglas), please contact: Email Contact.
To see Douglas in action, click here.
About Digital Domain
Digital Domain creates transportive experiences that entertain, inform and inspire. Throughout the last quarter of a century, the studio has grown to lead the visual effects industry, expanding globally into digital humans, virtual production, previsualization and virtual reality, and adding commercials, game cinematics and episodics to the robust film roster. Digital Domain’s rich legacy consists of hundreds of blockbuster feature films for every major studio and thousands of commercials, music videos, game cinematics and digital content by world-renowned directors and brands.
A creative force in visual effects and premium content, Digital Domain have brought artistry and technology to films including Titanic, The Curious Case of Benjamin Button and blockbusters Ready Player One, Avengers: Infinity War and Avengers: Endgame. Staff artists have won more than 100 major awards, including Academy Awards, Clios, BAFTA awards and Cannes Lions.
Digital Domain has successfully become the first independent visual effects studio to enter Greater China. In 2018, Digital Domain acquired one of China’s VR hardware equipment pioneers and leaders - VR Technology Holdings Ltd, Shenzhen（“3Glasses”).
Digital Domain has locations in Los Angeles, Vancouver, Montreal, Beijing, Shanghai, Shenzhen, Hong Kong, Taipei and Hyderabad. Digital Domain Holdings Limited is listed on the Hong Kong Stock Exchange (stock code: 547).
Digital Domain: www.digitaldomain.com