NVIDIA Unveils “ACE” Model For Next-Gen Games, Integrating AI Into Virtual Characters

NVIDIA unveils Avatar Cloud Engine (ACE), a custom AI model that integrates AI into Non-Playable Characters (NPCs) for natural game language interactions.

NVIDIA ACE Model Intends to Revolutionize Gaming Experience With The Help of AI

With the aid of this tool, software, and game developers will be able to create and integrate unique voice, conversation, and motion AI models. The project is being carried out in partnership with Convai, a business developing conversational AI for online gaming environments.

Here is how NVIDIA breaks down the foundations of the model:

• NVIDIA NeMo — for building, customizing and deploying language models, using proprietary data. The large language models can be customized with lore and character backstories and protected against counterproductive or unsafe conversations via NeMo Guardrails.
• NVIDIA Riva — for automatic speech recognition and text-to-speech to enable live speech conversation.
• NVIDIA Omniverse Audio2Face — for instantly creating expressive facial animation of a game character to match any speech track. Audio2Face features Omniverse connectors for Unreal Engine 5, so developers can add facial animation directly to MetaHuman characters.

NVIDIA also showcased the model by demonstrating an example of an AI-generated conversation with an NPC. As you can see in the video below, the character answers questions based on the narrative backstory through the help of generative AI.

NVIDIA's new tool is a significant advancement for the gaming industry. We're excited to see how AI is incorporated into forthcoming games since it will significantly change the experience of playing a particular title, mainly when dealing with NPCs.

Written by Muhammad Zuhair Haider Zaidi