Realistic mouth movements, convincing facial expressions and “natural” conversations with NPCs. Nvidia ACE should be able to do all this and more – and now even better than before
Nvidia’s ACE AI service, which is designed to enable real conversations with NPCs, is now even more realistic and accessible.
Nvidia presented ACE for the first time at Computex 2023 and was described by the American company itself as the “future of video games”.
Real conversations, embellished backstories and more
What is Nvidia ACE? It is an AI service that aims to help developers integrate unique voice, conversation and motion AI models into game characters.
What’s new in the update? Nvidia talks about more realism and better accessibility
The new ACE model is intended to enable developers to use various cloud APIs. These include the following services, for which we provide a brief explanation:
- Automatic Speech Recognition (ASR): A system that records spoken language and converts it into text.
- Text-To-Speech (TTS): A system that converts text input into natural human speech
- Neuronal Machine Translation (NMT): Speech is translated automatically and simultaneously.
- Audio2Face (A2F): Facial animation and lip synchronization are only generated by one audio source.
All of these tools are available in the Early Access program on the (Nvidia homepage) and can be used with rendering tools such as Unreal Engine 5.
What does Nvidia ACE bring me? Honestly? Not much for the time being. But in the future you’ll probably be able to have real conversations with characters and ask different questions that fit the character and their personality.
However, the dialogs might take a while yet. In the near future, you can look forward to more realistic animations and facial expressions, supported by AI.
When will Nvidia ACE be used? In the Nvidia Newsroom there is talk that the development studio GSC Game World will use Nvidia Ace in their upcoming game Stalker 2 . More specifically, Audio2Face, which will be used for realistic mouth movements that match the sentences spoken.
Are you looking forward to speaking with realistic-looking characters? What impact do you think this technology will have on the gaming industry once it becomes more widely used? Do you think there will be a big change in gaming, or will it be more in the direction of VR? So not the revolution that many expected, but a useful extension for certain games? Your opinion in the comments!
