NVIDIA’s AI has already changed the game, and it’s still only heating up

Since the introduction of GeForce RTX 20-series GPUs and their integrated Tensor cores, NVIDIA has advanced the capabilities of AI in gaming. More and more features and games are leveraging AI to deliver their game worlds and quality graphics. And with the latest NVIDIA ACE technology, it’s clear that NVIDIA plans to make AI even more integrated into games than before.

The rise of AI started with NVIDIA DLSS, Deep Learning Super Sampling, which allows gamers to enjoy high-fidelity visuals without the typical frame rate issues that come with them. NVIDIA achieved this by using higher quality graphics as AI training data so that Tensor Cores could support low-resolution gameplay and understand how to bridge the gap. Now DLSS multiplies resolution and frame rate using AI.

Similarly, NVIDIA Freestyle and RTX Remix provide tools to improve game visuals with AI. Freestyle allows users to apply filters or even convert rendering to HDR for non-HDR games in real time to improve their experience. Meanwhile, RTX Remix can do for game assets what DLSS did for output resolution, allowing modders to grab asset files and intelligently convert them to higher quality assets to produce rapid game remasters classics.

While DLSS, NVIDIA Freestyle, and RTX Remix are all changing the visual experience of games, NVIDIA ACE is poised to change the way people interact with games themselves.

NVIDIA ACE puts a set of AI tools behind the game‘s NPCs (non-player characters). Just as the power of large language models has profoundly brought chatbots to life, NVIDIA ACE can deliver a new level of dynamism to NPCs, allowing players to find more engagement throughout their games.

Riva speech from NVIDIA ACE and Audio2Face Animation models allow for seamless interaction between players and NPCs. Riva takes players’ voice prompts and transcribes them for the game. AI-based NPCs respond in natural language that can be processed by Audio2Face to synchronize facial animations with the game character’s speech. Developers can run the entire pipeline, from user input to NPC response, in the cloud or even locally on the user’s PC.

NVIDIA NeMo provides pre-trained models and frameworks allowing developers to create their own language models that can be used to create the brains behind NPCs. Choose from pre-trained language models called Nemotron and create guardrails (the safety system used to keep language models on track and appropriate) using NeMo Guardrails. The frameworks can be used to easily optimize, refine, and deploy these language models to NVIDIA GPUs in the cloud.

As complicated as it may seem, AI has an important role to play in the future of gaming, and NVIDIA ACE is one of them. To help you understand all the latest developments, NVIDIA has introduced the Decoded AI serieswhich you can check out to stay up to date on what lies ahead at the intersection of gaming and AI.