NVIDIA Brings AI Assistants to Life With GeForce RTX AI PCs

NVIDIA is integrating RTX AI acceleration into applications for content creators, modders, and video enthusiasts in several ways. One of the primary methods is through the RTX AI Toolkit, a suite of tools and SDKs for model customization, optimization, and deployment on RTX AI PCs5. This toolkit enables developers to build application-specific AI models that run on PCs, taking advantage of the AI ecosystem's hundreds of thousands of open-source models.

Last year, NVIDIA introduced RTX acceleration using TensorRT for one of the most popular Stable Diffusion user interfaces, Automatic1111. This week, RTX will also accelerate the highly popular ComfyUI, delivering up to a 60% improvement in performance over the currently shipping version and 7x faster performance compared to the MacBook Pro M3 Max2.

NVIDIA RTX Remix is another way NVIDIA is integrating RTX AI acceleration into applications for content creators. It's a modding platform for remastering classic DirectX 8 and DirectX 9 games with full ray tracing, NVIDIA DLSS 3.5, and physically accurate materials. RTX Remix includes a runtime renderer and the RTX Remix Toolkit app, which facilitates the modding of game assets and materials.

Last year, NVIDIA made RTX Remix Runtime open source, allowing modders to expand game compatibility and advance rendering capabilities. This month, NVIDIA will make the RTX Remix Toolkit open source, allowing modders to streamline how assets are replaced and scenes are relit, increase supported file formats for RTX Remix’s asset ingestor, and bolster RTX Remix’s AI Texture Tools with new models.

In addition, NVIDIA is making the capabilities of RTX Remix Toolkit accessible via a REST API, allowing modders to livelink RTX Remix to digital content creation tools such as Blender, modding tools such as Hammer, and generative AI apps such as ComfyUI. NVIDIA is also providing an SDK for RTX Remix Runtime to allow modders to deploy RTX Remix’s renderer into other applications and games beyond DirectX 8 and 9 classics.

Finally, NVIDIA RTX Video, the popular AI-powered super-resolution feature supported in the Google Chrome, Microsoft Edge, and Mozilla Firefox browsers, is now available as an SDK to all developers, helping them natively integrate AI for upscaling, sharpening, compression artifact reduction, and high-dynamic range (HDR) conversion. Coming soon to video editing software Blackmagic Design’s DaVinci Resolve and Wondershare Filmora, RTX Video will enable video editors to upscale lower-quality video files to 4K resolution, as well as convert standard dynamic range source files into HDR. In addition, the free media player VLC media will soon add RTX Video HDR to its existing super-resolution capability.

The RTX Remix Toolkit is a powerful modding platform that allows users to remaster classic DirectX 8 and DirectX 9 games with cutting-edge graphics2. Some of the key features of the RTX Remix Toolkit include:

1. Upgrading Textures with AI: The Toolkit allows modders to enhance textures using generative AI tools, which can analyze textures and identify the material properties they are meant to possess2. This helps in generating roughness and normal maps to simulate realistic materials and upscale the pixel count of textures by 4x, ensuring that the remastered content looks stunning while retaining the essence of the original game.

2. Replacing Game Assets: Modders can easily replace game assets with high-fidelity assets built with physically accurate (PBR) materials2. This allows for a higher level of detail and realism in the remastered games.

3. Injecting RTX Technologies: The RTX Remix Toolkit enables modders to inject RTX ray tracing, DLSS, and Reflex technologies into the games they remaster2. This significantly enhances the visual appeal and performance of the remastered games.

4. RTX Remix Runtime: The Toolkit includes the RTX Remix Runtime, which helps capture classic game scenes and bring them into the RTX Remix application for modding. The Runtime is responsible for making the mod "work" when a gamer is playing the mod, by replacing old assets with remastered assets and relighting the game with path tracing.

5. Open-Source Development: NVIDIA has made the RTX Remix Toolkit open-source, allowing modders to streamline how assets are replaced and scenes are relit, increase supported file formats for RTX Remix's asset ingestor, and bolster RTX Remix's AI Texture Tools with new models2.

6. REST API Integration: The capabilities of the RTX Remix Toolkit can be accessed via a REST API, allowing modders to livelink RTX Remix to digital content creation tools such as Blender, modding tools such as Hammer, and generative AI apps such as ComfyUI.

The RTX Remix Toolkit supports the modding community by providing them with the tools and resources to create visually stunning and immersive remasters of classic games. It simplifies the process of capturing game assets and enhancing materials, allowing modders to focus on their creative vision and bring new life to beloved titles.