|
| 1 | +# RTX Remix Release 1.0 Notes (3/13/2025) |
| 2 | + |
| 3 | +We are excited to announce the official 1.0 release of RTX Remix. |
| 4 | + |
| 5 | +Note: From now on the Toolkit version will follow the runtime version (1.0.0) and they will continue to be released together. |
| 6 | + |
| 7 | +RTX Remix comes out packed with new state of the art graphical features to empower you to build more beautiful worlds and characters in your mods. And the runtime has been upgraded with new neural rendering with DLSS 4 and Neural Radiance Cache to improve the experience playing Remix mods. DLSS 4 Transformer model ensures everything you create will retain more detail, allowing your artistic vision to translate more perfectly to the screen. With Multi-Frame Generation, path traced mods soar up to 8X performance over native. And, RTX Remix debuts the world’s first neural shader, Neural Radiance Cache–an AI approach to estimating indirect light more accurately and performantly, that trains on your live game session as you play. |
| 8 | + |
| 9 | +Let’s get into the details: |
| 10 | + |
| 11 | + |
| 12 | +## Improved RTX Remix Rendering |
| 13 | + |
| 14 | +**DLSS 4 Multi-Frame Generation:** |
| 15 | + DLSS 4 allows you to generate up to 3 frames per rendered frame, supercharging performance. In Half-Life 2 RTX, DLSS 4 MFG helps increase framerates by 10X over native at 4K, ensuring the game looks smooth no matter what bells and whistles you turn on. |
| 16 | + |
| 17 | +**DLSS 4 Ray Reconstruction Transformer Model:** |
| 18 | +Ray Reconstruction has a new Transformer model that is much more accurate at accurately denoising ray-traced images, ensuring the highest degree of detail is retained. With the new Transformer model, even lower DLSS presets can look as good as higher presets with the old “CNN model” (Convolutional Neural Network). The image will be more temporally stable and overall much more enjoyable. |
| 19 | + |
| 20 | +Please note, the Transformer model is a slightly heavier network than the CNN model. As a result, we’ve opted to automatically default to the CNN model at the “Low” and “Medium” presets to ensure people who are looking to claw back any performance on the table can secure it. |
| 21 | + |
| 22 | +**Neural Radiance Cache:** |
| 23 | + NRC is a neural shader that estimates more accurate indirect light more performantly. While you play, a grid of tiny neural networks in screen and world space train live on your game session, tailoring their approach to the content you are seeing in real time. Paths from lights are traced for 1-2 bounces before being stored in the radiance cache of the network, at which point a multitude of additional bounces are inferred by AI. Because fewer bounces are calculated and are instead inferred, NRC improves performance in Half-Life 2 RTX by 15%. |
| 24 | + |
| 25 | +It offers three graphical settings with tradeoffs between performance and indirect lighting accuracy: Medium, High, and Ultra. |
| 26 | + |
| 27 | +**Performance & Memory Optimizations:** |
| 28 | +The RTX Remix runtime has seen a number of optimizations to performance in both CPU bounded and GPU bounded scenarios. The extent of this uplift may vary depending on the specific RTX Remix mod. Take a look at how performance is improved in Portal With RTX on a 5070TI: |
| 29 | +1. Portal With RTX (Beta Runtime): 111 FPS |
| 30 | +2. Portal With RTX (Release Runtime): 132 FPS |
| 31 | +3. Portal With RTX (Release Runtime with NRC On): 155 FPS |
| 32 | +4. Portal With RTX (Release Runtime with NRC + DLSS): 260 FPS |
| 33 | + |
| 34 | +Performance and memory optimizations come on the back of a multitude of changes: |
| 35 | +Optimized memory and performance of BVH builds by utilizing instancing |
| 36 | +Limited max bones per vertex for skinned meshes |
| 37 | +Improved OMM budgeting to work better in scenarios using most of VRAM |
| 38 | +Added runtime normal compression for replacement assets to reduce memory usage |
| 39 | +Removed unnecessary resource allocations based on active graphics features |
| 40 | +Disabled rendering passes that are not needed for active graphics features |
| 41 | +Improved reuse of compatible resources' memory across different rendering passes |
| 42 | +Reduced memory usage of ray tracing acceleration structures on lower memory GPUs |
| 43 | +Tweaked RTXDI quality settings for more performance when Ray Reconstruction is enabled |
| 44 | +Switched from host visible to device local allocations for mesh replacement buffers |
| 45 | +Optimized CPU cost of CreateSurfaceMaterial by caching and reusing RtSurfaceMaterial within the same frame |
| 46 | +Reused instance matching and projection decomposition to lower per instance CPU cost |
| 47 | + |
| 48 | +**New Texture Streaming:** |
| 49 | +Optimizes VRAM usage to maximize texture quality within the available video memory budget. Players will notice assets streaming in faster, in higher quality more often, and will see “spilling” less frequently. Note: this will not necessarily decrease total VRAM usage, as RTX Remix always tries to use available VRAM efficiently to ensure highest quality textures are being seen. |
| 50 | + |
| 51 | +**Changes to Shader Compilation** |
| 52 | +Remix will now only prewarm shaders that are actually being used, improving shader compilation time at first launch. Note that this may lead to shader compile stalls when changing Remix options that require different shader permutations. |
| 53 | +Added asynchronous shader compilation functionality and a progress UI when the game is compiling shaders during play |
| 54 | + |
| 55 | + |
| 56 | +## Upgraded Mod Authorship Tools |
| 57 | + |
| 58 | +### New Features |
| 59 | + |
| 60 | +**Enhanced Character Creation:** In games that support GPU skinning, you will now be able to replace characters in the same fidelity you have been replacing assets and world materials. Import a rigged character replacement into RTX Remix, and from the Toolkit, remap its bones and joints to help it conform more closely to the skeleton RTX Remix captured (and therefore expects to render). Once this is done, the character will animate as expected. |
| 61 | + |
| 62 | +A new tool has been added to help with replacing animated assets using GPU Skinning. More [here](howto/learning-assets.md#remapping-skeleton-tool). |
| 63 | + |
| 64 | +**Controls for RTX Skin:** |
| 65 | +RTX Skin represents one of the first implementations of sub-surface scattering in ray-traced gaming. Light can now propagate and transmit through skin, grounding characters in a new realism. RTX Skin can also be used to make dazzling world materials, like jade, which can sparkle and take on complex colors when illuminated. |
| 66 | + |
| 67 | +Use the RTX Remix Toolkit to add SSS maps to any asset to tune the per pixel transmission level. And in the RTX Runtime, you can adjust the SSS scale to influence the global multiplier for all assets marked with SSS to increase the intensity of the effect.More [here](howto/learning-materials.md#subsurface-scattering). |
| 68 | + |
| 69 | +**RTX Volumetrics:** |
| 70 | +We’ve overhauled our volumetric system by leveraging a volume-based ReSTIR algorithm (Reservoir-based Spatiotemporal Importance Resampling). Light beams now look more defined, with higher contrast volumetric lighting and shadows. Shafts of light will look sharper, helping to create those epic moments in gameplay we love. |
| 71 | + |
| 72 | +Within the RTX Remix menu you can adjust parameters to customize the volumetric atmosphere of your mod. We provide presets so you can visualize your game scene with fog, smoke, haze, and other conditions, and each parameter is tunable. You can even inject dust particles in the scene, and define their physics and properties. |
| 73 | + |
| 74 | +In the RTX Remix Toolkit, the volumetric radiance scale attribute can make lighting larger than life (literally), influencing how much light contributes to the volumetric look of your scene. This multiplier enables modifying volumetric contribution on a per light basis to create more pronounced lighting effects. A 1 value keeps lighting completely physically based obeying the laws of physics, but you can turn it up or down for a more stylized look. |
| 75 | + |
| 76 | + |
| 77 | +### Stage Manager |
| 78 | + |
| 79 | +The most requested feature is here and it’s sure to speed up your modding. From this new control panel, modders can view a complete list of all tweakable game elements, jumping directly to them with a click. Sort and find prims, lights, meshes, materials, skeletons, and more, isolate remastered and original assets, and create custom searchable tags for any prim, making finding and editing assets easier. You can also view prims by Remix category, like particles, decals, UI, sky. |
| 80 | + |
| 81 | +You can also temporarily hide assets in the Viewport, in the event you are modifying a game scene that is obstructed by walls or large objects. And multiselection and editing is even easier when all of your assets are groupable in a list. |
| 82 | + |
| 83 | +**Stage Manager Official Release:** The Stage Manager is now integrated as a key component of the RTX Remix Toolkit that allows selecting and editing of any prim in your mod. |
| 84 | + |
| 85 | +**ON by default:** The Stage Manager is now on by default, but can still be toggled under "Optional Features". |
| 86 | + |
| 87 | +**New Stage Manager Tabs:** |
| 88 | +Added Categories, Skeleton, Meshes, Materials, and Custom Tags tabs alongside the existing All Prims and Lights tabs to Stage Manager. |
| 89 | + |
| 90 | +**Custom Tags:** |
| 91 | +Tag any capture or replacement prim with a custom name and make it easy to find again or manage similar objects. |
| 92 | + |
| 93 | +**Contributions Welcome:** Stage Manager functionality can easily be expanded by contributing to our open source project. |
| 94 | + |
| 95 | +#### Refined Toolkit Experience |
| 96 | + |
| 97 | +The Toolkit has had a thorough polish pass making it much easier to use. |
| 98 | + |
| 99 | +**Updated to kit sdk 106.5:** |
| 100 | +The app is now built on a new version of the omniverse [kit sdk](https://docs.omniverse.nvidia.com/dev-guide/latest/release-notes/106_5_highlights.html) which contains many fixes and stability improvements. |
| 101 | + |
| 102 | +**Removed Path Restrictions:** |
| 103 | +Removed whitespace project path limitation for flexible project names and locations. |
| 104 | + |
| 105 | +**Performance:** |
| 106 | +Improved performance and responsiveness of Stage Manager and other widgets. |
| 107 | + |
| 108 | +**New Homescreen:** |
| 109 | +A redesigned home screen with a simplified project creation flow brings a cleaner interface to making new projects. Added ability to cleanup deleted projects. |
| 110 | + |
| 111 | +**Improved Packaging:** |
| 112 | +Added a new tool to help automate resolving resource paths when packaging your mod. More [here](howto/learning-packaging.md). |
| 113 | + |
| 114 | +**Property Widget Improvements:** |
| 115 | +Continued to fix, improve the look and feel, and simplify code controlling selection panel and property editor widgets. |
| 116 | + |
| 117 | +**Remix Categories:** |
| 118 | +This key feature of Remix has been updated in Toolkit and aligned with the Runtime. We've foregrounded tooltips to help guide Modders in tagging replacement meshes with the appropriate category for the runtime. More [here](howto/learning-overview.md#remix-categories). |
| 119 | + |
| 120 | +**Ingestion Scale Factor**: Flipped asset ingestion parameter from "Meters per Unit" to "Asset Scale Factor" to make ingesting assets at the right size more intuitive. More [here](howto/learning-ingestion.md#how-to-ingest-an-asset) |
| 121 | + |
| 122 | +**Improved Documentation:** We have added more details and will continue to make updates to this documentation. Contributions are also welcome as github PRs to the [remix-toolkit repo](https://github.com/NVIDIAGameWorks/toolkit-remix). |
| 123 | + |
| 124 | +## Bugfixes and Minor Changes |
| 125 | +### RTX Remix Runtime: |
| 126 | +- Improved Ray Reconstruction responsiveness with animated textures. |
| 127 | +- Updated NRD to 4.13 for better performance, sharper and more stable denoising |
| 128 | +- AnimatedWaterTexture now works for translucent materials |
| 129 | +- Fixed flickering in reflection & refraction rays that hit the sky |
| 130 | +- Fixed incorrectly hidden meshes after hide / show is used in RTX Remix |
| 131 | +- Added support for rays starting underwater or inside other translucent materials based on the game's fog state |
| 132 | +- Fixed bugs with terrain and displace_out interactions |
| 133 | +- Improved free camera keyboard turning controls |
| 134 | +- Added max light intensity for light conversion |
| 135 | +- Corrected an issue with the Bridge where inputs would sometimes not be forwarded. |
| 136 | +- Added support for AddDirtyBox(), AddDirtyRect() and SetSoftwareVertexProcessing() API call forwarding. |
| 137 | +- Corrected an issue where certain bridge messaging systems ignored that timeouts were disabled, which could cause timeout related crashes if the default value was too low for the host application. |
| 138 | +- Corrected an issue where the bridge server or client could hang indefinitely when timeouts are disabled. |
| 139 | + |
| 140 | +### RTX Remix Toolkit: |
| 141 | +- Fixed capture window behavior to avoid it hanging on other tabs |
| 142 | +- Fixed disclosure icon display so tree view and panels mean the same thing |
| 143 | +- Fixed display of Remix Categories icon for only when applicable mesh objects are selected |
| 144 | +- Fixed various Stage Manager issues |
| 145 | +- Fixed layers panel performance in large projects |
| 146 | +- Fixed light selection behavior in selection panel |
| 147 | +- Fixed layer panel inconsistent muteness state |
| 148 | +- Fixed layer panel not refreshing after unloading stage + more fixes |
| 149 | +- Fixed ingestion bug for drag and drop |
| 150 | +- Fixed Tooltips on properties from USD schema which include a documentation string from the schema. |
| 151 | + |
| 152 | +## Changelogs |
| 153 | +For runtime release notes, please click [here](https://github.com/NVIDIAGameWorks/rtx-remix/releases/tag/remix-1.0.0) |
| 154 | + |
| 155 | +For a full toolkit changelog, please click [here](remix-full-changelog.md) |
| 156 | + |
| 157 | + |
1 | 158 | # RTX Remix Release 0.6 Notes (12/3/2024) |
2 | 159 |
|
3 | 160 | The latest release of the RTX Remix Toolkit and Runtime brings powerful new features and enhancements designed to take your modding experience to the next level. Here’s some of what the release has in store: |
|
0 commit comments