mirror of
https://github.com/tangerineturtle1/NX2navi.git
synced 2026-11-17 17:59:58 -04:00
Build a large compute shader ahead only when a run has dispatched it, and release the shaders of pipelines the boot does not keep.
The 2 GiB of device memory a filled cache cost was not the thousands of compute pipelines but twenty of them: the compute shaders of 0.9 to 2.0 million SPIR-V words, the game's tensor-core upscaler programs, which nothing dispatches. A pipeline of one holds about 100 MiB of device memory from the moment it exists, and the driver keeps that memory when the pipeline is destroyed, so keeping only the recently dispatched pipelines did not help: the boot pass still created the twenty from pipeline-cache.bin at every start. Measured with --probe-prewarm on a copy of an installed copy's caches (RTX 5090, NVIDIA 621.01): the pass over all 4,066 compute shaders took the device memory from 386 to 2,398 MiB and the process's commit up by 2.5 GB; the same pass before the twenty were in the cache left the device memory at 386 MiB, and all 4,046 other pipelines kept at once cost 2 MiB. A compute shader over NX2NAVI_LIB_PREBUILD_BIG is now built ahead, from the caches or by the background builder, only when the usage record says a run dispatched it. None of the twenty is among the 138 shaders eleven runs dispatched. Should the game dispatch one for the first time, that dispatch compiles it once and later boots build it ahead. The boot also reads the shader of a pipeline it does not keep as a copy and releases it after the build, instead of leaving 3,900 shaders loaded (240 MB of commit); a first dispatch then reads its shader from the disk, 0.04 to 0.10 ms in the probe. With both, the same pass on the same caches leaves the device memory at 386 MiB and raises the commit by 47 MB; 256 first dispatches after it took 0.13 ms on average, 1.8 ms at most, all read from the cache file. With compute_keep = all, which builds everything as before, the pass ends at 2,528 MiB. Not yet run in the game. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
This commit is contained in:
@@ -118,9 +118,10 @@ keeps per-core data without locks and relies on that, so the host models it (`ru
|
||||
are compiled outside the pipeline lock, and one compile serves every thread that needs it. The boot builds the
|
||||
pipeline of every compute shader play recorded or the shader preparation listed, but keeps only those of the shaders
|
||||
dispatched most recently (`compute-used.bin`, `compute_keep`): the others go into the pipeline cache and are
|
||||
destroyed, and their first dispatch creates them from it. A kept pipeline holds driver memory whether it is used or
|
||||
not, and the list has thousands of compute shaders a session never dispatches (`runtime/vk_pipeline.c`, "compute
|
||||
pipelines the boot keeps").
|
||||
destroyed, and their first dispatch creates them from it. A compute shader of more than half a million SPIR-V words
|
||||
is built ahead only when a run has dispatched it: a pipeline of one holds about 100 MiB of device memory whether it
|
||||
is used or not, also after it is destroyed, and the list has about twenty of them that the game never dispatches
|
||||
(`runtime/vk_pipeline.c`, "compute pipelines the boot keeps").
|
||||
- The game's tensor-core upscaler is replaced by a decode-and-scale pass (`vk_tonemap.c`); `vk_fsr.c` runs AMD FSR 1
|
||||
(EASU, RCAS) on the present when the window is larger than the picture.
|
||||
- HDR (`vk_hdr.c`): the game tonemaps its scene into a float target, upscales it, draws the HUD into a second float
|
||||
|
||||
@@ -306,7 +306,8 @@ exe's own version first, then of the other one.
|
||||
`--probe-prewarm` runs the boot's pipeline stages without the game, from the caches next to the exe (it skips when
|
||||
there are none): the pipeline cache load, the shader prewarm, the recorded pipelines and the compute pipeline prebuild,
|
||||
with a `mem: boot stage` log line after each that gives the device memory and the process commit so far. It then asks
|
||||
for compute pipelines the boot did not keep, as their first dispatch would, and prints what one costs. A change to what
|
||||
for compute pipelines the boot did not keep, as their first dispatch would, and prints what one costs. The device
|
||||
memory after the compute stage should be what it was before the stage, apart from the kept pipelines. A change to what
|
||||
the boot builds or keeps (`runtime/vk_pipeline.c`: `prewarm_run`, `lb_compute`, the `compute-used.bin` record) passes it.
|
||||
|
||||
Shaders: `.venv-py314\Scripts\python tools\shader_census.py --version <ver> --translate` extracts every Maxwell shader
|
||||
|
||||
Reference in New Issue
Block a user