FSR 2/4: temporal upscaling in the TAA resolve (clean_taa.comp)

sky_line commented

2026-09-29 21:31:11 +00:00

Owner

Part of #6. Depends on the render/display split.

Turn the TAA resolve into a temporal upscaler (TAAU / FSR-2-style reconstruction): accumulate jittered render-size samples into a display-size history.

Per-output-pixel reconstruction from the nearest render samples with jitter-aware Lanczos/Gaussian weights; sample weight feeds a per-pixel accumulation count (more jitter phases at lower scale: Halton length scales with scale^-2).
Motion vectors / depth / reactive mask read at render size, dilated.
History clip box built from render-size neighbourhood.
Disocclusion / reset handling as today.

Keeps us dependency-free on Linux and Windows. AMD's FSR 3.1 (Vulkan backend) can sit behind the same interface later if quality needs it.

Part of #6. Depends on the render/display split. Turn the TAA resolve into a temporal upscaler (TAAU / FSR-2-style reconstruction): accumulate jittered render-size samples into a display-size history. - Per-output-pixel reconstruction from the nearest render samples with jitter-aware Lanczos/Gaussian weights; sample weight feeds a per-pixel accumulation count (more jitter phases at lower scale: Halton length scales with scale^-2). - Motion vectors / depth / reactive mask read at render size, dilated. - History clip box built from render-size neighbourhood. - Disocclusion / reset handling as today. Keeps us dependency-free on Linux and Windows. AMD's FSR 3.1 (Vulkan backend) can sit behind the same interface later if quality needs it.

sky_line added the

rendering

perf

feature

labels

2026-09-29 21:31:11 +00:00

sky_line referenced this issue

2026-09-29 21:31:18 +00:00

FSR upscaling #6

sky_line referenced this issue from a commit

2026-09-29 22:05:48 +00:00

TAA upscale: coverage-weighted blend and a scale-sized jitter cycle

sky_line referenced this issue from a commit

2026-09-29 22:59:30 +00:00

TAA upscale: per-pixel accumulation weight + rectification bisect views

sky_line referenced this issue from a commit

2026-09-29 22:59:30 +00:00

Render scale: unjittered display depth for the display-space passes

sky_line referenced this issue from a commit

2026-09-29 22:59:30 +00:00

TAA debug views: keep the real resolve (history) running underneath

sky_line referenced this issue from a commit

2026-09-29 22:59:30 +00:00

TAA upscale: disocclusion test on the pixel's own depth when scaled

sky_line referenced this issue from a commit

2026-09-29 22:59:30 +00:00

TAA upscale: 3x3 previous-depth search when scaled

sky_line referenced this issue from a commit

2026-09-29 22:59:30 +00:00

TAA upscale: locks for converged pixels, scale-aware depth tolerance

sky_line referenced this issue

2026-09-29 22:59:51 +00:00

Z-fighting on near-coplanar surfaces (windowsills, frames); worse under TAA jitter -- reversed-Z #188

sky_line commented

2026-09-29 22:59:54 +00:00

Author

Owner

Status after the #181/#182 test rounds (pushed up to bd48eea58c): edge flicker, false disocclusion bands and overlay jitter are fixed; locks keep sub-render-pixel detail stable. Known leftover: speckled history rejection on very distant thin geometry at render scale 0.5 (RenderVKTAADebug 1), minor visually. Window-sill flicker turned out to be z-fighting (present at native): #188.

Status after the #181/#182 test rounds (pushed up to bd48eea58c): edge flicker, false disocclusion bands and overlay jitter are fixed; locks keep sub-render-pixel detail stable. **Known leftover:** speckled history rejection on very distant thin geometry at render scale 0.5 (RenderVKTAADebug 1), minor visually. Window-sill flicker turned out to be z-fighting (present at native): #188.

sky_line referenced this issue

2026-09-29 23:32:09 +00:00

Later: investigate integrating AMD FSR 3.1 upscaler as an alternative to our TAA upscaler #191

sky_line referenced this issue from a commit

2026-09-29 23:45:00 +00:00

TAA upscale: reconstruction kernel in display pixels when scaled

sky_line referenced this issue from a commit

2026-09-29 23:45:00 +00:00

TAA upscale: accumulation cap scales with (display/render)^2

sky_line commented

2026-09-29 23:45:10 +00:00

Author

Owner

Pushed up to 33a645cd0d: coverage-weighted accumulation (R32F weight, cap scaled by (display/render)^2), display-space reconstruction kernel, own-depth disocclusion test + 3x3 previous-depth search, scale-aware depth tolerance, locks, unjittered display depth, debug views 1-5 fixed.

Open (iterate later):

Fine texture detail (brick mortar) still slightly softer than native at Performance.
Speckled history rejection on very distant thin geometry.
Watch for ghosting reports on static surfaces with changing lighting (longer accumulation + locks).
FSR 2 features not yet ported: luma-instability detection, lock lifetimes, Lanczos kernel, transparency/composition masks. AMD FSR 3.1 as an alternative: #191.

Pushed up to 33a645cd0d: coverage-weighted accumulation (R32F weight, cap scaled by (display/render)^2), display-space reconstruction kernel, own-depth disocclusion test + 3x3 previous-depth search, scale-aware depth tolerance, locks, unjittered display depth, debug views 1-5 fixed. **Open (iterate later):** - Fine texture detail (brick mortar) still slightly softer than native at Performance. - Speckled history rejection on very distant thin geometry. - Watch for ghosting reports on static surfaces with changing lighting (longer accumulation + locks). - FSR 2 features not yet ported: luma-instability detection, lock lifetimes, Lanczos kernel, transparency/composition masks. AMD FSR 3.1 as an alternative: #191.

sky_line referenced this issue

2026-09-29 23:45:10 +00:00

FSR upscaling #6

sky_line referenced this issue

2026-09-30 06:30:51 +00:00

TAA: shimmering / jitter on water and distant mesh #204

sky_line referenced this issue from a commit

2026-10-03 01:50:56 +00:00

TAA (#204): native-resolution anti-flicker lock for thin / distant geometry

sky_line referenced this issue

2026-10-04 02:45:46 +00:00

FSR upscaling #6

sky_line commented

2026-10-05 13:33:19 +00:00

Author

Owner

Superseded: the in-house TAA-U temporal upscaler was replaced by AMD FSR 3 (the custom upscaler's settings were removed and mapped onto FSR). Remaining FSR-only AA work is #246.

sky_line closed this issue

2026-10-05 13:33:19 +00:00

sky_line referenced this issue

2026-10-05 13:33:19 +00:00

FSR upscaling #6

Rows
Columns

FSR 2/4: temporal upscaling in the TAA resolve (clean_taa.comp) #182