Vulkan: GPU breadcrumbs for device-lost diagnosis (NV checkpoints / AMD buffer markers) #136

New issue

Open

opened 2026-09-28 02:29:23 +00:00 by backspace119 · 0 comments

backspace119 commented

2026-09-28 02:29:23 +00:00

Owner

Related: #107, #135.

When the GPU hangs and the device is lost, the CPU-side dump only shows where we noticed (the next fence wait), not which pass hung. Add GPU breadcrumbs:

NVIDIA: VK_NV_device_diagnostic_checkpoints — vkCmdSetCheckpointNV at our existing gpuSubMark points (c_cull, c_lights, g_prepass, g_ssao, g_pass1, pass2, p_bloom, p_dof, p_aa, p_final, UI...); on DEVICE_LOST read vkGetQueueCheckpointDataNV and log the last executed/started markers.
AMD: VK_AMD_buffer_marker (vkCmdWriteBufferMarkerAMD into a host-visible buffer) with the same marker set.
Fallback for other vendors: VK_EXT_device_fault where available (vkGetDeviceFaultInfoEXT).
Setting to force it on (cheap; could default on for beta).
Output goes into the log so tester logs identify the hanging pass.

Related: #107, #135. When the GPU hangs and the device is lost, the CPU-side dump only shows where we noticed (the next fence wait), not which pass hung. Add GPU breadcrumbs: - NVIDIA: `VK_NV_device_diagnostic_checkpoints` — `vkCmdSetCheckpointNV` at our existing gpuSubMark points (c_cull, c_lights, g_prepass, g_ssao, g_pass1, pass2, p_bloom, p_dof, p_aa, p_final, UI...); on DEVICE_LOST read `vkGetQueueCheckpointDataNV` and log the last executed/started markers. - AMD: `VK_AMD_buffer_marker` (`vkCmdWriteBufferMarkerAMD` into a host-visible buffer) with the same marker set. - Fallback for other vendors: `VK_EXT_device_fault` where available (`vkGetDeviceFaultInfoEXT`). - Setting to force it on (cheap; could default on for beta). - Output goes into the log so tester logs identify the hanging pass.

backspace119 referenced this issue

2026-09-28 02:29:24 +00:00

Windows: abrupt exit with no dump or log error (fail-fast?) — tracking #107

backspace119 referenced this issue from a commit

2026-09-28 20:10:33 +00:00

Vulkan: GPU breadcrumbs for device-lost diagnosis