sky_line/Slipstream

[Epic] VR support (OpenXR) -- headline feature for 1.6 #1072

New issue

Open

opened 2026-10-25 20:31:36 +00:00 by sky_line · 1 comment

sky_line commented

2026-10-25 20:31:36 +00:00

Owner

Hard rule (applies to every VR ticket): the non-VR path must not lose quality or FPS. All VR work is optional and only affects the VR path: no new per-frame work, memory, pipelines or device extensions when VR is off; each milestone is gated by a fixed-camera GPU/CPU timer A/B of VR-off against main before it lands.

Plan: research/VR_SCOPE_1_6.md (local). Decisions so far: OpenXR; RT-capable GPUs only; RT shadows on, GI off, RT reflections optional and replacing planar mirrors, draw distance capped, DLSS per eye; curved UI wall with the full screen UI incl. HUDs + wrist panel for IMs/notifications; locomotion frozen while the wall is up; fly cam with a comfort blink back to the avatar; frame-rate safety governor in a new Preferences > Safety tab (on by default, warning when disabled). Desktop window shows a mirror of the headset view.

Milestones are linked as dependencies.

**Hard rule (applies to every VR ticket):** the non-VR path must not lose quality or FPS. All VR work is optional and only affects the VR path: no new per-frame work, memory, pipelines or device extensions when VR is off; each milestone is gated by a fixed-camera GPU/CPU timer A/B of VR-off against main before it lands. Plan: research/VR_SCOPE_1_6.md (local). Decisions so far: OpenXR; RT-capable GPUs only; RT shadows on, GI off, RT reflections optional and replacing planar mirrors, draw distance capped, DLSS per eye; curved UI wall with the full screen UI incl. HUDs + wrist panel for IMs/notifications; locomotion frozen while the wall is up; fly cam with a comfort blink back to the avatar; frame-rate safety governor in a new Preferences > Safety tab (on by default, warning when disabled). Desktop window shows a mirror of the headset view. Milestones are linked as dependencies.

sky_line added the

labels

2026-10-25 20:31:36 +00:00

sky_line added this to the Slipstream project

2026-10-25 20:31:36 +00:00

sky_line referenced this issue

2026-10-25 20:31:36 +00:00

VR M0: OpenXR session and a test image in the headset #1073

sky_line added a new dependency

2026-10-25 20:31:36 +00:00

#1073 VR M0: OpenXR session and a test image in the headset

sky_line referenced this issue

2026-10-25 20:31:36 +00:00

VR M1: mono world head-tracked #1074

sky_line added a new dependency

2026-10-25 20:31:36 +00:00

#1074 VR M1: mono world head-tracked

sky_line referenced this issue

2026-10-25 20:31:36 +00:00

VR M2: layered stereo -- N-view rendering (multiview raster, compute over view layers, shared once-per-frame work) #1075

sky_line added a new dependency

2026-10-25 20:31:36 +00:00

#1075 VR M2: layered stereo -- N-view rendering (multiview raster, compute over view layers, shared once-per-frame work)

sky_line referenced this issue

2026-10-25 20:31:37 +00:00

VR M3: UI wall, wrist panel, controllers, fly cam, safety governor #1076

sky_line added a new dependency

2026-10-25 20:31:37 +00:00

#1076 VR M3: UI wall, wrist panel, controllers, fly cam, safety governor

sky_line referenced this issue

2026-10-25 20:31:37 +00:00

VR M4: performance -- multiview, shared passes, foveation #1077

sky_line added a new dependency

2026-10-25 20:31:37 +00:00

#1077 VR M4: performance -- multiview, shared passes, foveation

sky_line referenced this issue

2026-10-25 20:31:37 +00:00

VR M5: comfort and polish #1078

sky_line added a new dependency

2026-10-25 20:31:37 +00:00

#1078 VR M5: comfort and polish

sky_line referenced this issue

2026-10-25 20:31:37 +00:00

VR de-risk spikes: simulated HMD, render-twice cost, queue-submit audit #1079

sky_line added a new dependency

2026-10-25 20:31:37 +00:00

#1079 VR de-risk spikes: simulated HMD, render-twice cost, queue-submit audit

sky_line referenced this issue from a commit

2026-10-26 02:36:20 +00:00

#1073: vendor the OpenXR headers and a run-time OpenXR loader shim (llxr)

sky_line commented

2026-10-26 02:50:28 +00:00

Author

Owner

Revised plan (2026-10-26):

✅ De-risk spikes (#1079) and M0 (#1073): OpenXR session, Vulkan device via the runtime, eye swapchains, frame loop -- working on a Valve Index.
M1 (#1074, in progress): head-tracked mono world in the headset (pose -> camera, frame loop / pacing, recenter, mirror window), plus M0 follow-ups.
M2 (#1075): layered stereo end state (multiview + compute over view layers + shared work); absorbs the old M4 (#1077, closed).
M3 (#1076): UI wall, wrist panel, controllers, fly cam, safety governor + Safety tab, login room.
M5 (#1078): comfort and polish (foveation follow-ups land here or under #1075).

Revised plan (2026-10-26): - ✅ De-risk spikes (#1079) and **M0** (#1073): OpenXR session, Vulkan device via the runtime, eye swapchains, frame loop -- working on a Valve Index. - **M1** (#1074, in progress): head-tracked mono world in the headset (pose -> camera, frame loop / pacing, recenter, mirror window), plus M0 follow-ups. - **M2** (#1075): layered stereo end state (multiview + compute over view layers + shared work); absorbs the old M4 (#1077, closed). - **M3** (#1076): UI wall, wrist panel, controllers, fly cam, safety governor + Safety tab, login room. - **M5** (#1078): comfort and polish (foveation follow-ups land here or under #1075).

sky_line self-assigned this

2026-10-26 02:58:26 +00:00

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1074: LLXrSession -- app reference space, the head pose per frame, the world image into both eyes

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1076: VR controllers -- OpenXR action set, hand poses in agent space, visible hands

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1076: VR UI wall -- the desktop UI on a curved world-locked wall, laser pointer, clicks, scroll

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1076: VR UI wall -- HUD attachments on the wall

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1076: VR locomotion -- thumbstick walk relative to your head, snap / smooth turn, up / down

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1076: VR wrist panel -- notifications and IMs on the left wrist while the wall is hidden

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1076: VR fly cam -- leave the body and fly; back to the avatar with a blink, never a fly-back

sky_line referenced this issue from a commit

2026-10-26 16:19:10 +00:00

#1076: VR frame-rate safety governor and the Preferences > Safety tab

sky_line referenced this issue

2026-10-26 20:55:23 +00:00

VR: local speech-to-text for chat and text fields (on-screen keyboard only as fallback) #1118

sky_line referenced this issue

2026-10-26 20:55:23 +00:00

VR: push-to-talk speech straight to nearby chat without opening the UI #1119

sky_line referenced this issue

2026-10-26 20:55:24 +00:00

VR: wrist panel is too small and hard to use -- redesign #1120

sky_line referenced this issue

2026-10-26 20:55:24 +00:00

VR: avatar head and neck follow the headset (look-at style), body turns past the neck's limits #1121

sky_line referenced this issue

2026-10-26 20:57:11 +00:00

VR: headset audio output and headset microphone while VR is on (switch back on exit) #1122

Sign in to join this conversation.

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Depends on

#1074 VR M1: mono world head-tracked

sky_line/Slipstream

#1075 VR M2: layered stereo -- N-view rendering (multiview raster, compute over view layers, shared once-per-frame work)

sky_line/Slipstream

#1073 VR M0: OpenXR session and a test image in the headset

sky_line/Slipstream

#1076 VR M3: UI wall, wrist panel, controllers, fly cam, safety governor

sky_line/Slipstream

#1077 VR M4: performance -- multiview, shared passes, foveation

sky_line/Slipstream

#1078 VR M5: comfort and polish

sky_line/Slipstream

#1079 VR de-risk spikes: simulated HMD, render-twice cost, queue-submit audit

sky_line/Slipstream

Reference

sky_line/Slipstream#1072

No description provided.