VR: full-body tracking (OpenXR trackers: hips / feet, IK; local-only first) #1565

Open
opened 2026-11-16 18:11:17 +00:00 by sky_line · 0 comments
Owner

Full-body tracking for VR (part of the VR epic #1072; milestone M5 comfort/polish or later; builds on #1121 head/neck follow).

Scope

  • Input: OpenXR tracker devices: XR_HTCX_vive_tracker_interaction (SteamVR: Vive / Tundra trackers; SlimeVR through its SteamVR driver). Check Monado's generic device path (XR_MNDX_xdev_space) on Linux. Feature-detect at session start; nothing changes when no trackers are present.
  • Roles and calibration: map trackers to roles (hips, left/right foot; optional knees, elbows, chest). A T-pose calibration step records each tracker's offset to its bone; roles from the runtime's role binding when available, else a manual assignment UI on the VR wall.
  • IK: drive the avatar's skeleton (Bento included) from the headset, controllers and trackers: hips + feet two-bone leg IK, spine from hips to head, arms from controllers (#1121's head/neck rules carry over). Local animation layer on top of SL animations, with a blend weight and a per-role enable.
  • Visibility to others (caveat): Second Life has no live-pose protocol, so tracking is local-only at first: you see your own body move, others don't. Showing it to other Slipstream users would need our own channel (like position sync #1417 via the Slipstream Helper), opt-in, later stage; other viewers would never see it.
  • Hard rule (VR epic): no cost when VR is off and no cost in VR when no trackers are connected: no per-frame work, memory or pipelines added to the non-VR path.

Acceptance

  • Trackers detected and listed; roles assignable; calibration from a T-pose.
  • Own avatar's hips/feet follow the trackers in the headset and in the desktop mirror window, with stable feet (no sliding/jitter beyond the trackers' own).
  • Tracker loss (battery, occlusion) degrades gracefully back to the normal animation for that limb.
  • VR-off and VR-without-trackers frame times unchanged (timer A/B).
Full-body tracking for VR (part of the VR epic #1072; milestone M5 comfort/polish or later; builds on #1121 head/neck follow). ## Scope - **Input:** OpenXR tracker devices: `XR_HTCX_vive_tracker_interaction` (SteamVR: Vive / Tundra trackers; SlimeVR through its SteamVR driver). Check Monado's generic device path (`XR_MNDX_xdev_space`) on Linux. Feature-detect at session start; nothing changes when no trackers are present. - **Roles and calibration:** map trackers to roles (hips, left/right foot; optional knees, elbows, chest). A T-pose calibration step records each tracker's offset to its bone; roles from the runtime's role binding when available, else a manual assignment UI on the VR wall. - **IK:** drive the avatar's skeleton (Bento included) from the headset, controllers and trackers: hips + feet two-bone leg IK, spine from hips to head, arms from controllers (#1121's head/neck rules carry over). Local animation layer on top of SL animations, with a blend weight and a per-role enable. - **Visibility to others (caveat):** Second Life has no live-pose protocol, so tracking is **local-only** at first: you see your own body move, others don't. Showing it to other Slipstream users would need our own channel (like position sync #1417 via the Slipstream Helper), opt-in, later stage; other viewers would never see it. - **Hard rule (VR epic):** no cost when VR is off and no cost in VR when no trackers are connected: no per-frame work, memory or pipelines added to the non-VR path. ## Acceptance - Trackers detected and listed; roles assignable; calibration from a T-pose. - Own avatar's hips/feet follow the trackers in the headset and in the desktop mirror window, with stable feet (no sliding/jitter beyond the trackers' own). - Tracker loss (battery, occlusion) degrades gracefully back to the normal animation for that limb. - VR-off and VR-without-trackers frame times unchanged (timer A/B).
sky_line added this to the Slipstream project 2026-11-16 18:11:17 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
sky_line/Slipstream#1565
No description provided.