VR: finger tracking -- Index finger curl / splay, controller grip poses and hand tracking drive the Bento fingers #1587

Open
opened 2026-11-17 11:38:03 +00:00 by sky_line · 0 comments
Owner

Valve Index controllers sense each finger (curl per finger plus thumb, index and middle splay), and other controllers report trigger, grip and thumb touch. None of this reaches the avatar today.

Proposal

  • Drive the Bento finger bones (mHand*1-3, thumb, and the spread) from controller input:
    • Index: SteamVR skeletal input through OpenXR (per-finger curl and splay), or XR_EXT_hand_tracking where the runtime offers hand-tracking data for the Index;
    • other controllers: a natural grip from trigger / grip / thumb touch (point, fist, thumbs up, open hand).
  • Hand tracking (Quest camera hand tracking, XR_EXT_hand_tracking) drives the fingers directly when available.
  • Blend with the hand animation; a tracked finger overrides it; fade back over 0.3 s when lost.
  • Pose sharing (#1584) sends the finger bones under the same deadband and hysteresis.
  • Setting SlipstreamVRFingerTracking (on).

Part of #1565.

Valve Index controllers sense each finger (curl per finger plus thumb, index and middle splay), and other controllers report trigger, grip and thumb touch. None of this reaches the avatar today. ## Proposal - Drive the Bento finger bones (mHand*1-3, thumb, and the spread) from controller input: - **Index:** SteamVR skeletal input through OpenXR (per-finger curl and splay), or XR_EXT_hand_tracking where the runtime offers hand-tracking data for the Index; - **other controllers:** a natural grip from trigger / grip / thumb touch (point, fist, thumbs up, open hand). - **Hand tracking** (Quest camera hand tracking, XR_EXT_hand_tracking) drives the fingers directly when available. - Blend with the hand animation; a tracked finger overrides it; fade back over 0.3 s when lost. - Pose sharing (#1584) sends the finger bones under the same deadband and hysteresis. - Setting `SlipstreamVRFingerTracking` (on). Part of #1565.
sky_line added this to the Slipstream project 2026-11-17 11:38:03 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
sky_line/Slipstream#1587
No description provided.