VR: your avatar's arms follow the controllers (arm IK, elbows, shoulders) and the neck follows the headset #1584

Open
opened 2026-11-17 11:13:20 +00:00 by sky_line · 0 comments
Owner

In VR, your own avatar's arms are not driven by anything today: they keep playing the animation while the controllers are drawn as small stand-ins. Full-body tracking (#1565) drives the hips, spine and legs, and the look-at turns the head, so in a mirror the body follows you but the arms don't. Testers report it is hard to judge tracking without arms.

Arms

  • Hands at the controllers: each avatar wrist goes to its controller's grip pose (position and orientation), with a per-controller grip offset (Index, Quest Touch, Vive wands) so the avatar's palm sits where your hand is.
  • Two-bone IK (shoulder to elbow to wrist) using the solver the legs already use. Arm length is mapped through the calibration's body scale (your eye height onto the avatar's), so short or tall avatars still reach.
  • Elbow direction:
    • toward elbow trackers when a body source has them (SlimeVR sends elbows; SteamVR roles left/right_elbow; headset body tracking gives elbow joints);
    • otherwise a natural pole: down, back and out, blended by how high and far the hand is.
  • Shoulders (mCollarLeft/Right) take a share of reach and raise, so overhead reaches don't hyper-extend.
  • Wrist twist shared into the forearm (Bento forearm twist where present), so no candy wrapper.
  • Out of reach: the arm straightens toward the target without stretching. A lost or untracked controller fades the arm back to the animation over 0.3 s.

Neck

  • Drive mNeck as well as mHead from the headset: split the head's rotation between neck and head (most of the pitch and lean in the neck), and let the neck follow the headset's position relative to the chest. Leaning and craning then read properly instead of a head swivelling on a fixed neck.
  • Must agree with SLPoseLookAt's VR head turn (#1121 / #1567), so neither layer counts the turn twice.

General

  • Same layer as the body (LLVRBodyMotion), own avatar only, works with or without body trackers (controllers alone give arms and neck).
  • Settings: SlipstreamVRArmTracking (on), SlipstreamVRBodyWeightArms, SlipstreamVRBodyWeightNeck (0-1, live).
  • Local only, like the rest of #1565; sending the pose to others is separate.
  • No cost on the desktop.

Part of #1565.

In VR, your own avatar's arms are not driven by anything today: they keep playing the animation while the controllers are drawn as small stand-ins. Full-body tracking (#1565) drives the hips, spine and legs, and the look-at turns the head, so in a mirror the body follows you but the arms don't. Testers report it is hard to judge tracking without arms. ## Arms - **Hands at the controllers:** each avatar wrist goes to its controller's grip pose (position and orientation), with a per-controller grip offset (Index, Quest Touch, Vive wands) so the avatar's palm sits where your hand is. - **Two-bone IK** (shoulder to elbow to wrist) using the solver the legs already use. Arm length is mapped through the calibration's body scale (your eye height onto the avatar's), so short or tall avatars still reach. - **Elbow direction:** - toward elbow trackers when a body source has them (SlimeVR sends elbows; SteamVR roles left/right_elbow; headset body tracking gives elbow joints); - otherwise a natural pole: down, back and out, blended by how high and far the hand is. - **Shoulders** (mCollarLeft/Right) take a share of reach and raise, so overhead reaches don't hyper-extend. - **Wrist twist** shared into the forearm (Bento forearm twist where present), so no candy wrapper. - Out of reach: the arm straightens toward the target without stretching. A lost or untracked controller fades the arm back to the animation over 0.3 s. ## Neck - Drive mNeck as well as mHead from the headset: split the head's rotation between neck and head (most of the pitch and lean in the neck), and let the neck follow the headset's position relative to the chest. Leaning and craning then read properly instead of a head swivelling on a fixed neck. - Must agree with SLPoseLookAt's VR head turn (#1121 / #1567), so neither layer counts the turn twice. ## General - Same layer as the body (LLVRBodyMotion), own avatar only, works with or without body trackers (controllers alone give arms and neck). - Settings: `SlipstreamVRArmTracking` (on), `SlipstreamVRBodyWeightArms`, `SlipstreamVRBodyWeightNeck` (0-1, live). - Local only, like the rest of #1565; sending the pose to others is separate. - No cost on the desktop. Part of #1565.
sky_line added this to the Slipstream project 2026-11-17 11:13:20 +00:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
sky_line/Slipstream#1584
No description provided.