VRChat IK 2.0

There are situations where one might want to track their hands, waist, feet, etc. but not have an HMD connected. This is especially true when trying to debug OSC trackers. Currently, all settings related to body tracking and FBT calibration are hidden when running VRC without an HMD connected. IK solver may not work correctly without a headset input, but that input can be provided or spoofed via OSC based on the documentation here: https://docs.vrchat.com/edit/osc-trackers

Based on this Canny, the new AvatarRoot TrackingDataType was introduced: https://feedback.vrchat.com/vrchat-ik-20/p/1333-unexpected-behavior-of-playerapigetrotation In FBT, it returns the root rotation independent from head rotation, as long a player stays somewhere. This works fine, as long the player is grounded, but it fails during falling, hovering or swimming (IsGrounded = false, no movement). In this case, the head rotation will be returned, which is unexpected. Expected Behaviour: PlayerApi.GetTrackingData(VRCPlayerApi.TrackingDataType.AvatarRoot) return the same rotation as it was before the IK changes with PlayerApi.GetRotation(), independent if the player is grounded or not. Reproducing steps: Enter the sailing world in FBT and jump from the boat: Watch back to the boat and turn your head. The issue occours when you don't move. https://vrchat.com/home/launch?worldId=wrld_511d8efe-b233-4ffa-af92-846370aa0f47

If you're using full body tracking and then proceed to turn off all your trackers, your avatar of course falls back to three-point tracking. However, for locomotion animations to start working again (e.g. those provided by Gogo Loco or Gorone System), the avatar has to be reloaded. This in itself works fine, however the issue I am running into is that this avatar reload only seems to happen after some form of user interaction: say opening the quick menu on either controller. I might be remembering wrong, but I believe that before IK 2.0 this either used to be automatic, or that no reload used to be required for locomotion animations to start working again after turning off your trackers. I understand that with IK 2.0 the reload is necessary, but it would be great if this reload were to happen automatically. My use case for this is that I develop an external tool that turns off motion trackers and falls back to controling locomotion animations over OSC when users fall asleep. Because users who are asleep cannot provide the necessary user input to trigger the avatar reload, there is no way for them to transition between FBT and locomotion animations. Alternatively, getting the ability to trigger an avatar reload over OSC would be a possible workaround.

NetworkIK does a good job of smoothing out a lot of the jittery motion and vibrations resulting from fast and sudden movements affecting your HMD, controllers and vive/tundra trackers for others. However, this is still quite jarring for the user locally. When using mirrors or stream cameras, particularaly for recording videos or streaming live content, this often creates a poor and distracting experience. I propose that a form of user-controlled local smoothing is implemented, perhaps through the quick menu, where the user can decide how little or how much smoothing (or interpolation) is applied to their local tracking experience. The minimum value could be what it is today, and the maximum could be the same amount of update rate that is applied for NetworkIK. I can see this being extremely beneficial for dancers in particular. This could even be a more complete version of an already existing suggestion for hands https://feedback.vrchat.com/feature-requests/p/motion-smoothing-option-for-hands-accessibility

If someone doesn't want to calibrate with their arms sticking all the way out, they can click a setting to toggle calibrating with their avatar in an A shaped pose. I see this being helpful for people who can't get a good calibration with their arms all the way out for whatever reason. Also, the more features we can integrate, the more people will stop using mods.

Issue Hands in VR are not properly aligned with your hands in real live when holding the controllers. The Palm of the hand can not properly touch the controller as it does in real life. With the new Wrist Angle Offset function it makes it seem as though the controller is floating in front of your hands, but not directly touching them. See Pictures below for further clarification. Suggestion Give the players the ability to offset the hands on the Z and X axes. Because the hands are symmetrical only 2 additional sliders are needed in the menu, meaning 1 slider per axis modifying both hands at the same time. (The same way it currently works with the wrist angle slider.)

This is motivated by @Kung's request in this post: https://feedback.vrchat.com/vrchat-ik-20/p/in-lock-both-mode-spine-scrunching-pathologically-overbends-the-neck In general, it seems that there's a bunch of cases where one-solution-fits-all would leave at least some people disappointed with the default behaviour of IK and no option to change it outside of [redacted]. As such, it seems sensible to provide more in-depth IK options that would allow users to fine-tune it for their own preferences and avatars. Naturally, it won't hurt to clearly mark these in-depth options as "advanced" and maybe collapsed by default so that average users won't be spooked by a huge array of variety - that and defaults that work well for most users will likely be sufficiently user-friendly. One important aspect here is in-game availability. Given that these options concern IK, having to edit a config file (and maybe even restart the game) just to see their effect would be incredibly bad for usability. On top of that, this same approach can be used during open beta to let users try out different approaches and solutions and gather feedback on what works and what doesn't. Options that produce split feedback would indicate that keeping it as an actual option for release might be beneficial, as people have different preferences on that specific thing. Additional discussions and ideas on this topic can be found in comments here: https://feedback.vrchat.com/vrchat-ik-20/p/chest-trackers

The HP Reverb G2, as well as possibly any Mixed reality headset, and other non-touch sensor tracked controllers, is having a major issue with the new system. Unless a gesture is being made, the avatar defaults to hand-open. Originally the controllers could only perform gestures via button press, including using (tilting/pressing) the joysticks for the thumb tracking. The new update changes it to the buttons (ABXY) which causes issues since these buttons have functions already including mute, menu, and jump. It also changes it so that while not using any buttons, the tracking defaults to hand open. It was annoying before to perform gestures, but being stuck in hand-open mode requires me to press these buttons to use rest mode. I've attempted turning off all items related to this update, using legacy tracking, and changing all the IK 2.0 features to off, nothing fixes it. I dont want to be stuck doing the hand open gesture while i play the game. The whole point of the resting pose is for when I am not using any buttons.

Now that so many trackers are supported, and all combinations are supported as well, SteamVR tracker roles should be respected when they're set. This would apply on top of the calibration range and help avoid issues like an elbow tracker mapping to the chest. As well, the Disabled role should apply, so a tracker could still be within the calibration range but unused by VRChat. I can't think of a use right now, but Im sure there's some.

Can we please PLEASE get a higher refresh rate for OSC parameters, right now it is so so so bad on network and facial tracking looks horrendous. https://www.youtube.com/watch?v=ueZVd4xEm-c