We'd like to be able to override the position and rotation (and ideally also the scale) of a remote player locally, for example to compensate for lag, without affecting their own local state.
Current issue: If I pick up a player with my hand locally using an Udon script, their movement relative to my hand will look correct on their side, but for me they will lack behind my hand with 2x ping latency. If I could override their position on my side, because I already know where they will move, I can use Udon to correct this.
Note: Udon should still be able to somehow get the "real" network position from them, not the locally changed one.
Another reason for this would be because my world wants to desync player positions, rotations or scales to allow cool new world concepts (like space stations etc). This can currently only be done using stations and we all know that this workaround is less than ideal and does not cover all use cases.