Until recently, you could have a disabled collider component on or as a child of your pickup object and it would not be part of the outline. This was nice.
VRChat made an update that broke existing content.
Now, the disabled state of the collider component is no longer respected by VRChat. Instead, the gameObject's enabled/disabled state is the only thing VRChat looks at now.
If the object is enabled, all colliders on it are now part of the outline, regardless of the collider component's active state. This new outline is not only wrong, it also blocks the raycast in my setups now.
It seems VRChat forgot to also check the component's active state in their recent change.
(after picking up the book and opening it, then dropping it in the open state, there should be no giant pickup outline as seen in the attached image)