When Mouth & Jaw are set to "Animation" in the Animator Tracking Control, the avatar Visemes integer (even when the LipSync mode is set to "Viseme Parameter Only") does not update.
This was confusing as the docs mention that the parameters would still be sent (for things like material).