TLDR; if an AudioClip on avatar is set to "Decompress On Load" which doesn't have "Load In Background" enabled (Which at least from my experience is literally how Unity imports AudioClips) - the avatar goes through the build process just fine, but then gives out an error "Avatar Validation Failed".

It's really just annoying and has no place making creators play a guessing game.