Can't play live streaming on iOS devices via VRCDN
yossy222
I have built the world for iOS and tried the MPEG-TS protocol and the fMP4 protocol, but could not play live streaming via VRCDN.
According to Apple's iOS specs, TS and fMP4 appear to be supported, and AV Pro's iOS support version was 12 or later, so I thought the platform requirements were met.
I contacted the VRCDN team and their view was that the VRCDN platform is implemented in accordance with the RFC, so whether or not it can play it depends on the iOS implementation of VRChat.
What would be a possible way to achieve live streaming playback of VRCDN on the iOS version of VRChat?
Environment in which it is being tested: iPhone 15 Pro Max, iOS 17.5.1, VRChat iOS 2024.2.3 (333)
Log In
Tundra_Wolf
Possibly useful data point for this: I hit the same wall with VRCDN on iOS, then stood up my own HLS relay (MediaMTX, H.264/AAC, HTTPS) in the hopes of getting something to work. Result: plain live HLS gets further than VRCDN's endpoints, the video actually plays on iOS, but the audio track is silently dropped, even though the identical stream plays with full audio in Safari on the same device and static H.264/AAC files play fine in-client. Tested both muxed MPEG-TS and fMP4 variants, same result.
So at least part of what's blocking VRCDN on iOS looks like it lives in the client's live-stream audio path, not just the transport formats. For event worlds, a plain HLS relay at least gets iOS viewers the video today, audio is the remaining gap, which is what this tracked report covers: https://feedback.vrchat.com/bug-reports/p/live-hls-streams-play-video-but-no-audio-on-ios-h264-aac-plays-correctly-in-safa
Glitch The Fox
It actually really upsets me that this isn't at least tracked as it's still an issue now, I've been pushing for many of the event worlds I work on to be iOS compatible, including VRelium's main festival venue, it's becoming tedious asking performers to keep their mic on so iOS users can at least hear them, and an issue for other users close to the stage hearing double.
I have welcomed many new users on iOS to VRChat recently and am regularly asked why the video isn't working no matter what they try.
Hackebein
Glitch The Fox https://wiki.vrchat.com/wiki/Video_players check out the support matrix