I know OSC is slated to come out but is/will it be possible to grab a set of colors from a livestream/video feed in udon in the near future to toggle a local trigger?

Say if I devote a corner of the video stream to a trigger by putting a logo or color deprived tiny image into it.. then trigger a colore square (in the livestream) to trigger a world event for everyone locally... that would be a great means of synchronizing a world show element for people across multiple instances.

That way on top of the main world it's instances can locally trigger a pre-uploaded show (build into the world) in sync for every single person (to the designed audio) so people can enjoy a pre-made show in instanced groups to spread out the user load over instances.

Multiple color triggers can also make up for people who crash mid show or join a session a bit later then the start of such a show run.

In the industry we use something called timecode that is panned on a side of an audio track which contains continous timing information but that means people watching the regular livestream would hear a very loud/obnoxious beeping sound.

Summerized technically: I want a color range to be readable from a specific part of the UV from a video stream and plug it into a Udon node. (thanks roll).

This is also safe because there isn't much tampering you can do.. put the trigger capability on a heavy cooldown.