Player Voice variables for Udon (e.g. isTalking, loudness, viseme)
tracked
DrBlackRat
Issue:
Currently it's not possible to react to a players voice at all. We don't know when someone is talking or how loud they are for example. This limits us from making games where someone needs to be quiet to hide from an enemy for example.
For security reasons it makes sense that we can't just listen to a player voice, which is why I think only giving limited access to it would be fine.
Suggestion:
Add an
isTalking
bool to the VRC Player API which is true when voice is detected and false when not.Add a
loudness
float to the VRC Player API which is a value between 0 and 1 depending on how loud a player is. (Basically how the current Voice parameter works on Avatars)Add a
viseme
integer to the VRC Player API which would indicate what viseme is currently used. (Basically how the current Viseme parameter works on Avatars)These would allow world creators to integrate player voice into game play while also not just directly giving them access to player voices for security.
Log In
UnusualTune
I want this for slashco vr so badly
AladorWolf
Looks like till it's added I'll just put the little chase AI I'm making on hold. I need to be able to detect just the moment a player starts talking to log the coordinates on the navmesh and attempt to go there. If it sees nobody, it is supposed to look around and then wander again. There will be safe places that you can hide and talk in so it's important to my game to make plans with your team before leaving these areas
Fax
Merged in a post:
Need Voice Recognition
숲울림_
Voice recognition is required.
Rather than recognizing what the player is saying, I wish there was a function that could tell us whether the player is talking or not.
If we have this function, we will be able to do more things in future map production.
vavassor
Visemes could be fun for something like a singing or karaoke game. Or a puppet or possession mechanic, where a character mimics the player's speech.
This post was marked as
tracked
Fax
Merged in a post:
World Sdk accessing some Avatar Sdk variables
_Chronic_
For a long time I've been desiring a process that allows me to get the variable within debug which shows a float value for visemes. I had hoped to make horror based Udon mechanics centered around player's voice volume. Would it be possible to add this to VRCplayerApi?
Scena
I really do hope this is added in the future, it's already possible on avatars, but even just to get a loudness float from use in worlds, would already be a huge advantage.
M
Mantibro
I've always wanted to have this feature in my new horror game, for the killer to be able to hear player's voices. I was VERY disappointed when it was not an option to me.
Widget365
This could have so many fun use cases! This would be incredibly helpful in my latest project Neoworlds, right now its very confusing at a given time who's talking when you can't see the default vrc nametags.
Fax
Merged in a post:
Expose voice volume to Udon
Jar
For a game world idea I'm working on, it would be useful to know whether another player is talking. You know how you can select a player, and see the amplitude of their voice going up and down, on the slider that lets you control a player's voice? (For the local player, there seems to be a similar bar that goes up and down underneath your microphone volume slider.) Perhaps this is the same value that makes their name tag light up? I would love if that percentage could be exposed to Udon. Perhaps something like "VRCPlayerApi.GetVoiceAmplitude()" and it returns a float.
In tandem with this, it would be nice if you could get the microphone mute state (bool) for the local player.
I can see this being useful and fun!
-You could have a prop in the world animate with your voice chat volume (that would be pretty fun)
-Have player names light up on Udon-based scoreboards or spectator screens when they are talking
-Games where NPC enemies can react to people communicating nearby (stealth game)
-Reminding you to unmute yourself in activities that have a microphone/stage/speaking role
Thanks for your consideration!
Load More
→