Hey! If you are experiencing issues with VBridger, please join the Discord. We have bug report and help channels and threads collecting common issues that you can check, as well as a much more reactive community for helping solve new problems!
#VBridger
Sample models and mouth chart!
Files for
#VTubeStudio
and
#Live2D
are available on Drive!
The chart matches the YT Tutorial. Hopefully it helps!
(repost because I forgot to note some extra context on the chart initially)
Public BETA release!
WEBCAM (RTX only) and AUDIO Tracking Support!
* NVidia Tracking (Thank you Denchi!)
* Audio only tracking
* New (and improved) ARKit settings
-Requires opting into the beta from Steam
-Requires the VTS NVidia DLC to use NVidia tracking and RTX graphics
IMPORTANT ANNOUNCEMENT
VBridger will have a major update 𝗧𝗢𝗠𝗢𝗥𝗥𝗢𝗪, 𝗗𝗲𝗰𝗲𝗺𝗯𝗲𝗿 𝟮𝟲𝘁𝗵 at about 12pm PST!
We've taken care to not break anything as much as possible and we delayed the update to not risk anything on Christmas!
MediaPipe with the VBridger_VisemesARKit settings file loaded; it replaces mouth tracking with visemes when it detects that you're talking, and when you're not talking it uses the expression tracking.
This hybrid option works really well if your webcam can't capture your lipsync
Overview of the new features-
Inputs as Outputs
More logic for riggers
VMC Output (Face only at the moment, bones coming later!)
Output Modifiers; Smoothing and Stepped
WEBCAM support
Audio support
New defaults for new tracking options
Calibrate face tracking from VBridger!
IMPORTANT ANNOUNCEMENT
VBridger will have a major update 𝗧𝗢𝗠𝗢𝗥𝗥𝗢𝗪, 𝗗𝗲𝗰𝗲𝗺𝗯𝗲𝗿 𝟮𝟲𝘁𝗵 at about 12pm PST!
We've taken care to not break anything as much as possible and we delayed the update to not risk anything on Christmas!
Calling all
#ESL
#Live2D
Riggers!
What are the most important mouth shapes in your first language? Does VBridger work well, or does it miss some important sounds(and accompanying mouth shapes) commonly used in your language?
(Please include what your first language is!)
Model movement is now available in the newest update of VTS!
It's currently always turned on- the movement config in VTS doesn't effect it, and it uses HeadPosX/Y/Z as an input
If you have the editor you can turn it off but it will also effect params that use HeadPos at this time
We've made some comparisons between
#VtubeStudio
tracking and
#vbridger
tracking with our own models but we'd love to see more comparisons with a wider amount of models! If you're a magical person with two iPhones, check this thread!
Webcam will always be less accurate than iPhone tracking; and depends heavily on the type of webcam you have, where it's placed, what your lighting setup looks like, etc.
Some settings in VBridger can help with issues like the heavy jitter and blinks not fully closing etc.
We've made some comparisons between
#VtubeStudio
tracking and
#vbridger
tracking with our own models but we'd love to see more comparisons with a wider amount of models! If you're a magical person with two iPhones, check this thread!
If you are still experiencing issues with the new VBridger version; you can roll back the update by going to "Betas" in the steam properties and setting it to "prev_stable"
!!! OLD VERSIONS CANT LOAD FILES SAVED WITH THE NEW VERSION !!!
So if the new version was stinky;
There are a few more default save options that come with VBridger; if they mention ARKit they are built to work with models that have been rigged with the advanced VBridger mouth tracking parameters and probably won't work super well with regular VTS models
Cheek Puff
Eye Squint
As VBridger has gained popularity, more riggers have begun to rig for VBridger.
Many of them follow our official guides, however some do not.
For the best face tracking experience, please check what your rigger includes in their VBridger rigging!
Audio tracking greatly helps boost webcam tracking, it works with models that have been rigged with VBridger parameters as well!
We expect there to be bugs, so we're releasing these features earlier (they will be part of a larger update in the comings months)
All these parameters have been supported since the beginning of VBridger nearly two years ago and the settings are included with the app.
If your rigger doesn't provide a new vbridger settings file, it should be rigged by the VBridger standard to work correctly.
Be weary of riggers advertising expressions as vbridger;
VBridger is not designed to trigger "expressions" or emotes based on standard tracking, it is only designed to improve face tracking and lip sync.
expressions can be triggered with VBridger; however that would require
Hopefully we can catch anything too crazy before the full release!
If you'd like to report any bugs or have questions about the beta, please join the discord.
We'll do our best to keep up!
a unique settings file from your rigger every time
So!
If you are seeking VBridger, make sure to ask about what is included with their rigging and compare their work samples to other VBridger samples.
Just because they might say VBridger doesn't always mean they rig correctly
We are primarily English speakers- so all testing and rigging has been done in the English context. I'm curious if it works as well in other languages where different mouth shapes might be more common!
@ERRORCODIE
VBridger tracking is now possible with webcam (If you have RTX) as well as audio-only.
The audio works with advanced VBridger rigs that otherwise work with iphone tracking, making it possible to take advantage of more advanced rigging even without an iphone!
VBridger is live!
We expect some issues in the beginning to iron out as the testing group has been very tiny during development.
We look forward to seeing what you can do!
@akiradolcelatte
The latency is comparable to VTS tracking- Here's a sample recorded with both VTS and VBridger running at the same time (with different phones) The difference in head range is from using different phones (X vs XR)
Left is VTS, Right is VBridger
This uses the Live2D sample Hiyori
@__EyesOnFire__
Mediapipe is integrated in Vbridger, Nvidia tracking uses the VTS DLC; it's free but must be downloaded to work.
Mediapipe will work all by itself if the webcam is available.
OBS can try to yoink the webcam input if you open OBS first which can cause it not to register in VB
@RubyVoxx
make sure you hit the "VMC" button on the bottom right of VBridger; by default it's set to VTS
Then in Vseeface you'll need to enable VMC; keep in mind VBridger only works on the blendshapes of the face and doesn't send head rotation/body poses (yet)!
You can record a comparison by opening two Vtube Studio windows, and turning the API off on the second window. Connect one iPhone to Vtube Studio, and the other to VBridger!
Please include the VBridger's face in the video so we can compare the expressions to the 3D~
@veenaliciousVT
@CreativeMrPen
It's not as accurate but it uses ARKit; so it tries to do all the same things iPhone does it's just less accurate at them ;u;
People are feeling.
If it's happening with the VBridger update, we will find it (eventually), and if it's some other factor it can be identified and people can know what's happening.
@veenaliciousVT
@CreativeMrPen
To help with this we've created a tracking/audio mixed settings to help lip sync along where it would otherwise completely fail; there's not too much we can do given the wide variety of webcams and qualities of input, but it can be pretty solid!
@NaniRue
Iphone is still best girl, but webcam + audio or nvidia is a convincing alternative!
NVidia's mouth isn't super responsive when compared to iphone, but it's more accurate than regular webcam tracking.
@NamiraVT
@TheArtGun
@xserp
Are you using the ifacialmocap app?
If you are- does the bar turn green when you hit connect?
When opening VBridger for the first time, windows defender should have also ask you to allow access to the wifi- did you say yes?
@Misu_PurpleNeko
@CreativeMrPen
@veenaliciousVT
The settings I mentioned are additive, so VBridger simply adds to the mouth open parameter and shapes while it's picking up the visemes, if you are silent it uses regular tracked motion
And you didn't change your settings files with the new version, you should be able to roll back and compare.
If it fixes your issues, please let us know what was different between the current version and previous versions...
We are trying to get to the bottom of the difference
@NYMNESIS
@BlueSpaceElf
@AkiFae_
This issue usually happens for us when switching models in VTS; either disconnecting VBridger for a couple seconds and reconnecting it, restarting the VTS API, or restarting VBridger should correct it
@RubyVoxx
Vseeface only allows for one VMC receiver if I remember correctly so it can't be mixed with fullbody mocap in Vseeface/ other apps allow for it but they all work differently so I'd check their VMC documentation if they have it to see how to integrate VBridger VMC.
@Kleos_Den
iPad tracking is about the same as the iPhone!
Even iPads without faceID can work; I have an iPad Mini gen6 and even though it has no faceID it works with the tracking apps!
@hellfangz
Can you send us a DM with a comparison?
We've been hearing reports of this; however If you use the same settings file as you did previously there should be no difference, so we aren't sure where the issue is coming from and additional info could help.
@blaspyVT
If you use your old settings, the results should be the same😳
We added features and new defaults but if you're using the same tracker and same file it should be no different
@Grimfyre
It requires an RTX graphics card if you want to use the NVidia tracking!
The audio-based tracking works along with VTS's normal webcam tracking and uses vbridger parameters, but ofc it's audio based and doesn't express with you IRL.
@NamiraVT
@TheArtGun
@xserp
The visuals stop to save computer resources- but it should still be working in the background and sending information to VTS!
@zingybeams
It is not included with the settings you get from the default Steam download- with the editor you can create custom inputs for the nose sneers though!
@blaspyVT
If you have new issues; please consider joining the discord and posting samples!
We always want to solve any problems if things aren't working correctly~
@caninecaine
Unfortunately it only works with Android and iPhone!
We have no plans to implement webcam at this time as we don't think we can improve on it. Not saying never, but not currently planned.
@AtteraNox
It struggles with winking but isn't too shabby, it's also on top of my monitor so it doesn't pick up my mouth as well.
Lower angles are better for mouth capture~
@MarinaVT_
We don't have a port selection just yet but there was a hotfix which allows you to force VBridger to only connect to the VTS running on the same computer~
Check "LocalHost"
You may need to restart VBridger for it to take effect