Blendshape Documentation

[ShadowMarker789]

I was trying to use XRAnimator for VMC export to a separate application (Inochi-Session) for VTubing

Only to find very few blendshapes being exported and made available.

Is this the full list? I was expecting, well, more. All the other values are various bones for the limbs of the body, none of which are relevant for sitting up close with the webcam focused on the face.

That, and the names of these blendshapes are very... minimalistic. And some of them never seem to change values at all.

angry and lookUp, lookDown, lookLeft, lookRight are always 0 and never change values.

For reference, I was expecting names like the following:

Unified	ARKit
EyeLookUpRight	eyeLookUpRight
EyeLookDownRight	eyeLookDownRight
EyeLookInRight	eyeLookInRight
EyeLookOutRight	eyeLookOutRight
EyeLookUpLeft	eyeLookUpLeft
EyeLookDownLeft	eyeLookDownLeft
EyeLookInLeft	eyeLookInLeft
EyeLookOutLeft	eyeLookOutLeft
EyeClosedRight	eyeBlinkRight
EyeClosedLeft	eyeBlinkLeft
EyeSquintRight	eyeSquintRight
EyeSquintLeft	eyeSquintLeft
EyeWideRight	eyeWideRight
EyeWideLeft	eyeWideLeft
BrowDownRight	browDownRight
BrowDownLeft	browDownLeft
BrowInnerUp	browInnerUp
BrowOuterUpRight	browOuterUpRight
BrowOuterUpLeft	browOuterUpLeft
NoseSneerRight	noseSneerRight
NoseSneerLeft	noseSneerLeft
CheekSquintRight	cheekSquintRight
CheekSquintLeft	cheekSquintLeft
CheekPuff	cheekPuff
JawOpen	jawOpen
MouthClosed	mouthClose
JawRight	jawRight
JawLeft	jawLeft
JawForward	jawForward
LipSuckUpper	mouthRollUpper
LipSuckLower	mouthRollLower
LipFunnel	mouthFunnel
LipPucker	mouthPucker
MouthUpperUpRight	mouthUpperUpRight
MouthUpperUpLeft	mouthUpperUpLeft
MouthLowerDownRight	mouthLowerDownRight
MouthLowerDownLeft	mouthLowerDownLeft
MouthSmileRight	mouthSmileRight
MouthSmileLeft	mouthSmileLeft
MouthFrownRight	mouthFrownRight
MouthFrownLeft	mouthFrownLeft
MouthStretchRight	mouthStretchRight
MouthStretchLeft	mouthStretchLeft
MouthDimpleRight	mouthDimpleRight
MouthDimpleLeft	mouthDimpleLeft
MouthRaiserUpper	mouthShrugUpper
MouthRaiserLower	mouthShrugLower
MouthPressRight	mouthPressRight
MouthPressLeft	mouthPressLeft
TongueOut	tongueOut

Is there any documentation about what blendshapes are expected to be exported for use when XR Animator is set to capture upper-body or face?

[ButzYung]

The blendshapes exported via VMC depend on the VRM model used. If you want XR Animator to export ARKit blendshapes, you need to use a VRM model that supports ARKit.

[ShadowMarker789]

Okay, interesting - I had genuinely not expected to need to supply a specific style of model in order to get blendshapes out for using the software solely for tracking and blendshape emission...

Is there really no way to get ARKit-style blendshape output via VMC without supplying a custom VRM model that supports ARKit?

[ButzYung]

Some VRM models have their own unique blendshapes. Not every VRM model support ARKit blendshapes, and even if it does, the names can be different from the default. Besides, XR Animator adjust blendshape values differently depending on whether the model supports ARKit or not. The only way to ensure compatibility is to only send supported blendshapes.

Ther are free VRM models out there that support ARKit blendshapes, if you can't provide your own.

[ShadowMarker789]

Okay, I now have it working and outputting blendshapes that look right.

I downloaded a sample VRM Model to get it to export ARKit blendshapes.

I was expecting a way to specify which type/kinds of blendshapes to output, it feels like a very strange workflow to have to download an external model file to get blendshape output via VMC, but I can confirm that it is working at least.

[Edit: Many thanks for your help and patience!]