CV VTuber Example

Works with Unity Cloud Build

iOS & Android support

Windows10 UWP support

WebGL support

Win & Mac & Linux Standalone support

Preview support in the Editor

This asset requires “OpenCV for Unity” and “Dlib FaceLandmark Detector”.

Official Site | ExampleCode | Android Demo WebGL Demo

Features:

- CVVTuberExample(Computer Vision Virtual YouTuber Example) is an example project of controlling 3D humanoid model (Mecanim Humanoid, "Unity-chan!" Model, VRM Model, Live2DCubism4 Model) using WebCamTexture. You can control the head orientation and the facial expression of the 3D humanoid model using WebCamTexture only.

- The head orientation and face expression are controlled by the following procedure.

1. WebCamTextureMatSourceGetter - Convert WebCamTexture to OpenCV's Mat class.

2. DlibFaceLandmarkGetter - Detect a face landmark points from OpenCV's Mat class.

3. DlibHeadRotationGetter - Estimate head orientation from face landmark points.

4. HeadRotationController - Control the head orientation of the 3D model using the estimated head orientation.

5. HeadLookAtIKController - Set Animator.SetLookAtPosition() method using the estimated head orientation.

6. DlibFaceBlendShapeController - Control the face BlendShape of the 3D model using the face landmark point.

Basic Examples:

- WebCamTexture CV VTuber Example

- VideoCapture CV VTuber Example

Advanced Examples: (require add-ons setup)

- UnityChan CV VTuber Example

- VRM CV VTuber Example

- Live2DCubism4 CV VTuber Example

The SDK and model data are not included in the asset package.

System Requirements

Build Win Standalone & Preview Editor : Windows 8 or later

Build Mac Standalone & Preview Editor : OSX 10.9 or later