Advice for animating lips of 3D talking head

Hello, I am planning to build a 3D talking head with animated lips (i.e. lip sync) according to some user input. My idea is to find a model head on a website such as https://sketchfab.com/ and then customize it in blender. Once complete, I would export it in glTF format and then load into three.js. From there I could morph the vertices on the lips using morphTargetInfluences. Is this a reasonable approach? Is there a better way?

2 Likes

Using morph targets is definitely a valid approach for facial animations.

i still waiting for merged https://github.com/mrdoob/three.js/pull/17649 looks like more optimized solution for Morph targets with https://github.com/zeux/meshoptimizer

Hi @shane,
I am struggling to make lipsync by using Rhubarb lipsync library but, I am unable to create lipsync by the exported json. Can you please suggest something?