Interactive ThreeJs model with webcam processed by TensorflowJS + source code

Huia is an extinct and rare bird originally from New Zealand and also the name of our tech + design studio . We gave digital live to a Huia by rendering it in ThreeJS and made it interactive by processing the webcam images in real time to extract the skeleton with PoseNet and detect the user pose with a custom trained neural network.

See it in action:
huia_1

5 Likes

More than the bird, I love the effects :slight_smile:

Particles, post process, smooth wireframe overlay - looks amazing. Great job!

4 Likes

Many dependent installation packages have become invalid and cannot be installed and run. Can you update the dependencies?