I wanted to share a codesandbox that I did yesterday.
The effect is based on the camera’s off-axis projection. (here the article from which I took inspiration).
To make things a little more interactive I added cannon.js
It’s all done with react-three-fiber and use-cannon (sorry if you don’t use react )
This version in particular uses DeviceMotion to animate the projection. But there are those who are working to make it a desktop version and a version with facetracking