Hi @henrisja,
I believe this is exactly what you’re looking for. I made a detailed post about the concept. The goal is to make gltf object interactivity with the mouse as easy as a any other html element, simply with events.
Please have a look at this post and let me know if you have any question: