Dead Reckoning Passive Entities

We have changed the cannon.js physics controlled characters and cars, where the car or character replicate the remote users position and orientation, but when i hit the character or car controlled by other users i pass right through it. How do we make the remote users to solid again?

url: #Threeviewer Virtual Experience