Maybe there are several ways to do this, including disabling the controls, unhooking its event listeners and/or stop using its update method. Personally, I like the way of forcing the camera of the OrbitControls to go to specific angles by juggling with their max and min values. Try it here:
https://codepen.io/boytchev/full/BaGppmJ
