In the example with THREE.OrbitControls(), controls instantiated with var controls = new THREE.OrbitControls( camera, renderer.domElement );
Quote from the documentation:
All event listeners in the controls are added to that element, which passed in the second parameter. Here and here.
So, you need to add all your event listeners (for touch events and for mouse events) to renderer.domElement.
Actually, you can take a look into the source code of THREE.OrbitControls() and see how the things work