Orbit Control changes angle when target is changing position

camera.position.add( player.position );
camera.lookAt( player.position );
orbitControls.update();

Hope this helps!
Source: Third person camera - #2 by PavelBoytchev