The ‘much faster time’ is because you are using slerp directly on sceneCamera, so you are changing the starting quaternion of the interpolation as you interpolate. Better to use the static version, i.e.
THREE.Quaternion.slerp( startQuaternion, endQuaternion, mesh.quaternion, t );