Sounds like you want to use an animation library like GSAP in order to animate between the current and initial state of your camera. There are few existing topics about using GSAP in combination with OrbitControls. The following fiddle shows how camera and controls properties can be animated with GSAP. You can use this as a basis for your own animations.
Thank you Mugen, a second time for making me discover about this library I made it work for my camera.position and .rotation, althought it makes the camera flying to the initial pos./rot. rather than '“dollying” back to it.