You can move the camera independently, according to the position change of the object:
const cameraOffset = new Vector3(0.0, 5.0, -5.0); // NOTE Constant offset between the camera and the target
// NOTE Assuming the camera is direct child of the Scene
const objectPosition = new Vector3();
object.getWorldPosition(objectPosition);
camera.position.copy(objectPosition).add(cameraOffset);
Even easier, you can just use position change of the object to move the camera: