In case of Orthographic camera, How we can implement Pan operation similar to standard navigation

For Orthographic camera, While doing the pan we would like to keep the same model point under the mouse as we move.

e.g. panning the map by dragging the mouse should keep the same point under the cursor as the map moves.

Can anyone share the code? Default Orbit Control is not working like this. Model point under mouse moves far as we move the mouse.