Apply Perspective using vanishing points

I have a background image (a room) and a foregraund image (a rug). Also i have 3 vanishing points for the room image. I want set the camera (or OrbitControls) x, y, z for rug spread on the floor. How i can do it?

my result for now:

my goal: