Matching the CGI to the Pup-Up

None of the angles on the CGI model that blends with the real image are really straight because the angle of the building is not 90 degrees the sidewalk is not straight, and the exact position of the camera is not known. The model was made to match the flat image perfectly while aproximating the actual dimensions as closely as possible. The resulting model, cannot be made into a pop up book. To compensate, I am working on another model with 90 degree angles that functions as a pop-up which I am making a blend shape to transition to the photo-based model. Matching the UV maps on the skewed model photo model to the straight model is tough because the geometry that folds is straight with regular UV maps, but the photo-match UVs are all warped to match the camera's perspective.

Here the angle of the photo-match polygon (in amber) was warped to match the perspective of the camera, attempting to match the outline with the polygon shape that folds best (in light blue) yields problems matching UVs. This paticulat flap has been very very troublesome.