Report

Shape-Preserving Half-Projective Warps for Image Stitching Che-Han Chang1, Yoichi Sato2, Yung-Yu Chuang1 1National Taiwan University 2The University of Tokyo Image stitching 2 3 4 Geometric transformation 5 Projective transformation (Homography) 6 Projective warp 7 Image compositing 8 • Misalignment (overlapping regions) • Geometric distortion (non-overlapping regions) – Stretched shapes shape distortion – Non-uniform scaling area distortion Misalignment Projective Warp 9 • Misalignment (overlapping regions) • Geometric distortion (non-overlapping regions) – Stretched shapes shape distortion – Non-uniform scaling area distortion Distortion Projective Warp 10 Globally aligned Projective Warp Distortion Locally aligned As-Projective-AsPossible Warp Distortion 11 Key idea: Replacing it by a similarity transformation. (scaling, rotation, translation) As-Projective-As-Possible Warp 12 We propose shape-preserving half-projective warp, a spatial combination of a projective transformation and a similarity transformation. Source Similarity warp Projective warp 13 Projective warp Our warp APAP warp APAP + Our warp 14 Goal Given a projective transformation, construct a warp that gradually changes from projective to similarity. 15 Analysis H Scale up Scale down Linear mapping Construction + 16 Change of coordinates 17 As , area distortion H Scale up Scale down 18 H becomes linear if u is a constant H 19 H becomes linear if u is a constant H similarity transformation 20 H S 21 H S 22 C0 continuity C1 continuity 23 Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous. 24 Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous. Boundary constraints C1 continuity on l1 C1 C1 C1 continuity on l2 25 Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous. Boundary constraints C1 continuity on l1 C1 continuity on l2 26 Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous. Boundary constraints C1 continuity on l1 C1 continuity on l2 27 Two-view stitching 28 Two-view stitching Projective warp Our warp 29 Parameters Given H, l1 and l2, determine S and T such that the total warp is C1 continuous. 30 Optimizing parameters We want that each image undergoes a similarity transformation as much as possible. 31 Multiple image stitching 32 Combining with the APAP warp Our warp Projective Refined warp APAP Refined warp Combined warp 33 Results Original Projective warp AutoStitch Our warp 34 Results Projective warp AutoStitch Our warp 35 Conclusion • A novel parametric warp for image stitching • Parameter selection could be improved Similarity warp Projective warp 36 Thank you! Any questions? 37