Image Composition with Depth Registration

Image Composition with Depth Registration

Zan Li, Wencheng Wang, Fei Hou

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence
Main Track. Pages 1134-1141. https://doi.org/10.24963/ijcai.2023/126

Handling occlusions is still a challenging problem for image composition. It always requires the source contents to be completely in front of the target contents or needs manual interventions to adjust occlusions, which is very tedious. Though several methods have suggested exploiting priors or learning techniques for promoting occlusion determination, their potentials are much limited. This paper addresses the challenge by presenting a depth registration method for merging the source contents seamlessly into the 3D space that the target image represents. Thus, the occlusions between the source contents and target contents can be conveniently handled through pixel-wise depth comparisons, allowing the user to more efficiently focus on the designs for image composition. Experimental results show that we can conveniently handle occlusions in image composition and improve efficiency by about 4 times compared to Photoshop.
Keywords:
Computer Vision: CV: Scene analysis and understanding   
Multidisciplinary Topics and Applications: MDA: Arts and creativity