Towards Unsupervised Image Harmonisation

Dolhasz, Alan and Harvey, Carlo and Williams, Ian (2020) Towards Unsupervised Image Harmonisation. In: 15th International Conference on Computer Vision Theory and Applications, 27.02.2020-29.02.2020, Valetta, Malta.

VisAPP_Camera_Ready.pdf - Accepted Version

Download (7MB)


The field of image synthesis intrinsically relies on the process of image compositing. This process can be automatic or manual, and depends upon artistic intent. Compositing can introduce errors, due to human-detectable differences in the general pixel level transforms of component elements of an image composite. We report on a pilot study evaluating a proof-of-concept automatic image composite harmonisation system consisting of a state-of-the-art deep harmonisation model and a perceptually-based composite luminance artifact detector. We evaluate the performance of both systems on a large data-set of 68128 automatically generated image composites and find that without any task-specific adaptations, the end-to-end system achieves comparable results to the baseline harmoniser fed with ground truth composite masks. We discuss these findings in the context of extending this to an end-to-end, multi-task system.

Item Type: Conference or Workshop Item (Paper)
7 January 2020Accepted
28 February 2020Published Online
Uncontrolled Keywords: image compositing, harmonisation, artifact detection, end-to-end compositing, deep learning
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
CAH11 - computing > CAH11-01 - computing > CAH11-01-05 - artificial intelligence
Divisions: Faculty of Computing, Engineering and the Built Environment
Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Alan Dolhasz
Date Deposited: 01 Apr 2020 07:45
Last Modified: 22 Mar 2023 12:01

Actions (login required)

View Item View Item


In this section...