Image Composition Assessment with Saliency-augmented Multi-pattern Pooling
Published in
British Machine Vision Conference(2021)External Links:
TL
TL;DR
A composition assessment network SAMP-Net with a novel Saliency-Augmented Multi-pattern Pooling (SAMP) module, which analyses visual layout from the perspectives of multiple composition patterns, and can perform more favorably than previous aesthetic assessment approaches.
Abstract
Image composition assessment is crucial in aesthetic assessment, which aims to assess the overall composition quality of a given image. However, to the best of our knowledge, there is neither dataset nor method specifically proposed for this task. In this paper, we contribute the first composition assessment dataset CADB with composition scores for each image provided by multiple professional raters. Besides, we propose a composition assessment network SAMP-Net with a novel Saliency-Augmented Multi-pattern Pooling (SAMP) module, which analyses visual layout from the perspectives of multiple composition patterns. We also leverage composition-relevant attributes to further boost the performance, and extend Earth Mover's Distance (EMD) loss to weighted EMD loss to eliminate the content bias. The experimental results show that our SAMP-Net can perform more favorably than previous aesthetic assessment approaches.
References68 items
1
Camera View Adjustment Prediction for Improving Image Composition
2
Perceptual Quality Assessment of Smartphone Photography
3
Adaptive Fractional Dilated Convolution Network for Image Aesthetics Assessment
4
Personality-Assisted Multi-Task Learning for Generic and Personalized Image Aesthetics Assessment
5