Aesthetics Quality Assessment

Personalized Image Aesthetics Assessment via Meta-Learning With Bilevel Gradient Optimization

Guiguang Ding, Sicheng Zhao, Jinjian Wu, Leida Li, Hancheng Zhu, Guangming Shi•Wed Jun 10 2020

Typical image aesthetics assessment (IAA) is modeled for the generic aesthetics perceived by an “average” user. However, such generic aesthetics models neglect the fact that users’ aesthetic preferences vary significantly depending on their unique preferences. Therefore, it is essential to tackle the issue for personalized IAA (PIAA). Since PIAA is a typical small sample learning (SSL) problem, existing PIAA models are usually built by fine-tuning the well-established generic IAA (GIAA) models, which are regarded as prior knowledge. Nevertheless, this kind of prior knowledge based on “average aesthetics” fails to incarnate the aesthetic diversity of different people. In order to learn the shared prior knowledge when different people judge aesthetics, that is, learn how people judge image aesthetics, we propose a PIAA method based on meta-learning with bilevel gradient optimization (BLG-PIAA), which is trained using individual aesthetic data directly and generalizes to unknown users quickly. The proposed approach consists of two phases: 1) meta-training and 2) meta-testing. In meta-training, the aesthetics assessment of each user is regarded as a task, and the training set of each task is divided into two sets: 1) support set and 2) query set. Unlike traditional methods that train a GIAA model based on average aesthetics, we train an aesthetic meta-learner model by bilevel gradient updating from the support set to the query set using many users’ PIAA tasks. In meta-testing, the aesthetic meta-learner model is fine-tuned using a small amount of aesthetic data of a target user to obtain the PIAA model. The experimental results show that the proposed method outperforms the state-of-the-art PIAA metrics, and the learned prior model of BLG-PIAA can be quickly adapted to unseen PIAA tasks.

72 0

Paper Graph

Aesthetics Quality Assessment | State-of-the-Art

Aesthetics Quality Assessment

Benchmarks

Libraries

Datasets

Subtasks

Most implemented papers

Photo Aesthetics Ranking Network with Attributes and Content Adaptation

Content

NIMA: Neural Image Assessment

Attention-based Multi-Patch Aggregation for Image Aesthetic Assessment

Personalized Image Aesthetics Assessment via Meta-Learning With Bilevel Gradient Optimization

Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regression

Effective Aesthetics Prediction With Multi-Level Spatially Pooled Features

Image Composition Assessment with Saliency-augmented Multi-pattern Pooling

OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression

Understanding Aesthetics with Language: A Photo Critique Dataset for Aesthetic Assessment

Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels