MIGS: Meta Image Generation from Scene Graphs
Published in
British Machine Vision Conference(2021)External Links:
TL
TL;DR
This work proposes MIGS (Meta Image Generation from Scene Graphs), a meta-learning based approach for few-shot image generation from graphs that enables adapting the model to different scenes and increases the image quality by training on diverse sets of tasks.
Abstract
Generation of images from scene graphs is a promising direction towards explicit scene generation and manipulation. However, the images generated from the scene graphs lack quality, which in part comes due to high difficulty and diversity in the data. We propose MIGS (Meta Image Generation from Scene Graphs), a meta-learning based approach for few-shot image generation from graphs that enables adapting the model to different scenes and increases the image quality by training on diverse sets of tasks. By sampling the data in a task-driven fashion, we train the generator using meta-learning on different sets of tasks that are categorized based on the scene attributes. Our results show that using this meta-learning approach for the generation of images from scene graphs achieves state-of-the-art performance in terms of image quality and capturing the semantic relationships in the scene. Project Website: https://migs2021.github.io/
References42 items
1
Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphs
2
Unconditional Scene Graph Generation
3
Training Generative Adversarial Networks with Limited Data
4
Learning To Classify Images Without Labels
5