CCLAP: Controllable Chinese Landscape Painting Generation Via Latent Diffusion Model
TL
TL;DR
A controllable Chinese landscape painting generation method named CCLAP, which can generate painting with specific content and style based on Latent Diffusion Model, which achieves state-of-the-art performance, especially in artfully-composed and artistic conception.
Abstract
With the development of deep generative models, recent years have seen great success of Chinese landscape painting generation. However, few works focus on controllable Chinese landscape painting generation due to the lack of data and limited modeling capabilities. In this work, we propose a controllable Chinese landscape painting generation method named CCLAP, which can generate painting with specific content and style based on Latent Diffusion Model. Specifically, it consists of two cascaded modules, i.e., content generator and style aggregator. The content generator module guarantees the content of generated paintings specific to the input text. While the style aggregator module is to generate paintings of a style corresponding to a reference image. Moreover, a new dataset of Chinese landscape paintings named CLAP is collected for comprehensive evaluation. Both the qualitative and quantitative results demonstrate that our method achieves state-of-the-art performance, especially in artfully-composed and artistic conception. Codes are available at https://github.com/Robin-WZQ/CCLAP.
References27 items
1
Enhanced Super-Resolution Generative Adversarial Networks (ESRGAN) on Melanoma Skin Cancer Detection
2
LAION-5B: An open large-scale dataset for training next generation image-text models
3
GlueGAN: Gluing Two Images as a Panorama with Adversarial Learning
4
Learning to Generate Poetic Chinese Landscape Painting with Calligraphy
5