Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks
Published in
arXiv.org(2016)External Links:
TL
TL;DR
This paper introduces a novel concept to augment such generative architectures with semantic annotations, either by manually authoring pixel labels or using existing solutions for semantic segmentation, resulting in a content-aware generative algorithm that offers meaningful control over the outcome.
Abstract
Convolutional neural networks (CNNs) have proven highly effective at image synthesis and style transfer. For most users, however, using them as tools can be a challenging task due to their unpredictable behavior that goes against common intuitions. This paper introduces a novel concept to augment such generative architectures with semantic annotations, either by manually authoring pixel labels or using existing solutions for semantic segmentation. The result is a content-aware generative algorithm that offers meaningful control over the outcome. Thus, we increase the quality of images generated by avoiding common glitches, make the results look significantly more plausible, and extend the functional range of these algorithms---whether for portraits or landscapes, etc. Applications include semantic style transfer and turning doodles with few colors into masterful paintings!
References10 items
1
Exploring the Neural Algorithm of Artistic Style
2
A Survey of Semantic Segmentation
3
Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
4
Semantic portrait color transfer with internet images
5