Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? (2019-04-05T00:00:00.000000Z)

TL;DR

This work proposes an efficient algorithm to embed a given image into the latent space of StyleGAN, which enables semantic image editing operations that can be applied to existing photographs.

Abstract

We propose an efficient algorithm to embed a given image into the latent space of StyleGAN. This embedding enables semantic image editing operations that can be applied to existing photographs. Taking the StyleGAN trained on the FFHD dataset as an example, we show results for image morphing, style transfer, and expression transfer. Studying the results of the embedding algorithm provides valuable insights into the structure of the StyleGAN latent space. We propose a set of experiments to test what class of images can be embedded, how they are embedded, what latent space is suitable for embedding, and if the embedding is semantically meaningful.

Authors

Peter Wonka

11 papers

Yipeng Qin

2 papers

Rameen Abdal

1 papers

TL;DR

Abstract

Authors

References40 items

Semantic Image Synthesis With Spatially-Adaptive Normalization

Face Recognition Systems Under Morphing Attacks: A Survey

Latent Filter Scaling for Multimodal Unsupervised Image-To-Image Translation

A Style-Based Generator Architecture for Generative Adversarial Networks

Large Scale GAN Training for High Fidelity Natural Image Synthesis

High Quality Facial Surface and Texture Synthesis via Generative Adversarial Networks

Spectral Normalization for Generative Adversarial Networks

Feature-Based Metrics for Exploring the Latent Space of Generative Models

Toward Multimodal Image-to-Image Translation

Progressive Growing of GANs for Improved Quality, Stability, and Variation

Detection of Face Morphing Attacks by Deep Learning

MoCoGAN: Decomposing Motion and Content for Video Generation

Wasserstein Generative Adversarial Networks

Perceptual Generative Adversarial Networks for Small Object Detection

TextureGAN: Controlling Deep Image Synthesis with Texture Patches

Improved Training of Wasserstein GANs

Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks

Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization

Image-to-Image Translation with Conditional Adversarial Networks

Inverting the Generator of a Generative Adversarial Network

Least Squares Generative Adversarial Networks

Generative Visual Manipulation on the Natural Image Manifold

Generating Videos with Scene Dynamics

Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks

Perceptual Losses for Real-Time Style Transfer and Super-Resolution

Generating Images with Perceptual Similarity Metrics based on Deep Networks

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

Very deep convolutional neural network based image classification using small training sample size

A Neural Algorithm of Artistic Style

Texture Synthesis Using Convolutional Neural Networks

Auto-Encoding Variational Bayes

Using face morphing to protect privacy

ImageNet classification with deep convolutional neural networks

Face morphing using 3D-aware appearance optimization

Morphing techniques for manipulating face images

Image morphing: a survey

GENERATIVE ADVERSARIAL NETS

3D human face reconstruction using principal components spaces

3D human face reconstruction using principal components spaces

Stylegan -official tensorflow implementation

Field of Study

Journal Information

Name

Page

Venue Information

Name

Type

URL

Alternate Names