CreativeGAN: Editing Generative Adversarial Networks for Creative Design Synthesis (2021-03-10T00:00:00.000000Z)

TL;DR

An automated method, named CreativeGAN, is proposed that can create new bicycle designs with unique frames and handles, and generalize rare novelties to a broad set of designs, and demonstrates a way to rethink creative design synthesis and exploration.

Abstract

Modern machine learning techniques, such as deep neural networks, are transforming many disciplines ranging from image recognition to language understanding, by uncovering patterns in big data and making accurate predictions. They have also shown promising results for synthesizing new designs, which is crucial for creating products and enabling innovation. Generative models, including generative adversarial networks (GANs), have proven to be effective for design synthesis with applications ranging from product design to metamaterial design. These automated computational design methods can support human designers, who typically create designs by a time-consuming process of iteratively exploring ideas using experience and heuristics. However, there are still challenges remaining in automatically synthesizing ‘creative’ designs. GAN models, however, are not capable of generating unique designs, a key to innovation and a major gap in AI-based design automation applications. This paper proposes an automated method, named CreativeGAN, for generating novel designs. It does so by identifying components that make a design unique and modifying a GAN model such that it becomes more likely to generate designs with identified unique components. The method combines state-of-art novelty detection, segmentation, novelty localization, rewriting, and generative models for creative design synthesis. Using a dataset of bicycle designs, we demonstrate that the method can create new bicycle designs with unique frames and handles, and generalize rare novelties to a broad set of designs. Our automated method requires no human intervention and demonstrates a way to rethink creative design synthesis and exploration. For details and code used in this paper please refer to http://decode.mit.edu/projects/creativegan/.

References37 items

Generative Adversarial Networks

BIKED: A Dataset and Machine Learning Benchmarks for Data-Driven Bicycle Design

PaDGAN: Learning to Generate High-Quality Novel Designs

MO-PaDGAN: Reparameterizing Engineering Designs for Augmented Multi-objective Optimization

Generative Design by Reinforcement Learning: Enhancing the Diversity of Topology Optimization Designs

Rewriting a Deep Generative Model

Conditional Generative Adversarial Network Framework for Airfoil Inverse Design

Training Generative Adversarial Networks with Limited Data

Integrating deep learning into CAD/CAE system: generative design and evaluation of 3D conceptual wheel

Sub-Image Anomaly Detection with Deep Pyramid Correspondences

Deep Nearest Neighbor Anomaly Detection

Development of a Conditional Generative Adversarial Network for Airfoil Shape Optimization

Analyzing and Improving the Image Quality of StyleGAN

A Survey on GANs for Anomaly Detection

Design creativity: refined method for novelty assessment

Deep Generative Design: Integration of Topology Optimization and Generative Models

A Style-Based Generator Architecture for Generative Adversarial Networks

GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training

Adversarially Learned One-Class Classifier for Novelty Detection

Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications

Efficient GAN-Based Anomaly Detection

Anomaly Detection with Robust Deep Autoencoders

CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Norms

VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning

Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery

Improved Techniques for Training GANs

Wide Residual Networks

Deep Residual Learning for Image Recognition

U-Net: Convolutional Networks for Biomedical Image Segmentation

Topology Optimization: "Theory, Methods, And Applications"

Assessing design creativity

Novelty detection: a review - part 1: statistical approaches

Metrics for measuring ideation effectiveness

Topology Optimization of Continuum Structures with Stress Constraints

Aerodynamic design optimization on unstructured grids with a continuous adjoint formulation

AUTO-ENCODING VARIATIONAL BAYES

We demonstrate that anomaly detection algorithm when applied at different granularities can identify unique designs and unique components within each design