Machine Learning for Synthetic Data Generation: a Review (2023-02-08T00:00:00.000000Z)

TL;DR

A comprehensive systematic review of existing studies that employ machine learning models for the purpose of generating synthetic data, which explores different machine learning methods, with particular emphasis on neural network architectures and deep generative models.

Abstract

Machine learning heavily relies on data, but real-world applications often encounter various data-related issues. These include data of poor quality, insufficient data points leading to under-fitting of machine learning models, and difficulties in data access due to concerns surrounding privacy, safety, and regulations. In light of these challenges, the concept of synthetic data generation emerges as a promising alternative that allows for data sharing and utilization in ways that real-world data cannot facilitate. This paper presents a comprehensive systematic review of existing studies that employ machine learning models for the purpose of generating synthetic data. The review encompasses various perspectives, starting with the applications of synthetic data generation, spanning computer vision, speech, natural language processing, healthcare, and business domains. Additionally, it explores different machine learning methods, with particular emphasis on neural network architectures and deep generative models. The paper also addresses the crucial aspects of privacy and fairness concerns related to synthetic data generation. Furthermore, this study identifies the challenges and opportunities prevalent in this emerging field, shedding light on the potential avenues for future research. By delving into the intricacies of synthetic data generation, this paper aims to contribute to the advancement of knowledge and inspire further exploration in synthetic data generation.

Authors

Ying-Cheng Lu

1 papers

Huazheng Wang

1 papers

Wenqi Wei

2 papers

TL;DR

Abstract

Authors

References275 items

Differentially Private Fine-Tuning of Diffusion Models

DDN3.0: determining significant rewiring of biological network structure with differential dependency networks

Uncovering LLM-Generated Code: A Zero-Shot Synthetic Code Detector via Code Rewriting

TWIN-GPT: Digital Twins for Clinical Trials via Large Language Model

DP-RDM: Adapting Diffusion Models to Private Domains Without Fine-Tuning

Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction

Trustworthy Distributed AI Systems: Robustness, Privacy, and Governance

Synthetic data

Synthesizing differentially private location traces including co-locations

ABDS: tool suite for analyzing biologically diverse samples

Differentially Private Latent Diffusion Models

Post-processing Private Synthetic Data for Improving Utility on Selected Measures

Meta-hallucinator: Towards Few-Shot Cross-Modality Cardiac Image Segmentation

Boundary crossing: an experimental study of individual perceptions toward AIGC

A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT

LDPTrace: Locally Differentially Private Trajectory Synthesis

Extracting Training Data from Diffusion Models

Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models

Reinforced Genetic Algorithm for Structure-based Drug Design

Stutter-TTS: Controlled Synthesis and Improved Recognition of Stuttered Speech

Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe

Cosbin: cosine score-based iterative normalization of biologically diverse samples

Differentially Private Diffusion Models

Malicious Repositories Detection with Adversarial Heterogeneous Graph Contrastive Learning

Deep Generative Models for Fast Photon Shower Simulation in ATLAS

SynBench: Task-Agnostic Benchmarking of Pretrained Representations using Synthetic Data

PrivTrace: Differentially Private Trajectory Synthesis by Adaptive Markov Model

Artificial intelligence foundation for therapeutic science

DPView: Differentially Private Data Synthesis Through Domain Size Information

Rep2Vec: Repository Embedding via Heterogeneous Graph Adversarial Contrastive Learning

Disentangled Dynamic Heterogeneous Graph Learning for Opioid Overdose Prediction

SIPF: Sampling Method for Inverse Protein Folding

Antibody Complementarity Determining Regions (CDRs) design using Constrained Energy Model

A Multifaceted benchmarking of synthetic electronic health record generation models

Privacy-Preserving Synthetic Data Generation for Recommendation Systems

ACT-NET: Asymmetric Co-Teacher Network for Semi-Supervised Memory-Efficient Medical Image Segmentation

DPGEN: Differentially Private Generative Energy-Guided Network for Natural Image Synthesis

The generation of synthetic data for risk modelling

COT: an efficient and accurate method for detecting marker genes among many subtypes

GeoPointGAN: Synthetic Spatial Data with Local Label Differential Privacy

A Methodology for Controlling Bias and Fairness in Synthetic Data Generation

Video Diffusion Models

MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Design

MT-UDA: Towards Unsupervised Cross-modality Medical Image Segmentation with Limited Source Labels

GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generation

Interpretable Molecular Graph Generation via Monotonic Constraints

Deduplicating Training Data Mitigates Privacy Risks in Language Models

Competition-level code generation with AlphaCode

AIM: An Adaptive and Iterative Mechanism for Differentially Private Synthetic Data

Synthetic Data Generation with Differential Privacy via Bayesian Networks

Generative Adversarial Networks

Ethical and social risks of harm from Language Models

Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergence

DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networks

Differentially Private Fine-tuning of Language Models

When do GANs replicate? On the choice of dataset size

Fake it till you make it: face analysis in the wild using synthetic data alone

Robin Hood and Matthew Effects: Differential Privacy Has Disparate Impact on Synthetic Data

Differentiable Scaffolding Tree for Molecular Optimization

The Problem of Fairness in Synthetic Healthcare Data

Comparative assessment and novel strategy on methods for imputing proteomics data

Adapting Meta Knowledge with Heterogeneous Information Network for COVID-19 Themed Malicious Repository Detection

Exploring city digital twins as policy tools: A task-based approach to generating synthetic data on urban mobility

Data Synthesis via Differentially Private Markov Random Field

Real-World Trajectory Sharing with Local Differential Privacy

RyanSpeech: A Corpus for Conversational Text-to-Speech Synthesis

An Analysis of the Deployment of Models Trained on Private Tabular Synthetic Data: Unexpected Surprises

SynthASR: Unlocking Synthetic Data for Speech Recognition

Hermite Polynomial Features for Private Data Generation

Exploring the application of synthetic audio in training keyword spotters

Synthetic data in machine learning for medicine and healthcare

Causally Constrained Data Synthesis for Private Data Release

Growing synthetic data through differentially-private vine copulas

Synthetic Data generation using DCGAN for improved traffic sign recognition

DDN2.0: R and Python packages for differential dependency network analysis of biological systems

Can You Fake It Until You Make It?: Impacts of Differentially Private Synthetic Data on Downstream Classification Fairness