Content Authentication for Neural Imaging Pipelines: End-To-End Optimization of Photo Provenance in Complex Distribution Channels (2018-12-04T00:00:00.000000Z)

TL;DR

It is demonstrated that neural imaging pipelines can be trained to replace the internals of digital cameras, and jointly optimized for high-fidelity photo development and reliable provenance analysis at the end of the distribution channel.

Abstract

Forensic analysis of digital photo provenance relies on intrinsic traces left in the photograph at the time of its acquisition. Such analysis becomes unreliable after heavy post-processing, such as down-sampling and re-compression applied upon distribution in the Web. This paper explores end-to-end optimization of the entire image acquisition and distribution workflow to facilitate reliable forensic analysis at the end of the distribution channel. We demonstrate that neural imaging pipelines can be trained to replace the internals of digital cameras, and jointly optimized for high-fidelity photo development and reliable provenance analysis. In our experiments, the proposed approach increased image manipulation detection accuracy from 45% to over 90%. The findings encourage further research towards building more reliable imaging pipelines with explicit provenance-guaranteeing properties.

Authors

Pawel Korus

2 papers

N. Memon

2 papers

TL;DR

Abstract

Authors

References46 items

Identification of deep network generated images using disparities in color components

Noiseprint: A CNN-Based Camera Model Fingerprint

Detection of Deep Network Generated Images Using Disparities in Color Components

Learning Rich Features for Image Manipulation Detection

Learning to See in the Dark

Constrained Convolutional Neural Networks: A New Approach Towards General Purpose Image Manipulation Detection

Deep Image Demosaicking using a Cascade of Convolutional Residual Denoising Networks

Noise2Noise: Learning Image Restoration without Clean Data

Learning Deep Convolutional Networks for Demosaicing

Deep Learning for Detecting Processing History of Images

Object insertion and removal in images with mirror reflection

Digital image integrity - a survey of protection and verification techniques

Photo forensics from JPEG dimples

Tracing images back to their social network of origin: A CNN-based approach

HDR image reconstruction from a single exposure using deep CNNs

WESPE: Weakly Supervised Photo Enhancer for Digital Cameras

Fast Image Processing with Fully-Convolutional Networks

Reflection correspondence for exposing photograph manipulation

Multi-Scale Difference Map Fusion for Tamper Localization Using Binary Ranking Hashing

Large-scale evaluation of splicing localization algorithms for web images

Deep joint demosaicking and denoising

Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising

Learning the Image Processing Pipeline

General-purpose image forensics using patch likelihood under image statistical models

U-Net: Convolutional Networks for Biomedical Image Segmentation

RAISE: a raw images dataset for digital image forensics

Towards Practical Self-Embedding for JPEG-Compressed Digital Images

Exposing Photo Manipulation from Shading and Shadows

Toward image phylogeny forests: automatically recovering semantically similar image relationships.

Large-Scale Image Phylogeny: Tracing Image Ancestral Relationships

Information Forensics: An Overview of the First Decade

An Overview on Image Forensics

Image denoising: Can plain neural networks compete with BM3D?

The patch transform and its applications to image editing

Determining Image Origin and Integrity Using Sensor Noise

Demosaicking using artificial neural networks

See better and further with super res zoom on the pixel 3. https://ai.googleblog.com/ 2018/10/see-better-and-further-with-super-res.html

Joint Photographic Experts Group

Rawkit

LibRaw

COLOR IMAGE DEMOSAICKING VIA DEEP RESIDUAL LEARNING

Demosaicing With Directional Filtering and a posteriori Decision

Secure Digital Camera

Signiﬁcant improvement of forensic analysis performance in challenging, heavily post-processed conditions

The ﬁrst security-oriented discussion of neural imaging pipelines and the inherent trade-oﬀs

A neural model of the entire photo acquisition and distribution channel with a fully diﬀerentiable approximation of the JPEG codec

Field of Study

Journal Information

Name

Page

Venue Information

Name

Type

URL

Alternate Names