Pansharpening via Detail Injection Based Convolutional Neural Networks (2018-06-22T00:00:00.000000Z)

TL;DR

This paper designs a new detail injection based convolutional neural network (DiCNN) framework for pansharpening with the MS details being directly formulated in end-to-end manners, where the first detail injections based CNN mines MS details through the PAN image and the MS image, and the second one utilizes only the PAN picture.

Abstract

Pansharpening aims to fuse a multispectral (MS) image with an associated panchromatic (PAN) image, producing a composite image with the spectral resolution of the former and the spatial resolution of the latter. Traditional pansharpening methods can be ascribed to a unified detail injection context, which views the injected MS details as the integration of PAN details and bandwise injection gains. In this paper, we design a new detail injection based convolutional neural network (DiCNN) framework for pansharpening with the MS details being directly formulated in end-to-end manners, where the first detail injection based CNN (DiCNN1) mines MS details through the PAN image and the MS image, and the second one (DiCNN2) utilizes only the PAN image. The main advantage of the proposed DiCNNs is that they provide explicit physical interpretations and can achieve fast convergence while achieving high pansharpening quality. Furthermore, the effectiveness of the proposed approaches is also analyzed from a relatively theoretical point of view. Our methods are evaluated via experiments on real MS image datasets, achieving excellent performance when compared to other state-of-the-art methods.

Authors

A. Plaza

4 papers

J. Chanussot

5 papers

Jun Yu Li

2 papers

TL;DR

Abstract

Authors

References53 items

A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening

Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network

A residual convolutional neural network for pan-shaprening

Single Image Super-Resolution Using Multi-Scale Convolutional Neural Network

Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks

Pansharpening by Convolutional Neural Networks

Deep Residual Learning for Image Recognition

Accurate Image Super-Resolution Using Very Deep Convolutional Networks

Bayesian Fusion of Multi-band Images: A Powerful Tool for Super-resolution. (Fusion Bayesieene des multi-bandes Images: Un outil puissant pour la Super-résolution)

Deep Convolutional Neural Networks for Hyperspectral Image Classification

Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest

A Critical Comparison Among Pansharpening Algorithms

Hyperspectral Pansharpening: A Review

Image Super-Resolution Using Deep Convolutional Networks

Adam: A Method for Stochastic Optimization

MatConvNet: Convolutional Neural Networks for MATLAB

The Loss Surfaces of Multilayer Networks

How transferable are features in deep neural networks?

Learning a Deep Convolutional Network for Image Super-Resolution

Caffe: Convolutional Architecture for Fast Feature Embedding

Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening

Bayesian Fusion of Multi-Band Images

Rectified Linear Units Improve Restricted Boltzmann Machines

Tensor Decompositions and Applications

Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics

An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets

Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique

Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest

Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data

MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery

Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods

A global quality measurement of pan-sharpened multispectral imagery

An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas

Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis

A new look at IHS-like image fusion methods

Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm

Backpropagation Applied to Handwritten Zip Code Recognition

Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques

A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement

Large-Scale Machine Learning with Stochastic Gradient Descent

Fast and Efficient Panchromatic Sharpening

Neural Networks and Learning Machines

Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images

Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions

Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation

A wavelet transform method to merge Landsat TM and SPOT panchromatic data

Gradient-based learning applied to document recognition

Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images

The Stationary Wavelet Transform and some Statistical Applications

A generalized component substitution technique for spatial enhancement of multispectral images using

Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis

Neocognitron: A hierarchical neural network capable of visual pattern recognition

Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening

Field of Study

Journal Information

Name

Page

Volume

Venue Information

Name

Type

URL

Alternate Names