Full-resolution quality assessment for pansharpening (2021-08-13T00:00:00.000000Z)

TL;DR

This work proposes an alternative no-reference full-resolution assessment framework, and introduces a protocol, namely the reprojection protocol, to take care of the spectral consistency issue and a new index of the spatial consistency between the pansharpened image and the panchromatic band at full resolution.

Abstract

A reliable quality assessment procedure for pansharpening methods is of critical importance for the development of the related solutions. Unfortunately, the lack of ground truths to be used as guidance for an objective evaluation has pushed the community to resort to two approaches, which can also be jointly applied. Hence, two kinds of indexes can be found in the literature: (i) reference-based reduced-resolution indexes aimed to assess the synthesis ability; (ii) no-reference subjective quality indexes for full-resolution datasets aimed to assess spectral and spatial consistency. Both reference-based and no-reference indexes present critical shortcomings, which motivate the community to explore new solutions. In this work, we propose an alternative no-reference full-resolution assessment framework. On one side, we introduce a protocol, namely the reprojection protocol, to take care of the spectral consistency issue. On the other side, a new index of the spatial consistency between the pansharpened image and the panchromatic band at full resolution is also proposed. Experimental results carried out on different datasets/sensors demonstrate the effectiveness of the proposed approach.

Authors

Matteo Ciotola

3 papers

G. Scarpa

4 papers

TL;DR

Abstract

Authors

References101 items

Pansharpening by convolutional neural networks in the full resolution framework

Sub pixel resolution using spectral-spatial encoding in x-ray imaging

Generative Dual-Adversarial Network With Spectral Fidelity and Spatial Enhancement for Hyperspectral Pansharpening

A New Benchmark Based on Recent Advances in Multispectral Pansharpening: Revisiting Pansharpening With Classical and Emerging Pansharpening Methods

Deep Spectral-Spatial Features of Near Infrared Hyperspectral Images for Pixel-Wise Classification of Food Products

Model-Based Reduced-Rank Pansharpening

TanDEM-X Forest Mapping Using Convolutional Neural Networks

Robust Band-Dependent Spatial-Detail Approaches for Panchromatic Sharpening

Survey on semantic segmentation using deep learning techniques

Pan-Sharpening Using an Efficient Bidirectional Pyramid Network

A Combiner-Based Full Resolution Quality Assessment Index for Pansharpening

CoSpace: Common Subspace Learning From Hyperspectral-Multispectral Correspondences

$M^3\text{Fusion}$: A Deep Learning Architecture for Multiscale Multimodal Multitemporal Satellite Data Fusion

An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing

Object Detection With Deep Learning: A Review

Spatial Consistency for Full-Scale Assessment of Pansharpening

A CNN-Based Model for Pansharpening of WorldView-3 Images

A Bayesian Procedure for Full-Resolution Quality Assessment of Pansharpened Products

Psgan: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening

Full Scale Regression-Based Injection Coefficients for Panchromatic Sharpening

Remote Sensing Image Fusion With Deep Convolutional Neural Network

A CNN-Based Fusion Method for Feature Extraction from Sentinel Data

A Regression-Based High-Pass Modulation Pansharpening Approach

A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening

Haze Correction for Contrast-Based Multispectral Pansharpening

PanNet: A Deep Network Architecture for Pan-Sharpening

Target-Adaptive CNN-Based Pansharpening

Blind Quality Assessment of Fused WorldView-3 Images by Using the Combinations of Pansharpening and Hypersharpening Paradigms

Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network

Deep residual learning for remote sensed imagery pansharpening

A residual convolutional neural network for pan-shaprening

Intersensor Statistical Matching for Pansharpening: Theoretical Issues and Practical Solutions

Combining Component Substitution and Multiresolution Analysis: A Novel Generalized BDSD Pansharpening Algorithm

A new pansharpening method using multi resolution analysis framework and deep neural networks

Mask R-CNN

CNN-based pansharpening of multi-resolution remote-sensing images

Context-Adaptive Pansharpening Based on Image Segmentation

An Integrated Framework for the Spatio–Temporal–Spectral Fusion of Remote Sensing Images

Pansharpening by Convolutional Neural Networks

Exploiting Joint Sparsity for Pansharpening: The J-SparseFI Algorithm

Fusion of Multispectral and Panchromatic Images Based on Morphological Operators

Hyperspectral Super-Resolution by Coupled Spectral Unmixing

Joint Quality Measure for Evaluation of Pansharpening Accuracy

Full-Scale Assessment of Pansharpening Through Polynomial Fitting of Multiscale Measurements

Improving the spatial resolution of hyperspectral image using panchromatic and multispectral images: An integrated method

A Critical Comparison Among Pansharpening Algorithms

Model-Based Fusion of Multi- and Hyperspectral Images Using PCA and Wavelets

Pansharpening Based on Semiblind Deconvolution

Pansharpening of Multispectral Images Based on Nonlocal Parameter Optimization

Image Super-Resolution Using Deep Convolutional Networks

Full scale assessment of pansharpening methods and data products

Quality assessment of pan-sharpening methods

Recent advances in pansharpening and key problems in applications

A Sparse Image Fusion Algorithm With Application to Pan-Sharpening

Making a “Completely Blind” Image Quality Analyzer

Remote Sensing Image Fusion via Sparse Representations Over Learned Dictionaries

ImageNet classification with deep convolutional neural networks

Adjustable Model-Based Fusion Method for Multispectral and Panchromatic Images

Image misalignment caused by decimation in image fusion evaluation

Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion

A New Pan-Sharpening Method Using a Compressed Sensing Technique

A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery

Pansharpening Quality Assessment Using the Modulation Transfer Functions of Instruments

Hypercomplex Quality Assessment of Multi/Hyperspectral Images

Bayesian Data Fusion for Adaptable Image Pansharpening

Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics

An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets

Multispectral and panchromatic data fusion assessment without reference

Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique

Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest

Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data

MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery

Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods

A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery

A global quality measurement of pan-sharpened multispectral imagery

An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas