UPSNet: Unsupervised Pan-Sharpening Network with Registration Learning between Panchromatic and Multi-Spectral Images

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 48
  • Download : 49
Recent advances in deep learning have shown impressive performances for pan-sharpening. Pan-sharpening is the task of enhancing the spatial resolution of a multi-spectral (MS) image by exploiting the high-frequency information of its corresponding panchromatic (PAN) image. Many deep-learning-based pan-sharpening methods have been developed recently, surpassing the performances of traditional pan-sharpening approaches. However, most of them are trained in lower scales using misaligned PAN-MS training pairs, which has led to undesired artifacts and unsatisfying visual quality. In this paper, we propose an unsupervised learning framework with registration learning for pan-sharpening, called UPSNet. UPSNet can be effectively trained in the original scales, and implicitly learns the registration between PAN and MS images without any dedicatedly designed registration module involved. Additionally, we design two novel loss functions for training UPSNet: a guided-filter-based color loss between network outputs and aligned MS targets; and a dual-gradient detail loss between network outputs and PAN inputs. Extensive experimental results show that our UPSNet can generate pan-sharpened images with remarkable improvements in terms of visual quality and registration, compared to the state-of-the-art methods.
Publisher
Institute of Electrical and Electronics Engineers Inc.
Issue Date
2020-11
Language
English
Article Type
Article
Citation

IEEE ACCESS, v.8, pp.201199 - 201217

ISSN
2169-3536
DOI
10.1109/ACCESS.2020.3035802
URI
http://hdl.handle.net/10203/278600
Appears in Collection
EE-Journal Papers(저널논문)
Files in This Item
000590427800001.pdf(21.56 MB)Download

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0