电光与控制, 2023, 30 (3): 70, 网络出版: 2023-04-03  

基于卷积神经网络的高光谱图像分类算法综述

A Survey of Hyperspectral Image Classification Algorithms Based on Convolutional Neural Networks
作者单位
中国人民解放军陆军装甲兵学院兵器与控制系, 北京 100000
摘要
高光谱图像拥有光谱分辨率高、图谱合一的优点, 已经成为遥感科学的重要研究方向。大多数传统的高光谱图像分类方法是基于浅层人工特征且依赖于专家经验, 已经难以满足当下的技术需求。近年来, 随着卷积神经网络在人工智能领域的广泛应用, 基于卷积神经网络的高光谱图像分类方法已经在分类精度和速度上取得突破性的进展。首先介绍了高光谱图像分类方法, 分析了传统分类方法的局限性; 然后根据卷积神经网络对高光谱图像特征提取方式的不同, 将算法分为基于谱特征、空间特征和空谱特征3大类, 并分析了每类算法的优缺点; 最后对高光谱图像分类的小样本训练、实际应用和分类结果等问题提出建议。
Abstract
Hyperspectral image has been considered as one of the greatest research directions in the remote sensing science due to its advantages of high spectral resolution as well as allowing for the synchronous acquisition of both images and spectra of objects.Most conventional hyperspectral image classification methods, however, are based on “shallow” handcrafted features, and highly relies on expert knowledge, which are difficult to meet the current technical requirements.In recent years, with the wide application of convolutional neural networks in the field of artificial intelligence, hyperspectral image classification methods based on convolutional neural networks have achieved breakthroughs in classification accuracy and speed.Firstly, hyperspectral image classification methods are introduced, and the limitations of traditional classification methods are analyzed.Secondly, according to the different extraction methods of hyperspectral image features by convolutional neural networks, the algorithm is divided into three types:Spectral features, spatial features and spatial-spectral features, and the merits and demerits are analyzed.Finally, some suggestions are put forward for the insufficient sample training, practical application and classification results of hyperspectral image classification.
参考文献

[1] GOETZ A F, VANE G, SOLOMON J E, et al.Imaging spectrometry for earth remote sensing[J].Science, 1985, 228(4704):1147-1153.

[2] 童庆禧,张兵,张立福.中国高光谱遥感的前沿进展[J].遥感学报,2016, 20(5):689-707.

[3] AWAD M M J I P I A.An innovative intelligent system based on remote sensing and mathematical models for improving crop yield estimation[J].Information Processing in Agriculture, 2019, 6(3):316-325.

[4] BIOUCAS-DIAS J M, PLAZA A, CAMPS-VALLS G, et al.Hyperspectral remote sensing data analysis and future challenges[J].IEEE Geoscience and Remote Sensing Magazine, 2013, 1(2):6-36.

[5] PIPITONE C, MALTESE A, DARDANELLI G, et al.Monitoring water surface and level of a reservoir using different remote sensing approaches and comparison with dam displacements evaluated via GNSS[J].Remote Sensing, 2018, 10(2):71-95.

[6] 马世欣,刘春桐,李洪才,等.基于高光谱图像探测与感知的伪装效果评估方法[J].兵工学报,2019, 40(7):1485-1494.

[7] HE K M, ZHANG X Y, REN S Q, et al.Deep residual learning for image recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE, 2016:1-12.

[8] CHEN Y S, ZHAO X, JIA X P.Spectral-spatial classification of hyperspectral data based on deep belief network[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015, 8(6):2381-2392.

[9] CHAO T, HONGBO P, YANSHENG L, et al.Unsupervised spectral-spatial feature learning with stacked sparse autoencoder for hyperspectral imagery classification[J].IEEE Geoscience and Remote Sensing Letters, 2015, 12(12):2438-2442.

[10] HU W, HUANG Y Y, WEI L, et al.Deep convolutional neural networks for hyperspectral image classification[J].Journal of Sensors, 2015, 2015:1-12.

[11] LECUN Y, BENGIO Y, HINTON G.Deep learning[J].Nature, 2015, 521(7553):36-44.

[12] 刘康,周壮,李盛阳,等.天宫一号高光谱遥感场景分类数据集及应用[J].遥感学报, 2020, 24(9):1077-1087.

[13] 曹林林,李海涛,韩颜顺,等.卷积神经网络在高分遥感影像分类中的应用[J].测绘科学,2016, 41(9):170-175.

[14] SAMANIEGO L, BARDOSSY A, SCHULZ K.Supervised classification of remotely sensed imagery using a modified k-NN technique[J].IEEE Transactions on Geoscience and Remote Sensing, 2008, 46(7):2112-2125.

[15] MELGANI F, BRUZZONE L.Classification of hyperspectral remote sensing images with support vector machines[J].IEEE Transactions on Geoscience and Remote Sensing, 2004, 42(8):1778-1790.

[16] ZHONG Y F, ZHANG L P, SENSING R.An adaptive artificial immune network for supervised classification of multi-/hyperspectral remote sensing imagery[J].IEEE Transactions on Geoscience and Remote Sensing, 2012, 50(3):894-909.

[17] LI J, BIOUCAS-DIAS J M, PLAZA A.Semisupervised hyperspectral image segmentation using multinomial logistic regression with active learning[J].IEEE Transactions on Geoscience and Remote Sensing, 2010, 48(11):4085-4098.

[18] PRASAD S, BRUCE L M.Limitations of principal components analysis for hyperspectral target recognition[J].IEEE Geoscience and Remote Sensing Letters, 2008, 5(4):625-629.

[19] VILLA A, BENEDIKTSSON J A, CHANUSSOT J, et al.Hyperspectral image classification with independent component discriminant analysis[J].IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(12):4865-4876.

[20] LI S T, SONG W W, FANG L Y, et al.Deep learning for hyperspectral image classification:an overview[J].IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(9):6690-6709.

[21] PAJARES G, LPEZ-MARTNEZ C, SNCHEZ-LLAD F J, et al.Improving wishart classification of polarimetric SAR data using the hopfield neural network optimization approach[J].Remote Sensing, 2012, 4(11):3571-3595.

[22] CHEN Y, NASRABADI N M, TRAN T D J I T O G, et al.Hyperspectral image classification using dictionary-based sparse representation[J].IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(10):3973-3985.

[23] HUANG K S, LI S T, KANG X D, et al.Spectral-spatial hyperspectral image classification based on KNN[J].Sensing and Imaging, 2016, 17(1):1-13.

[24] FAUVEL M, CHANUSSOT J, BENEDIKTSSON J A, et al.Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles[C]//IEEE International Geoscience and Remote Sensing Symposium.Barcelona: IEEE, 2008:3804-3814.

[25] 姜一河,王涛,常红伟.高光谱图像特征提取方法研究综述[J].电光与控制,2020, 27(10):73-77.

[26] KRIZHEVSKY A, SUTSKEVER I, HINTON G E.Image-Net classification with deep convolutional neural networks[J].Communications of the ACM, 2017, 60(6):84-90.

[27] GHAMISI P, PLAZA J, CHEN Y, et al.Advanced spectral classifiers for hyperspectral images:a review[J].IEEE Geoscience and Remote Sensing Magazine, 2017, 5(1):8-32.

[28] CHEN Y, JIANG H, LI C, et al.Deep feature extraction and classification of hyperspectral images based on convolutional neural networks[J].IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(10):6232-6251.

[29] SRIVASTAVA N, HINTON G, KRIZHEVSKY A, et al.Dropout:a simple way to prevent neural networks from overfitting[J].The Journal of Machine Learning Research, 2014, 15(1):1929-1958.

[30] 邬国栋.基于深度学习的高光谱图像分类和异常检测研究[D].北京:北京化工大学,2018.

[31] 姜含露.基于卷积神经网的高光谱数据特征提取及分类技术研究[D].哈尔滨:哈尔滨工业大学,2016.

[32] GONG Z Q, ZHONG P, YU Y, et al.A CNN with multiscale convolution and diversified metric for hyperspectral image classification[J].IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(6):3599-3618.

[33] MAKANTASIS K, KARANTZALOS K, DOULAMIS A, et al.Deep supervised learning for hyperspectral data classification through convolutional neural networks[C]//IEEE International Geoscience and Remote Sensing Symposium.Milan:IEEE, 2015:4959-4962.

[34] YUE J, ZHAO W Z, MAO S J, et al.Spectral-spatial classification of hyperspectral images using deep convolutional neural networks[J].Remote Sensing Letters, 2015, 6(6):468-477.

[35] SONG W W, LI S T, FANG L Y, et al.Hyperspectral image classification with deep feature fusion network[J].IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(6):3173-3184.

[36] JIA S, JIANG S G, LIN Z J, et al.A survey:deep learning for hyperspectral image classification with few labeled samples[J].Neurocomputing, 2021, 448:179-204.

[37] LEE H, KWON H.Contextual deep CNN based hyperspectral classification[C]//IEEE International Geoscience and Remote Sensing Symposium(IGARSS).Beijing:IEEE, 2016:3322-3325.

[38] 蔡瑞.基于卷积神经网络的高光谱地物目标分类算法研究[D].西安: 中国科学院大学(中国科学院西安光学精密机械研究所),2019.

[39] 王昱淞.基于深度学习的高光谱影像典型地物分类方法研究[D].吉林: 吉林大学,2021.

[40] LIU B, YU X C, ZHANG P Q, et al.Supervised deep feature extraction for hyperspectral image classification[J].IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(4):1909-1921.

[41] ZHAO W Z, DU S H.Spectral-spatial feature extraction for hyperspectral image classification:a dimension reduction and deep learning approach[J].IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(8):4544-4554.

[42] CAO X Y, ZHOU F, XU L, et al.Hyperspectral image classification with Markov random fields and a convolutional neural network[J].IEEE Transactions on Image Processing, 2018, 27(5):2354-2367.

[43] HE N, PAOLETTI M E, HAUT J M, et al.Feature extraction with multiscale covariance maps for hyperspectral image classification[J].IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(2):755-769.

[44] LI S M, ZHU X Y, LIU Y, et al.Adaptive spatial-spectral feature learning for hyperspectral image classification[J].IEEE Access, 2019, 7:61534-61547.

[45] 陈采璐.基于深度卷积神经网络的高光谱图像分类方法研究[D].哈尔滨:哈尔滨工业大学,2019.

[46] PAOLETTI M E, HAUT J M, ROY S K, et al.Rotation equivariant convolutional neural networks for hyperspectral image classification[J].IEEE Access, 2020, 8:179575-179591.

[47] RAN L Y, ZHANG Y N, WEI W, et al.A hyperspectral image classification framework with spatial pixel pair features[J].Sensors, 2017, 17(10):2421.

[48] YU S Q, JIA S, XU C Y.Convolutional neural networks for hyperspectral image classification[J].Neurocomputing, 2017, 219:88-98.

[49] LI Y, XU Q Z, LI W, et al.Automatic clustering-based two-branch CNN for hyperspectral image classification[J].IEEE Transactions on Geoscience and Remote Sensing, 2021, 59(9):7803-7816.

[50] WANG X, XIE W X, SONG J Y.Learning spatiotemporal features with 3DCNN and ConvGRU for video anomaly detection[C]//The 14th IEEE International Conference on Signal Processing (ICSP).Beijing:IEEE, 2018:474-479.

[51] LI Y, ZHANG H K, SHEN Q.Spectral-spatial classification of hyperspectral imagery with 3D convolutional neural network[J].Remote Sensing, 2017, 9(1):67-79.

[52] BEN H A, BENOIT A, LAMBERT P, et al.3-D deep learning approach for remote sensing image classification[J].IEEE Transactions on Geoscience and Remote Sensing, 2018, 56(8):4420-4434.

[53] 张欣.基于三维卷积神经网络的高光谱遥感图像分类技术研究[D].长春:中国科学院大学(中国科学院长春光学精密机械与物理研究所),2021.

[54] GHADERIZADEH S, ABBASI-MOGHADAM D, SHARIFI A, et al.Hyperspectral image classification using a hybrid 3d-2d convolutional neural networks[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14:7570-7588.

[55] XU Q, XIAO Y, WANG D Y, et al.CSA-MSO3DCNN:multiscale octave 3D CNN with channel and spatial attention for hyperspectral image classification[J].Remote Sensing, 2020, 12(1):188-194.

[56] CHEN Y S, ZHU K Q, ZHU L, et al.Automatic design of convolutional neural network for hyperspectral image classification[J].IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(9):7048-7066.

[57] GAO H M, CHEN Z H, LI C.Sandwich convolutional neural network for hyperspectral image classification using spectral feature enhancement[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2021, 14:3006-3015.

易瑔, 张宇航, 宗艳桃, 戴颜斌. 基于卷积神经网络的高光谱图像分类算法综述[J]. 电光与控制, 2023, 30(3): 70. YI Quan, ZHANG Yuhang, ZONG Yantao, DAI Yanbin. A Survey of Hyperspectral Image Classification Algorithms Based on Convolutional Neural Networks[J]. Electronics Optics & Control, 2023, 30(3): 70.

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!