面向高分辨SAR图像分类的量子深度神经网络研究

项目来源

国家自然科学基金(NSFC)

项目主持人

李阳阳

项目受资助机构

西安电子科技大学

项目编号

61772399

立项年度

2017

立项时间

未公开

项目级别

国家级

研究期限

未知 / 未知

受资助金额

63.00万元

学科

信息科学-人工智能

学科代码

F-F06

基金类别

面上项目

关键词

深度神经网络 ; 地物分类 ; 高分辨SAR图像 ; 稀疏特征 ; 量子并行计算 ; quantum parallel computation ; deep neural network ; sparse feature ; high-resolution SAR image ; terrain classification

参与者

李豪;李玲玲;孟洋;刘天宇;陆高;周林浩;张玮桐;白小玉

参与机构

西安电子科技大学;上海海事大学

项目标书摘要:本课题针对高分辨SAR图像数据量大,稀疏特征难以表示的瓶颈问题,从而借鉴脑神经计算机理,构造量子深度神经网络模型对高分辨SAR数据进行稀疏表示;为解决深度神经网络模型规模与训练速度、训练精度之间的权衡问题,基于量子并行计算,建立量子深度学习算法,实现高效学习,克服灾变性失忆等缺陷;将非监督的高分辨SAR图像分类转化为对目标函数的优化问题,针对传统优化算法全局优化能力不足导致SAR图像处理结果易陷入局部极值,建立量子免疫优化的高维特征选择算法,用具有挑战性的高分辨SAR图像分类问题,来验证该网络计算模型的有效性与可扩展性。

Application Abstract: Aiming at the bottlenecks,such as large amount of data and being difficult to represent the sparse features,of high-resolution Synthetic Aperture Radar(SAR)images,this subject draws on the neural network mechanism and constructs the quantum-inspired deep neural network to overcome these bottlenecks.In order to solve the trade-off between the model scale and the training speed,training precision of the deep neural networks,we will design quantum-inspired learning algorithms based on the quantum parallel computing,which achieve efficient learning,and overcome catastrophic amnesia.In our study,we convert the unsupervised high-resolution SAR image classification problem into optimization problem.Meanwhile,aiming at the shortcomings that the SAR image processing results are easy to fall into the local optimum of the traditional optimization algorithm,we establish a high-dimensional feature selection algorithm for quantum-inspired immune optimization,and use the challenging high-resolution SAR image to verify the validity and expansibility of the computing network model.

项目受资助省

陕西省

项目结题报告(全文)

针对高分辨SAR 图像数据量大,稀疏特征难以表示,借鉴量子神经网络的指数级记忆容量和学习速度,并行计算能力,稳定性好的特性,建立模拟大脑处理信息过程的智能计算模型——量子深度神经网络模型;针对深度神经网络在处理高分辨SAR图像时的瓶颈问题,建立量子学习算法;通过优化的方式构建高效的深度神经网络,实现高分辨SAR图像分类,突破了网络模型的结构和超参数难以确定、复杂数据计算量庞大、自适应性弱、抗噪能力差和鲁棒性差等关键技术,为高维复杂结构的SAR图像分类任务构建了高效、稳健的深度神经网络;成功应用于高分辨SAR图像分类与解译的关键问题中,设计并实现基于量子神经网络的高分辨SAR图像识别系统。本课题研究成果共计发表论文37篇,其中SCI检索的国际期刊论文25篇,包括SCI Ⅰ区及II 区的国际刊物共16篇,出版教材1部,获2020年度陕西省研究生优秀教材一等奖1项,申报国家发明专利16 项和软件著作权2项(其中授权5项专利和2项软件著作权),培养博士和硕士9人,其中一篇博士论文获得“2021年陕西省优秀博士学位论文”称号。

  • 排序方式:
  • 1
  • /
  • 1.Mask Decoupled Head for Instance Segmentation in Remote Sensing Images

    • 关键词:
    • ;
    • Wang, Yuan;Zhang, Xiangrong;Zhang, Tianyang;Zhu, Xiaoqian;Tang, Xu;Gao, Li;Jiao, Licheng
    • 《2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022》
    • 2022年
    • July 17, 2022 - July 22, 2022
    • Kuala Lumpur, Malaysia
    • 会议

    Instance segmentation predicts the categories of all instances and locates them using pixel-level masks. Although existing methods have shown exemplary performance, the poor boundaries due to the lack of fine-grained information re-mains a challenge for RSIs instance segmentation. In this paper, to address the problem, we propose a novel instance segmentation branch, namely Mask Decoupled Head, which is mainly composed of a Feature Enhance Module (FEM) and a Feature Decoupled Module (FDM). FEM enhances the rep-resentation of the body features through the low-frequency component of images. FDM decouples the segmentation task by supervising body and edge separately and leverages fine-grained information to complement the boundary details. We performed comprehensive experiments on NWPU VHR-10 and HRSID datasets to evaluate the effectiveness of our pro-posed method and achieved good performance. © 2022 IEEE.

    ...
  • 2.Semantic-Aware Context Modeling for Road Extraction in Remote Sensing Images

    • 关键词:
    • ;
    • Cao, Fei;Zhang, Xiangrong;Zhu, Xiaoqian;Zhu, Peng;Tang, Xu;Gao, Li;Jiao, Licheng
    • 《2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022》
    • 2022年
    • July 17, 2022 - July 22, 2022
    • Kuala Lumpur, Malaysia
    • 会议

    Road extraction faces the great challenges of occlusion, large span, and complex backgrounds in remote sensing images. Many existing methods receive context from regions near the road non-differently, and the context from irrelevant regions instead harms the semantics of features and leads to the mis-classification of the network. To address the above problem, we propose a Semantic-Aware Context Module (SACM) that encourages the network to model the context of different se-mantics supervised by a soft foreground map. And Strip Pooling Module (SPM) is introduced to match the fact that roads tend to be strip-shaped, contributing to the suppression of contamination information in irrelevant regions. Both SACM and SPM enable the network to obtain more specific semanti-cally relevant context. The experimental results on the Deep-Globe dataset show that the proposed method tremendously improves the performance of the network. © 2022 IEEE.

    ...
  • 3.Few-Shot Hyperspectral Image Classification Based on Domain Adaptation of Class Balance

    • 关键词:
    • ;
    • Zhen, Qi;Zhang, Xiangrong;Li, Zhenyu;Hou, Biao;Tang, Xu;Gao, Li;Jiao, Licheng
    • 《2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022》
    • 2022年
    • July 17, 2022 - July 22, 2022
    • Kuala Lumpur, Malaysia
    • 会议

    Hyperspectral image (HSI) classification has attracted ever-rising attention to better performance based on limited labeled data. In this paper, a domain adaptation method of class balance based on few-shot learning is proposed, which obtains the classification results of target HSI by training the dataset in the source domain containing sufficient labeled data. We use a random weighted sampling strategy in the source domain and the generative adversarial network (GAN) in the target domain to reduce the label distribution shift caused by unbalanced classes. Then, the conditional maximum mean discrepancy (CMMD) is presented for a more comprehensive domain alignment by considering the posterior data distribution. In addition, the double cross non-local block and multi-scale strategy are adopted in the feature extraction stage to get a refined classification result. Experimental results on public HSI datasets demonstrate that our method is efficient and outperforms other baselines. © 2022 IEEE.

    ...
  • 5.A MULTI-BRANCH NETWORK BASED ON WEIGHT SHARING AND ATTENTION MECHANISM FOR HYPERSPECTRAL IMAGE CLASSIFICATION

    • 关键词:
    • ;
    • Guo, Zhen;Mu, Caihong;Liu, Yi
    • 《2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021》
    • 2021年
    • July 12, 2021 - July 16, 2021
    • Brussels, Belgium
    • 会议

    Deep convolutional neural network (DCNN) has been widely used in hyperspectral image classification. However, due to the large number of parameters of DCNN, it is difficult for the network to converge during the training. Besides, under the condition of limited samples, DCNN will suffer from the over-fitting problem. In this paper, we propose a multi-branch network based on weight sharing and attention mechanism (MNWA), in which multiple branches share the same parameters and the number of parameters in the proposed neural network is greatly reduced. On the other hand, the proposed attention mechanism can give different weight values to different bands in hyperspectral images, which reduces the transmission of noise bands in the network and increases the transmission of bands useful for classification. Experiments on two datasets show that MNWA is superior to the state-of-the-art methods in the case of limited training samples.
    © 2021 IEEE

    ...
  • 6.A NOVEL DATA AUGMENTATION METHOD FOR SAR IMAGE TARGET DETECTION AND RECOGNITION

    • 关键词:
    • ;
    • Zhang, Xiaolong;Chai, Xinghua;Chen, Yanqiao;Yang, Zichen;Liu, Guangyuan;He, Aiyuan;Li, Yangyang
    • 《2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021》
    • 2021年
    • July 12, 2021 - July 16, 2021
    • Brussels, Belgium
    • 会议

    With the development of remote sensing satellite technology, the resolution of remote sensing images is constantly improved, but there are difficulties in obtaining labeled SAR image datasets for target detection and recognition. To address the problem that only limited SAR image target detection and recognition data are available, a novel data augmentation method based on convolutional neural network is proposed. Firstly, the Synthetic Aperture Radar (SAR) image target detection and recognition dataset SAR_OD was produced based on the synthesis of military targets and background images in MSTAR dataset. But considering the fact that the number of targets in each image in SAR_OD is still not enough for training a target detection model with good performance, we augmented SAR_OD and then we obtained SAR_OD+ dataset. It is proved that the model trained on SAR_OD+ dataset is significantly improved in the evaluation index by the data augmentation method proposed in this paper, especially in the experiments using only 50% of the training data. Therefore, the proposed data augmentation method can be used to improve the performance of SAR image target detection and recognition model in the case of limited labeled data.
    © 2021 IEEE.

    ...
  • 7.A NOVEL DATA AUGMENTATION METHOD FOR SAR IMAGE TARGET DETECTION AND RECOGNITION

    • 关键词:
    • ;
    • ZhangXiaolong;ChaiXinghua;ChenYanqiao;YangZichen;LiuGuangyuan;HeAiyuan;LiYangyang
    • 《2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021》
    • 2021年
    • July 12, 2021-July 16, 2021
    • Brussels, Belgium
    • 会议

    With the development of remote sensing satellite technology, the resolution of remote sensing images is constantly improved, but there are difficulties in obtaining labeled SAR image datasets for target detection and recognition. To address the problem that only limited SAR image target detection and recognition data are available, a novel data augmentation method based on convolutional neural network is proposed. Firstly, the Synthetic Aperture Radar (SAR) image target detection and recognition dataset SAR_OD was produced based on the synthesis of military targets and background images in MSTAR dataset. But considering the fact that the number of targets in each image in SAR_OD is still not enough for training a target detection model with good performance, we augmented SAR_OD and then we obtained SAR_OD+ dataset. It is proved that the model trained on SAR_OD+ dataset is significantly improved in the evaluation index by the data augmentation method proposed in this paper, especially in the experiments using only 50% of the training data. Therefore, the proposed data augmentation method can be used to improve the performance of SAR image target detection and recognition model in the case of limited labeled data. © 2021 IEEE.

    ...
  • 8.Discriminative Feature Pyramid Network for Object Detection in Remote Sensing Images

    • 关键词:
    • Object recognition;Remote sensing;Feature extraction;Semantics;Complex networks;Complex background;Discrimination informations;Discriminative features;Feature aggregation;Geo-spatial objects;High level semantics;Remote sensing images;Semantic information
    • Zhu, Xiaoqian;Zhang, Xiangrong;Zhang, Tianyang;Zhu, Peng;Tang, Xu;Li, Chen
    • 《2020 International Joint Conference on Neural Networks, IJCNN 2020》
    • 2020年
    • July 19, 2020 - July 24, 2020
    • Virtual, Glasgow, United kingdom
    • 会议

    Multi-class geospatial object detection in remote sensing images suffer great challenges, such as large scales variability and complex background. Although feature pyramid network (FPN) can alleviate the problem of scale variation to some extent, it causes the loss of spatial and semantic information which is not conducive to object location. To address the above problem, this paper proposes a discriminative feature pyramid network (DFPN) by introducing a global guidance module (GGM) and a feature aggregation module (FAM). Specifically, the global guidance module delivers the high-level semantic information to lower layers, so as to obtain feature maps with stronger semantic information to eliminate the interference caused by complex background. The feature aggregation module enhances the interflow of information between different layers and better captures the discrimination information at each layer. We validate the effectiveness of our method on the NWPU VHR-10 and RSOD datasets, the results outperform baseline by 2.06 and 3.88 points respectively. © 2020 IEEE.

    ...
  • 9.Scene Attention Mechanism for Remote Sensing Image Caption Generation

    • 关键词:
    • Convolution;Remote sensing;Convolutional neural networks;Attention mechanisms;Hidden state;Mean features;Remote sensing images;Short term memory;Visual information
    • Wu, Shiqi;Zhang, Xiangrong;Wang, Xin;Li, Chen;Jiao, Licheng
    • 《2020 International Joint Conference on Neural Networks, IJCNN 2020》
    • 2020年
    • July 19, 2020 - July 24, 2020
    • Virtual, Glasgow, United kingdom
    • 会议

    Remote sensing images play an important role in various applications. To make it easier for humans to understand remote sensing images, the task of remote sensing image captioning attracts more and more researchers' attention. Inspired from the way human receives visual information, attention mechanism has been widely used in remote sensing image understanding. To catch more scene information and improve the stability of the generated sentences, a new attention mechanism called scene attention is proposed. Except for the current attention via the current hidden state of the long shortterm memory network (LSTM), our proposed method simultaneously explores the global visual information from the mean feature of all convolutional features. The effectiveness of the proposed method is evaluated on UCM-captions, Sydney-captions and RSICD datasets. The results of our experiment show that comparing with some other captioning methods, our method is more stable and obtains a better performance. © 2020 IEEE.

    ...
  • 10.SAR Image Specle Reduction based on a Generative Adversarial Network

    • 关键词:
    • Metadata;Discriminators;Image enhancement;Speckle;Noise abatement;Radar imaging;Synthetic aperture radar;Adversarial networks;Discriminative networks;Homogeneous regions;Homomorphic transformation;Logarithmic transformations;SAR image processing;Statistical performance;Synthetic aperture radar (SAR) images
    • Liu, Ruijiao;Li, Yangyang;Jiao, Licheng
    • 《2020 International Joint Conference on Neural Networks, IJCNN 2020》
    • 2020年
    • July 19, 2020 - July 24, 2020
    • Virtual, Glasgow, United kingdom
    • 会议

    Synthetic aperture radar (SAR) image despeckling is recognized as the basis for SAR image processing and interpretation. Over the past decades, many impressed speckle reduction methods have been developed and achieved good performance under certain circumstances. However, how to suppress speckle noise in a homogeneous region while more effectively protecting details and avoid distortion of data features caused by homomorphic transformation is still an urgent problem. In this paper, a novel speckle reduction algorithm based on generative adversarial network (GAN) is proposed, which contains a generator and a discriminator. For the generator that is used directly for subsequent noise reduction, a total variation (TV) loss function is added. Meanwhile, we directly learn the mapping between the input image and the ground truth rather than the logarithmic transformation. Indeed, the improved lightweight discriminative network will also provide learning guidance for the generator. Experiments on simulatedSAR images and real SAR images demonstrate the improvement in visual and statistical performance comparing to the state-of-the-art despeckling algorithms. © 2020 IEEE.

    ...
  • 排序方式:
  • 1
  • /