面向高分辨SAR图像分类的量子深度神经网络研究
项目来源
项目主持人
项目受资助机构
立项年度
立项时间
项目编号
项目级别
研究期限
受资助金额
学科
学科代码
基金类别
关键词
参与者
参与机构
项目受资助省
项目结题报告(全文)
1.Mask Decoupled Head for Instance Segmentation in Remote Sensing Images
- 关键词:
- ;
- Wang, Yuan;Zhang, Xiangrong;Zhang, Tianyang;Zhu, Xiaoqian;Tang, Xu;Gao, Li;Jiao, Licheng
- 《2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022》
- 2022年
- July 17, 2022 - July 22, 2022
- Kuala Lumpur, Malaysia
- 会议
Instance segmentation predicts the categories of all instances and locates them using pixel-level masks. Although existing methods have shown exemplary performance, the poor boundaries due to the lack of fine-grained information re-mains a challenge for RSIs instance segmentation. In this paper, to address the problem, we propose a novel instance segmentation branch, namely Mask Decoupled Head, which is mainly composed of a Feature Enhance Module (FEM) and a Feature Decoupled Module (FDM). FEM enhances the rep-resentation of the body features through the low-frequency component of images. FDM decouples the segmentation task by supervising body and edge separately and leverages fine-grained information to complement the boundary details. We performed comprehensive experiments on NWPU VHR-10 and HRSID datasets to evaluate the effectiveness of our pro-posed method and achieved good performance. © 2022 IEEE.
...2.Semantic-Aware Context Modeling for Road Extraction in Remote Sensing Images
- 关键词:
- ;
- Cao, Fei;Zhang, Xiangrong;Zhu, Xiaoqian;Zhu, Peng;Tang, Xu;Gao, Li;Jiao, Licheng
- 《2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022》
- 2022年
- July 17, 2022 - July 22, 2022
- Kuala Lumpur, Malaysia
- 会议
Road extraction faces the great challenges of occlusion, large span, and complex backgrounds in remote sensing images. Many existing methods receive context from regions near the road non-differently, and the context from irrelevant regions instead harms the semantics of features and leads to the mis-classification of the network. To address the above problem, we propose a Semantic-Aware Context Module (SACM) that encourages the network to model the context of different se-mantics supervised by a soft foreground map. And Strip Pooling Module (SPM) is introduced to match the fact that roads tend to be strip-shaped, contributing to the suppression of contamination information in irrelevant regions. Both SACM and SPM enable the network to obtain more specific semanti-cally relevant context. The experimental results on the Deep-Globe dataset show that the proposed method tremendously improves the performance of the network. © 2022 IEEE.
...3.Few-Shot Hyperspectral Image Classification Based on Domain Adaptation of Class Balance
- 关键词:
- ;
- Zhen, Qi;Zhang, Xiangrong;Li, Zhenyu;Hou, Biao;Tang, Xu;Gao, Li;Jiao, Licheng
- 《2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022》
- 2022年
- July 17, 2022 - July 22, 2022
- Kuala Lumpur, Malaysia
- 会议
Hyperspectral image (HSI) classification has attracted ever-rising attention to better performance based on limited labeled data. In this paper, a domain adaptation method of class balance based on few-shot learning is proposed, which obtains the classification results of target HSI by training the dataset in the source domain containing sufficient labeled data. We use a random weighted sampling strategy in the source domain and the generative adversarial network (GAN) in the target domain to reduce the label distribution shift caused by unbalanced classes. Then, the conditional maximum mean discrepancy (CMMD) is presented for a more comprehensive domain alignment by considering the posterior data distribution. In addition, the double cross non-local block and multi-scale strategy are adopted in the feature extraction stage to get a refined classification result. Experimental results on public HSI datasets demonstrate that our method is efficient and outperforms other baselines. © 2022 IEEE.
...4.Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation(Open Access)
- Zhang, Xiangrong ; Peng, Zelin ; Zhu, Peng ; Zhang, Tianyang ; Li, Chen ; Zhou, Huiyu ; Jiao, Licheng
- 《MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia》
- 2021年
- 会议
5.A MULTI-BRANCH NETWORK BASED ON WEIGHT SHARING AND ATTENTION MECHANISM FOR HYPERSPECTRAL IMAGE CLASSIFICATION
- 关键词:
- ;
- Guo, Zhen;Mu, Caihong;Liu, Yi
- 《2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021》
- 2021年
- July 12, 2021 - July 16, 2021
- Brussels, Belgium
- 会议
Deep convolutional neural network (DCNN) has been widely used in hyperspectral image classification. However, due to the large number of parameters of DCNN, it is difficult for the network to converge during the training. Besides, under the condition of limited samples, DCNN will suffer from the over-fitting problem. In this paper, we propose a multi-branch network based on weight sharing and attention mechanism (MNWA), in which multiple branches share the same parameters and the number of parameters in the proposed neural network is greatly reduced. On the other hand, the proposed attention mechanism can give different weight values to different bands in hyperspectral images, which reduces the transmission of noise bands in the network and increases the transmission of bands useful for classification. Experiments on two datasets show that MNWA is superior to the state-of-the-art methods in the case of limited training samples.© 2021 IEEE...6.A NOVEL DATA AUGMENTATION METHOD FOR SAR IMAGE TARGET DETECTION AND RECOGNITION
- 关键词:
- ;
- Zhang, Xiaolong;Chai, Xinghua;Chen, Yanqiao;Yang, Zichen;Liu, Guangyuan;He, Aiyuan;Li, Yangyang
- 《2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021》
- 2021年
- July 12, 2021 - July 16, 2021
- Brussels, Belgium
- 会议
With the development of remote sensing satellite technology, the resolution of remote sensing images is constantly improved, but there are difficulties in obtaining labeled SAR image datasets for target detection and recognition. To address the problem that only limited SAR image target detection and recognition data are available, a novel data augmentation method based on convolutional neural network is proposed. Firstly, the Synthetic Aperture Radar (SAR) image target detection and recognition dataset SAR_OD was produced based on the synthesis of military targets and background images in MSTAR dataset. But considering the fact that the number of targets in each image in SAR_OD is still not enough for training a target detection model with good performance, we augmented SAR_OD and then we obtained SAR_OD+ dataset. It is proved that the model trained on SAR_OD+ dataset is significantly improved in the evaluation index by the data augmentation method proposed in this paper, especially in the experiments using only 50% of the training data. Therefore, the proposed data augmentation method can be used to improve the performance of SAR image target detection and recognition model in the case of limited labeled data.© 2021 IEEE....7.A NOVEL DATA AUGMENTATION METHOD FOR SAR IMAGE TARGET DETECTION AND RECOGNITION
- 关键词:
- ;
- ZhangXiaolong;ChaiXinghua;ChenYanqiao;YangZichen;LiuGuangyuan;HeAiyuan;LiYangyang
- 《2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021》
- 2021年
- July 12, 2021-July 16, 2021
- Brussels, Belgium
- 会议
With the development of remote sensing satellite technology, the resolution of remote sensing images is constantly improved, but there are difficulties in obtaining labeled SAR image datasets for target detection and recognition. To address the problem that only limited SAR image target detection and recognition data are available, a novel data augmentation method based on convolutional neural network is proposed. Firstly, the Synthetic Aperture Radar (SAR) image target detection and recognition dataset SAR_OD was produced based on the synthesis of military targets and background images in MSTAR dataset. But considering the fact that the number of targets in each image in SAR_OD is still not enough for training a target detection model with good performance, we augmented SAR_OD and then we obtained SAR_OD+ dataset. It is proved that the model trained on SAR_OD+ dataset is significantly improved in the evaluation index by the data augmentation method proposed in this paper, especially in the experiments using only 50% of the training data. Therefore, the proposed data augmentation method can be used to improve the performance of SAR image target detection and recognition model in the case of limited labeled data. © 2021 IEEE.
...8.Discriminative Feature Pyramid Network for Object Detection in Remote Sensing Images
- 关键词:
- Object recognition;Remote sensing;Feature extraction;Semantics;Complex networks;Complex background;Discrimination informations;Discriminative features;Feature aggregation;Geo-spatial objects;High level semantics;Remote sensing images;Semantic information
- Zhu, Xiaoqian;Zhang, Xiangrong;Zhang, Tianyang;Zhu, Peng;Tang, Xu;Li, Chen
- 《2020 International Joint Conference on Neural Networks, IJCNN 2020》
- 2020年
- July 19, 2020 - July 24, 2020
- Virtual, Glasgow, United kingdom
- 会议
Multi-class geospatial object detection in remote sensing images suffer great challenges, such as large scales variability and complex background. Although feature pyramid network (FPN) can alleviate the problem of scale variation to some extent, it causes the loss of spatial and semantic information which is not conducive to object location. To address the above problem, this paper proposes a discriminative feature pyramid network (DFPN) by introducing a global guidance module (GGM) and a feature aggregation module (FAM). Specifically, the global guidance module delivers the high-level semantic information to lower layers, so as to obtain feature maps with stronger semantic information to eliminate the interference caused by complex background. The feature aggregation module enhances the interflow of information between different layers and better captures the discrimination information at each layer. We validate the effectiveness of our method on the NWPU VHR-10 and RSOD datasets, the results outperform baseline by 2.06 and 3.88 points respectively. © 2020 IEEE.
...9.Scene Attention Mechanism for Remote Sensing Image Caption Generation
- 关键词:
- Convolution;Remote sensing;Convolutional neural networks;Attention mechanisms;Hidden state;Mean features;Remote sensing images;Short term memory;Visual information
- Wu, Shiqi;Zhang, Xiangrong;Wang, Xin;Li, Chen;Jiao, Licheng
- 《2020 International Joint Conference on Neural Networks, IJCNN 2020》
- 2020年
- July 19, 2020 - July 24, 2020
- Virtual, Glasgow, United kingdom
- 会议
Remote sensing images play an important role in various applications. To make it easier for humans to understand remote sensing images, the task of remote sensing image captioning attracts more and more researchers' attention. Inspired from the way human receives visual information, attention mechanism has been widely used in remote sensing image understanding. To catch more scene information and improve the stability of the generated sentences, a new attention mechanism called scene attention is proposed. Except for the current attention via the current hidden state of the long shortterm memory network (LSTM), our proposed method simultaneously explores the global visual information from the mean feature of all convolutional features. The effectiveness of the proposed method is evaluated on UCM-captions, Sydney-captions and RSICD datasets. The results of our experiment show that comparing with some other captioning methods, our method is more stable and obtains a better performance. © 2020 IEEE.
...10.SAR Image Specle Reduction based on a Generative Adversarial Network
- 关键词:
- Metadata;Discriminators;Image enhancement;Speckle;Noise abatement;Radar imaging;Synthetic aperture radar;Adversarial networks;Discriminative networks;Homogeneous regions;Homomorphic transformation;Logarithmic transformations;SAR image processing;Statistical performance;Synthetic aperture radar (SAR) images
- Liu, Ruijiao;Li, Yangyang;Jiao, Licheng
- 《2020 International Joint Conference on Neural Networks, IJCNN 2020》
- 2020年
- July 19, 2020 - July 24, 2020
- Virtual, Glasgow, United kingdom
- 会议
Synthetic aperture radar (SAR) image despeckling is recognized as the basis for SAR image processing and interpretation. Over the past decades, many impressed speckle reduction methods have been developed and achieved good performance under certain circumstances. However, how to suppress speckle noise in a homogeneous region while more effectively protecting details and avoid distortion of data features caused by homomorphic transformation is still an urgent problem. In this paper, a novel speckle reduction algorithm based on generative adversarial network (GAN) is proposed, which contains a generator and a discriminator. For the generator that is used directly for subsequent noise reduction, a total variation (TV) loss function is added. Meanwhile, we directly learn the mapping between the input image and the ground truth rather than the logarithmic transformation. Indeed, the improved lightweight discriminative network will also provide learning guidance for the generator. Experiments on simulatedSAR images and real SAR images demonstrate the improvement in visual and statistical performance comparing to the state-of-the-art despeckling algorithms. © 2020 IEEE.
...
