KD loss: Enhancing discriminability of features with kernel trick for object detection in VHR remote sensing images

Xi CHEN, Liyue LI, Zhihong LI, Min LIU, Qingli LI, Honggang QI, Dongliang MA, Ying WEN, Guitao CAO, Leung Ho Philip YU

Research output: Contribution to journalArticlespeer-review

1 Citation (Scopus)

Abstract

The classification accuracy of the object detection relies on the network's ability to learn discriminative features on very high resolution (VHR) remote sensing images. Popular optimization of the feature representation is implemented with loss functions by minimizing intra-class distance and maximizing inter-class distance in the original feature space. However, existing loss functions may be insufficient in capturing the complex nonlinear relationships inherent in the data, requiring further improvement to achieve accurate classification. To address this issue, we propose a new loss function, referred to as the kernel-based discriminative loss (KD loss), by constructing weight term using the kernel trick and applying them to re-weight the softmax cross-entropy loss. Specifically, the KD loss maps the class centers of deep features to the Hilbert space and calculates the distance between each class center using the Mercer kernel. Besides, the KD loss also employs kernel function to learn the similarity between the deep features and their corresponding class center, thereby facilitating the model in acquiring more discriminative and class-specific feature representations. Compared to existing loss functions, the KD loss improves the feature discriminability in the high-dimensional Hilbert space for the first time. Extensive experiments on the DOTA and RSOD datasets demonstrate that the KD loss can significantly improve the performance of VHR remote sensing object detection. Copyright © 2023 Elsevier Ltd. All rights reserved.

Original languageEnglish
Article number107641
JournalEngineering Applications of Artificial Intelligence
Volume129
Early online dateDec 2023
DOIs
Publication statusPublished - Mar 2024

Citation

Chen, X., Li, L., Li, Z., Liu, M., Li, Q., Qi, H., Ma, D., Wen, Y., Cao, G., & Yu, P. L. H. (2024). KD loss: Enhancing discriminability of features with kernel trick for object detection in VHR remote sensing images. Engineering Applications of Artificial Intelligence, 129, Article 107641. https://doi.org/10.1016/j.engappai.2023.107641

Fingerprint

Dive into the research topics of 'KD loss: Enhancing discriminability of features with kernel trick for object detection in VHR remote sensing images'. Together they form a unique fingerprint.