Semantic interaction learning for fine‐grained vehicle recognition

2021 ◽  
Author(s):  
Jingjing Zhang ◽  
Jingsheng Lei ◽  
Shengying Yang ◽  
Xinqi Yang
Keyword(s):  
Fine Grained ◽  
Vehicle Recognition ◽  
Semantic Interaction

scholarly journals A Viewpoint Aware Multi-Task Learning Framework for Fine-Grained Vehicle Recognition

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 171912-171923
Author(s):  
Qianqiu Chen ◽  
Wei Liu ◽  
Xiaoxia Yu
Keyword(s):  
Fine Grained ◽  
Vehicle Recognition ◽  
Learning Framework ◽  
Task Learning

scholarly journals Hierarchical semantic interaction-based deep hashing network for cross-modal retrieval

2021 ◽  
Vol 7 ◽  
pp. e552
Author(s):  
Shubai Chen ◽  
Song Wu ◽  
Li Wang
Keyword(s):  
High Performance ◽  
Large Scale ◽  
High Efficiency ◽  
Specific Information ◽  
Linear Interaction ◽  
Fine Grained ◽  
Semantic Correlation ◽  
Deep Hashing ◽  
Public Datasets ◽  
Semantic Interaction

Due to the high efficiency of hashing technology and the high abstraction of deep networks, deep hashing has achieved appealing effectiveness and efficiency for large-scale cross-modal retrieval. However, how to efficiently measure the similarity of fine-grained multi-labels for multi-modal data and thoroughly explore the intermediate layers specific information of networks are still two challenges for high-performance cross-modal hashing retrieval. Thus, in this paper, we propose a novel Hierarchical Semantic Interaction-based Deep Hashing Network (HSIDHN) for large-scale cross-modal retrieval. In the proposed HSIDHN, the multi-scale and fusion operations are first applied to each layer of the network. A Bidirectional Bi-linear Interaction (BBI) policy is then designed to achieve the hierarchical semantic interaction among different layers, such that the capability of hash representations can be enhanced. Moreover, a dual-similarity measurement (“hard” similarity and “soft” similarity) is designed to calculate the semantic similarity of different modality data, aiming to better preserve the semantic correlation of multi-labels. Extensive experiment results on two large-scale public datasets have shown that the performance of our HSIDHN is competitive to state-of-the-art deep cross-modal hashing methods.

Sign in / Sign up

Export Citation Format

Share Document