- Title
- Fine-grained image classification based on knowledge distillation
- Creator
- Liu, Ying; Feng, Hao; Zhang, Weidong; Fang, Jie; Xiao, Peng; Zhang, Dengsheng
- Date
- 2023
- Type
- Text; Conference paper
- Identifier
- http://researchonline.federation.edu.au/vital/access/HandleResolver/1959.17/197029
- Identifier
- vital:18786
- Identifier
-
https://doi.org/10.1109/ICNC-FSKD59587.2023.10280977
- Identifier
- ISBN:9798350304398 (ISBN)
- Abstract
- Despite the outstanding performance of deep learning-based fine-grained image classification methods, the commonly used models still suffer from high cost of computation and memory Therefore, this paper proposes a mobile-based CNN network that focuses on discriminative features of fine-grained images by embedding a hybrid-domain attention module to achieve higher accuracy in recognition. Specifically, under the premise of reducing network parameters, this paper presents a classification method that combines transfer learning and knowledge distillation to enhance the model's generalization performance and resistance to overfitting. Different knowledge transfer strategies are validated through the experiments in the knowledge distillation process. Mobile models such as SqueezeNet, MobileNetV2, and CBAM MobileNetV2 all demonstrate enhanced performance the knowledge distillation optimization. The proposed method in this paper can be used to develop a lightweight mobile-based CNN model with comparable performance to complex models making it more advantageous in real-life scenarios with limited storage resources and low hardware computation levels. Additionally, the model compression process utilizes only the intermediate features of the original dataset, meeting the confidentiality requirements of the original data in the field of public security. © 2023 IEEE.
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Relation
- 19th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2023, Harbin, China, 29-31 July 2023, 2023 19th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)
- Rights
- All metadata describing materials held in, or linked to, the repository is freely available under a CC0 licence
- Rights
- Copyright © 2023 IEEE
- Subject
- Fine-grained images; Image classification; Knowledge distillation; Mobile-based CNN model
- Reviewed
- Hits: 439
- Visitors: 433
- Downloads: 0
| Thumbnail | File | Description | Size | Format |
|---|