Semi-PKD: Semi-supervised Pseudoknowledge Distillation for saliency prediction
Date
2025
Authors
Termritthikun, C.
Umer, A.
Suwanwimolkul, S.
Lee, I.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
ICT Express, 2025; 11(2):364-370
Statement of Responsibility
Conference Name
Abstract
In saliency prediction, Knowledge Distillation (KD) is leveraged to improve the predictive performance of compact Student Networks. However, the challenge is searching for an optimal teacher–student pair while handling the unavailability of large-scale annotations in the Pseudoknowledge Distillation (PKD). To overcome this challenge, a semi-supervised method is proposed; Semi-PKD. This method involves pseudo-label generation on unlabeled data by a Teacher Network trained using the exponential moving average KD (EMA-KD) method. The EMA-KD method utilizes only the Student Network by acquiring self-knowledge, solving the problem of optimal teacher–student pair selection. Semi-PKD outperforms other state-of-the-art saliency prediction models across various evaluation metrics. The code is available at https://github.com/chakkritte/Semi-PKD.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright 2024 The author(s) (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Access Condition Notes: Under a Creative Commons license