DC Field | Value | Language |
---|---|---|
dc.contributor.advisor | Moon, Il-Chul | - |
dc.contributor.advisor | 문일철 | - |
dc.contributor.author | Ji, Mingi | - |
dc.date.accessioned | 2023-06-22T19:32:55Z | - |
dc.date.available | 2023-06-22T19:32:55Z | - |
dc.date.issued | 2022 | - |
dc.identifier.uri | http://library.kaist.ac.kr/search/detail/view.do?bibCtrlNo=1007809&flag=dissertation | en_US |
dc.identifier.uri | http://hdl.handle.net/10203/308394 | - |
dc.description | 학위논문(박사) - 한국과학기술원 : 산업및시스템공학과, 2022.8,[vi, 55 p. :] | - |
dc.description.abstract | The performance of models related to visual recognition, such as image classification and object detection, has recently improved with the development of deep learning. However, in order to train a deep learning-based model, a model with many parameters and a large amount of data are required. This thesis examines the knowledge distillation method. First, we proposed an attention-based meta-network which models relationships between the teacher model layers and the student model layers to distill knowledge effectively. We empirically show through experiments that the proposed methodology is more effective than using a heuristic to designate the layer links between the teacher model layers and the student model layers. Second, when using the method of knowledge distillation by the student model itself without a teacher model (self-knowledge distillation), we proposed the novel method which utilizes spatial information. To this end, we introduced an auxiliary network for training by altering the model used in the existing object detection model. | - |
dc.language | eng | - |
dc.publisher | 한국과학기술원 | - |
dc.subject | Transfer learning▼aKnowledge distillation▼aImage classification | - |
dc.subject | 전이 학습▼a모델 증류▼a영상 분류 | - |
dc.title | Feature based knowledge distillation for image recognition | - |
dc.title.alternative | 영상 인식을 위한 피처 기반의 지식 증류 | - |
dc.type | Thesis(Ph.D) | - |
dc.identifier.CNRN | 325007 | - |
dc.description.department | 한국과학기술원 :산업및시스템공학과, | - |
dc.contributor.alternativeauthor | 지민기 | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.