Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation. - Kenneth Borup; Lars Nørvang Andersen (NeurIPS, 2021)

Distilling from Similar Tasks for Transfer Learning on a Budget. - Kenneth Borup; Cheng Perng Phoo; Bharath Hariharan (ICCV, 2023)

Self-Distillation for Gaussian Process Regression and Classification. - Kenneth Borup; Lars Nørvang Andersen (CoRR, 2023)

Automatic sleep scoring using patient-specific ensemble models and knowledge distillation for ear-EEG data. - Kenneth Borup; Preben Kidmose; Huy Phan; Kaare B. Mikkelsen (Biomed. Signal Process. Control., 2023)