Cascaded channel pruning using hierarchical self-distillation. - Roy Miles; Krystian Mikolajczyk (BMVC, 2020)

Compression of convolutional neural networks for high performance imagematching tasks on mobile devices. - Roy Miles; Krystian Mikolajczyk (CoRR, 2020)

Compressing Local Descriptor Models for Mobile Applications. - Roy Miles; Krystian Mikolajczyk (ICASSP, 2021)

Network compression and faster inference using spatial basis filters. - Roy Miles; Krystian Mikolajczyk (CoRR, 2021)

Information Theoretic Representation Distillation. - Roy Miles; Adrián López Rodríguez; Krystian Mikolajczyk (BMVC, 2022)

MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation. - Roy Miles; Mehmet Kerim Yucel; Bruno Manganelli; Albert Saà-Garriga (CVPR, 2023)

Reconstructing Pruned Filters using Cheap Spatial Transformations. - Roy Miles; Krystian Mikolajczyk (ICCV (Workshops), 2023)

A closer look at the training dynamics of knowledge distillation. - Roy Miles; Krystian Mikolajczyk (CoRR, 2023)

Understanding the Role of the Projector in Knowledge Distillation. - Roy Miles; Krystian Mikolajczyk (AAAI, 2024)

Learning to Project for Cross-Task Knowledge Distillation. - Dylan Auty; Roy Miles; Benedikt Kolbeinsson; Krystian Mikolajczyk (BMVC, 2024)

$V_{k}D$: Improving Knowledge Distillation Using Orthogonal Projections. - Roy Miles; Ismail Elezi; Jiankang Deng (CVPR, 2024)

VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections. - Roy Miles; Pradyumna Reddy; Ismail Elezi; Jiankang Deng (NeurIPS, 2024)

VkD: Improving Knowledge Distillation using Orthogonal Projections. - Roy Miles; Ismail Elezi; Jiankang Deng (CoRR, 2024)

Region-based Cluster Discrimination for Visual Representation Learning. - Yin Xie; Kaicheng Yang 002; Xiang An; Kun Wu; Yongle Zhao; Weimo Deng; Zimin Ran; Yumeng Wang; Ziyong Feng; Roy Miles; Ismail Elezi; Jiankang Deng (CoRR, 2025)