Selected Publications
For a complete list see my Google Scholar profile
VkD: Improving Knowledge Distillation using Orthogonal Projections
Roy Miles, Ismail Elezi and Jiankang Deng
In CVPR 2024
Understanding the Role of the Projector in Knowledge Distillation
Roy Miles and Krystian Mikolajczyk
In AAAI 2024
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation
Roy Miles, Mehmet Kerim Yucel, Bruno Manganelli and Albert Saa-Garriga
In CVPR 2023
Reconstructing Pruned Filters using Cheap Spatial Transformations
Roy Miles and Krystian Mikolajczyk
In ICCVW 2023
Information Theoretic Representation Distillation
Roy Miles, Adrian Lopez Rodriguez and Krystian Mikolajczyk
In BMVC 2022
Compression of descriptor models for mobile applications
Roy Miles and Krystian Mikolajczyk
In ICASSP 2021
Cascaded channel pruning using hierarchical self-distillation
Roy Miles and Krystian Mikolajczyk
In BMVC 2020