AberHu / Knowledge-Distillation-Zoo Star 1.8k Code Issues Pull requests Pytorch implementation of various Knowledge Distillation (KD) methods. knowledge-distillation teacher-student knowledge-transfer model-compression distillation kd kd-methods Updated Nov 25, 2021 Python
ardaerendogru / dinov2_distillation Star 11 Code Issues Pull requests This project implements knowledge distillation from DINOv2 (Vision Transformer) to convolutional networks, enabling efficient visual representation learning with reduced computational requirements. knowledge-distillation teacher-student knowledge-transfer model-compression distillation kd kd-methods dinov2 Updated Jul 30, 2025 Python
xcode911 / distill Star 3 Code Issues Pull requests Compress command outputs to reduce token use by up to 99% while preserving essential information for language models. laravel deep-neural-networks webpack computer-vision deep-learning packaging transfer-learning semantic-segmentation codex co-training ncnn distillation yolov5 distillation-model model-distillation mobile-yolov5s kd-methods iclr2022 Updated Sep 1, 2026 TypeScript