#

distillation

Here are 220 public repositories matching this topic...

IntelLabs / distiller

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

deep-neural-networks jupyter-notebook pytorch regularization pruning quantization group-lasso distillation onnx truncated-svd network-compression pruning-structures early-exit automl-for-compression

Updated Apr 24, 2023
Jupyter Notebook

dkozlov / awesome-knowledge-distillation

Awesome Knowledge Distillation

deep-learning knowledge-distillation teacher-student knowledge-transfer co-training model-compression distillation kd knowldge-distillation distillation-model model-distillation

Updated Jun 10, 2025

FLHonker / Awesome-Knowledge-Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

deep-learning transfer-learning model-compression distillation kd knowldge-distillation

Updated May 30, 2023

tangxyw / RecSysPapers

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

Updated Jun 30, 2025
Python

GMvandeVen / continual-learning

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

deep-learning artificial-neural-networks replay incremental-learning variational-autoencoder generative-models lifelong-learning distillation continual-learning elastic-weight-consolidation replay-through-feedback icarl gradient-episodic-memory class-incremental-learning task-incremental-learning domain-incremental-learning

Updated May 17, 2025
Jupyter Notebook

AberHu / Knowledge-Distillation-Zoo

Pytorch implementation of various Knowledge Distillation (KD) methods.

knowledge-distillation teacher-student knowledge-transfer model-compression distillation kd kd-methods

Updated Nov 25, 2021
Python

airaria / TextBrewer

A PyTorch-based knowledge distillation toolkit for natural language processing

nlp knowledge pytorch bert distillation

Updated May 8, 2023
Python

ViTAE-Transformer / ViTPose

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

deep-learning pytorch pose-estimation mae distillation self-supervised-learning vision-transformer

Updated Jul 24, 2024
Python

PaddlePaddle / PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

sparsity compression detection transformer segmentation pruning quantization nas bert tensorrt distillation ernie yolov5 yolov6 yolov7

Updated Jul 1, 2025
Python

Syencil / mobile-yolov5-pruning-distillation

mobilev2-yolov5s剪枝、蒸馏，支持ncnn，tensorRT部署。ultra-light but better performence！

pruning ncnn distillation yolov5 mobile-yolov5s

Updated Sep 26, 2022
Jupyter Notebook

CLUEbenchmark / CLUEPretrainedModels

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

text-classification corpus dataset chinese semantic-similarity pretrained-models sentence-classification albert bert sentence-analysis distillation sentence-pairs roberta

Updated Jul 8, 2020
Python

lightly-ai / lightly-train

LightlyTrain is the first PyTorch framework to pretrain computer vision models on unlabeled data for industrial applications

python machine-learning computer-vision deep-learning pytorch embeddings pretrained-models self-supervised distillation self-supervised-learning contrastive-learning dinov2

Updated Jul 2, 2025
Python

szq0214 / MEAL-V2

MEAL V2: Boosting Vanilla ResNet-50 to 80%+ Top-1 Accuracy on ImageNet without Tricks. In NeurIPS 2020 workshop.

pytorch imagenet model-architecture compression-algorithm pre-trained meal imagenet-dataset distillation resnet50 mobilenetv3 efficientnet distillation-model

Updated Dec 24, 2021
Python

Tanuki / tanuki.py

Prompt engineering for developers

python ai tdd alignment distillation tanuki pydantic gpt-4 llm chat-gpt gpt-4-api ai-functions

Updated Feb 13, 2024
Python

segmind / distill-sd

Segmind Distilled diffusion

inference knowledge-distillation distillation stable-diffusion

Updated Oct 18, 2023
Python

gojasper / flash-diffusion

⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025 Oral)

super-resolution text-to-image inpainting dit distillation diffusion-models sdxl

Updated Mar 11, 2025
Python

thu-ml / ares

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

nes pca bim benchmark-framework evolutionary spsa boundary adversarial-machine-learning distillation fgsm adversarial-attacks deepfool adversarial-robustness mi-fgsm mmlda hgd

Updated Oct 15, 2023
Python

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/

machine-learning deep-learning artificial-intelligence distillation distillation-model llm llm-agent llm-training llm-inference llm-local

Updated May 14, 2024
Python

huggingface / optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

optimization intel transformers inference pruning quantization distillation onnx openvino diffusers

Updated Jul 2, 2025
Jupyter Notebook

Zhen-Dong / HAWQ

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

pytorch quantization hessian 8-bit model-compression distillation tvm 4-bit mixed-precision tensorcore quantized-neural-networks hardware-aware efficient-neural-networks

Updated May 15, 2023
Python

Improve this page

Add a description, image, and links to the distillation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the distillation topic, visit your repo's landing page and select "manage topics."