TurboDiffusion: 100–200× Acceleration for Video Diffusion Models

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention

Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching

Discrete Diffusion Forcing (D2F): dLLMs Can Do Faster-Than-AR Inference

[NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising

⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.

KsanaDiT: High-Performance DiT (Diffusion Transformer) Inference Framework for Video & Image Generation

This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"

[CVPR 2026] VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation

The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":

[ICML26] Official Repo for WorldCache: Accelerating World Models for Free via Heterogeneous Token Caching

[ICLR 2026] Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding

Implementation of ICCV 2025 paper "Growing a Twig to Accelerate Large Vision-Language Models".

DepthStream Accelerator: A TensorRT-optimized monocular depth estimation tool with ROS2 integration for C++. It offers high-speed, accurate depth perception, perfect for real-time applications in robotics, autonomous vehicles, and interactive 3D environments.

The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).

Training-free inference acceleration framework for interactive video world models, with tested support for HY-WorldPlay and Matrix-Game-3.0.

a mixed-precision gemm with quantize and reorder kernel.