Pinned Loading

1. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 6.1k 1k

2. madsys-dev/sosp-paper19-ae madsys-dev/sosp-paper19-ae Public

   The Artifact Evaluation Version of SOSP Paper #19

   C++ 54 13

3. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.9k 7.5k

4. izumihanako/LightDSA izumihanako/LightDSA Public

   This is the code repository of paper "LightDSA: Enabling Efficient DSA Through Hardware-Aware Transparent Optimization"

   C++ 5

5. MoonshotAI/checkpoint-engine MoonshotAI/checkpoint-engine Public

   Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

   Python 984 102

6. sgl-project/rbg sgl-project/rbg Public

   A workload for deploying LLM inference services on Kubernetes

   Go 267 69