Pinned Loading

1. turboderp-org/exllamav3 turboderp-org/exllamav3 Public

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python 692 70

2. turboderp-org/exllamav2 turboderp-org/exllamav2 Public

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python 4.5k 328

3. theroyallab/tabbyAPI theroyallab/tabbyAPI Public

   The official API server for Exllama. OAI compatible, lightweight, and fast.

   Python 1.2k 144

4. turboderp-org/exui turboderp-org/exui Public

   Web UI for ExLlamaV2

   JavaScript 510 46