Pinned Loading

1. vllm-kvcompress vllm-kvcompress Public

   KV cache compression for high-throughput LLM inference

   Python 154 6

2. tacklebox tacklebox Public

   Improved handling of PyTorch module hooks

   Python 6

3. Syntactically-Constrained-Sampling Syntactically-Constrained-Sampling Public

   LLM sampling method for enforcing syntax adherence in generated output

   Jupyter Notebook 25 1

4. animation-assist-data animation-assist-data Public

   Simple application for downloading and labeling Flickr images with deployment to GCP

   Jupyter Notebook