Pinned Loading

1. LLM-from-scratch LLM-from-scratch Public

   Implement a ChatGPT-like LLM in PyTorch from scratch

   Jupyter Notebook

2. llm-observability-pack llm-observability-pack Public

   Ready-to-run observability stack for LLM inference servers (vLLM, Triton) with Prometheus, Grafana dashboards, and load testing scripts

   Python

3. vLLM-ops-lab vLLM-ops-lab Public

   vLLM Ops Lab

   Python

4. pii-llm pii-llm Public

   PII detection/redaction using LLMs. A research project exploring the effectiveness of Large Language Models for detecting Personally Identifiable Information (PII) in text.

   Jupyter Notebook

5. protoai protoai Public

   Python

6. LLM-zero-downtime-update LLM-zero-downtime-update Public

   Kubernetes (Argo Rollouts) implementation for zero-downtime model updates for an LLM serving stack

   Shell