LMCache on Google Kubernetes Engine: Boosting LLM Inference Performance with KV Cache on Tiered Storage
By Danna Wang, Google
Overview of the Collaboration
[Read More]
-
-
Implementing LMCache Plugin Framework & lmcache_frontend: Design Philosophy
A flexible plugin system for enhanced observability and management
By Baolong, Kobe
Abstract [Read More] -
NVIDIA Dynamo integrates LMCache, Accelerating LLM Inference
By NVIDIA Dynamo team, LMCache teamWe’re thrilled to announce that Nvidia Dynamo has integrated LMCache as a KV caching layer solution. This is a big milestone: Dynamo gets a battle-tested caching solution, and LMCache becomes part of a data center-scale inference platform used by many developers worldwide to deploy AI at scale. [Read More] -
Extending LMCache Backends: A Comprehensive Guide to Custom Backend Development
Learn how to build custom backends for LMCache using the external backend extension mechanism
By Baolong, KobeAbstract [Read More] -
🎉 LMCache Hits 5,000+ GitHub Stars — Thank You, Community!
A milestone that shows KV cache has become a first-class citizen in the LLM inference stack
By LMCache TeamWe’re thrilled to share that LMCache has officially crossed 5,000 GitHub stars! 🚀 This milestone is not just a number — it’s a strong signal that KV cache technology has become a first-class citizen in the LLM inference stack, and that our community is leading the way. [Read More]