Get the latest tech news

Mooncake: A KVCache-Centric Disaggregated Architecture for LLM Serving


Contribute to kvcache-ai/Mooncake development by creating an account on GitHub.

This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of LLM

LLM

Photo of centric

centric

Related news:

News photo

How to think about creating a dataset for LLM fine-tuning evaluation

News photo

Dappier is building a marketplace for publishers to sell their content to LLM builders

News photo

Show HN: FiddleCube – Generate Q&A to test your LLM