https://blog.lmcache.ai/2025-04-29-pdbench/

[giscus[bot]]

https://blog.lmcache.ai/2025-04-29-pdbench/

TL;DR: In our previous blog, we introduced LMCache’s integration with vLLM v1 and NVIDIA’s NIXL used in Dynamo, enabling Prefill-Decode Disaggregation (PD) for LLM inference. Today, we’re excited to share benchmark results that confirm this system achieves state-of-the-art PD performance, balancing time-to-first-token (TTFT) and inter-token latency (ITL) with unprecedented consistency....

https://blog.lmcache.ai/2025-04-29-pdbench/