DéjàVu: KV-cache Streaming for Fast, Fault-tolerant Generative LLM Serving

D´ej`aVu proposes efficient solutions to challenges in large-scale LLM serving through KV cache streaming, disaggregation, and fault tolerance mechanisms.