MOOR NEWS
Where Should the KV Cache Live? Placement Policies Across GPU, CPU, and SSD for Long-Lived Sessions
Research preprint listed by arXiv CS.AI: “Where Should the KV Cache Live? Placement Policies Across GPU, CPU, and SSD for Long-Lived Sessions”. Review the original paper for the authors’ methods and findings. Sources: 1.