Offloading KV Cache to Secondary Memory: A Three-Tier Hierarchy Emulator using vLLMChen WangMengmei Yeet al.2026PyTorch Conference 2026Poster
Spyre: An inference-optimized scalable AI accelerator for enterprise workloadsMatt CohenMonodeep Karet al.2026ISSCC 2026Conference paper