Offloading KV Cache to Secondary Memory: A Three-Tier Hierarchy Emulator using vLLM
- Chen Wang
- Mengmei Ye
- et al.
- 2026
- PyTorch Conference 2026
Poster
Publications
29 results for Hubertus Franke
From Device Passthrough to Host Passout
- Chathura Rajapaksha
- Sandhya Koteshwara
- et al.
- 2026
- NESD 2026
Talkcache_ext: Customizing the Page Cache with eBPF
- Tal Zussman
- Ioannis Zarkadas
- et al.
- 2026
- NESD 2026
TalkVFIO: Very Frightening I/O? Taming Wild Guests and their PCIe Config-Space Abuse
- Chathura Rajapaksha
- Sandhya Koteshwara
- et al.
- 2025
- LPC 2025
TalkAn Expert in Residence: LLM Agents for Always-On Operating System Tuning
- Georgios Liargkovas
- Vahab Jabrayilov
- et al.
- 2025
- NeurIPS 2025
Workshop paperCPU-Limits kill Performance: Time to rethink Resource Control
- Chirag Shetty Shetty
- Sarthak Chakraborty
- et al.
- 2025
- SoCC 2025
Conference paperFrom Device Passthrough to Host Passout: Exploring RAS Risks in {High-Performance, Virtualized} AI-Systems
- Chathura Rajapaksha
- Sandhya Koteshwara
- et al.
- 2025
- OSDI 2025
PosterTransforming The Hybrid Cloud for Emerging AI Workloads
- Deming Chen
- Alaa Youssef
- et al.
- 2024
- arXiv
PapervLLM in Confidential CPU-GPU Enclaves: Does it Perform?
- Mengmei Ye
- Apoorve Mohan
- et al.
- 2024
- AICS 2024
PosterFrom Confidential Computing to Zero Trust, Come Along for the (Bumpy?) Ride
- Mengmei Ye
- Sandhya Koteshwara
- et al.
- 2024
- MICRO 2024
Workshop paper