llm-d 1.0 hardens open-source AI inference for day 2 production operations
Release
Peter Hess
Blog
1 result for Archit Patke
IBM and UIUC develop an orchestration system to serve LLMs more efficiently
Technical noteArchit Patke, Saurabh Jha, and Chandra Narayanaswami