llm-d 1.0 hardens open-source AI inference for day 2 production operations
Release
Peter Hess
Blog
2 results for Jungwook Choi
Highly accurate deep learning inference with 2-bit precision
Technical noteJungwook Choi8-bit precision for training deep learning systems
ResearchNaigang Wang