llm-d 1.0 hardens open-source AI inference for day 2 production operationsReleasePeter Hess20 Oct 2026AIAI for CodeDistributed InferenceGenerative AIOpen Source
Improving Hugging Face training efficiency through packing with flash attentionTechnical noteRhui Dih Lee, Arthur Zucker, Achintya Kundu, Laura Wynter, Raghu Ganti, and Mayank Mishra28 Aug 2024AI