Towards Pareto Optimal Throughput in Small Language Model Serving
- Pol G. Recasens
- Yue Zhu
- et al.
- 2024
- EuroMLSys 2024
Publications
3 results for Eun K. Lee
Characterizing Training Performance and Energy for Foundation Models and Image Classifiers on Multi-Instance GPUs
- Connor Espenshade
- Rachel Peng
- et al.
- 2024
- EuroMLSys 2024
Reducing Datacenter Compute Carbon Footprint by Harnessing the Power of Specialization: Principles, Metrics, Challenges and Opportunities
- Tamar Eilam
- Pradip Bose
- et al.
- 2024
- IEEE Trans Semicond Manuf