ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs
- Irene Huang
- Wei Lin
- et al.
- 2024
- NeurIPS 2024
Publications
Date
Featured collections
Popular topics
- Foundation Models
601 results for Foundation Models
Efficient multi-prompt evaluation of LLMs
- Felipe Maia Polo
- Ronald Xu
- et al.
- 2024
- NeurIPS 2024
Optimizing GPU Multiplexing for Efficient and Cost-Effective Access to Diverse Large Language Models in GPU Clusters
- Yue Zhu
- Chen Wang
- et al.
- 2024
- MASCOTS 2024
Why Don’t Prompt-Based Fairness Metrics Correlate?
- Abdelrahman Zayed
- Gonçalo Mordido
- et al.
- 2024
- ACL 2024
tinyBenchmarks: evaluating LLMs with fewer examples
- Felipe Maia Polo
- Lucas Weber
- et al.
- 2024
- ICML 2024
A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts
- Mohammed Nowaz Rabbani Chowdhury
- Meng Wang
- et al.
- 2024
- ICML 2024
BRAIn: Bayesian Reward-conditioned Amortized INference for natural language generation from feedback
- Gaurav Pandey
- Yatin Nandwani
- et al.
- 2024
- ICML 2024
Asymmetry in Low-Rank Adapters of Foundation Models
- Jiacheng Zhu
- Kristjan Greenewald
- et al.
- 2024
- ICML 2024
Risk Aware Benchmarking of Large Language Models
- Apoorva Nitsure
- Youssef Mroueh
- et al.
- 2024
- ICML 2024
LaMAGIC: Language-Model-based Topology Generation for Analog Integrated Circuits
- Chen-chia Chang
- Yikang Shen
- et al.
- 2024
- ICML 2024