Towards Measuring the Representation of Subjective Global Opinions in Language Models
This paper introduces a quantitative framework using the GlobalOpinionQA dataset to evaluate how well language models represent diverse global opinions, revealing biases and stereotypes.
Esin Durmus, Karina Nguyen, Thomas I. Liao et al.