QuALITY: Question Answering with Long Input Texts, Yes!
Introduces QuALITY, a long-text (≈5000 words) multiple-choice QA dataset, with models achieving only 55.4% accuracy versus 93.5% by humans.
Richard Yuanzhe Pang, Alicia Parrish, Nitish Joshi et al.