UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor
Proposes UMBRELA, an open-source toolkit using GPT-4 for automatic relevance assessment, showing high correlation with human judgments.
Shivani Upadhyay, Ronak Pradeep, Nandan Thakur et al.