Exploring Gender Biases in Information Retrieval Relevance Judgement Datasets

Amin Bigdeli, Negar Arabzadeh, Morteza Zihayat, Ebrahim Bagheri
January 2021

Abstract

This paper explores gender biases in information retrieval relevance judgement datasets, contributing to fair and unbiased evaluation practices.

Type
Conference paper
Publication
European Conference on Information Retrieval (ECIR)

This work investigates gender biases in information retrieval evaluation datasets.

Gender Bias Information Retrieval Relevance Judgements Bias Detection Fair Evaluation
Morteza Zihayat
Morteza Zihayat
Principal Investigator

Dr. Morteza Zihayat is a Canada Research Chair (CRC) in Human-Centered AI and Associate Professor at Toronto Metropolitan University, Faculty of Engineering and Architectural Science. He also holds appointments as Adjunct Associate Professor at the University of Waterloo (Management Sciences) and IBM Faculty Fellow at IBM Centre for Advanced Studies. He is the Director of the Human-Centered Machine Intelligence Lab.