Socially Aware Bias Measurements for Hindi Language Representations
TL
TL;DR
This work investigates the biases present in Hindi language representations such as caste and religion associated biases and demonstrates how biases are unique to specific language representations based on the history and culture of the region they are widely spoken in.
Abstract
Language representations are an efficient tool used across NLP, but they are strife with encoded societal biases. These biases are studied extensively, but with a primary focus on English language representations and biases common in the context of Western society. In this work, we investigate the biases present in Hindi language representations such as caste and religion associated biases. We demonstrate how biases are unique to specific language representations based on the history and culture of the region they are widely spoken in, and also how the same societal bias (such as binary gender associated biases) when investigated across languages is encoded by different words and text spans. With this work, we emphasize on the necessity of social-awareness along with linguistic and grammatical artefacts when modeling language representations, in order to understand the biases encoded.
References42 items
1
On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language Representations
2
Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies
3
Detecting Cross-Geographic Biases in Toxicity Modeling on Social Media
4
Gender bias, social bias, and representation: 70 years of BHollywood
5