A survey on datasets for fairness‐aware machine learning (2021-10-01T00:00:00.000000Z)

TL;DR

This paper overviews real‐world datasets used for fairness‐aware ML by identifying relationships between the different attributes, particularly with respect to protected attributes and class attribute, using a Bayesian network.

Abstract

As decision‐making increasingly relies on machine learning (ML) and (big) data, the issue of fairness in data‐driven artificial intelligence systems is receiving increasing attention from both research and industry. A large variety of fairness‐aware ML solutions have been proposed which involve fairness‐related interventions in the data, learning algorithms, and/or model outputs. However, a vital part of proposing new approaches is evaluating them empirically on benchmark datasets that represent realistic and diverse settings. Therefore, in this paper, we overview real‐world datasets used for fairness‐aware ML. We focus on tabular data as the most common data representation for fairness‐aware ML. We start our analysis by identifying relationships between the different attributes, particularly with respect to protected attributes and class attribute, using a Bayesian network. For a deeper understanding of bias in the datasets, we investigate interesting relationships using exploratory analysis.

Authors

Tai Le Quy

1 papers

Arjun Roy

1 papers

Vasileios Iosifidis

1 papers

TL;DR

Abstract

Authors

References161 items

Longitudinal Fairness with Censorship

Fair Decision-making Under Uncertainty

FARF: A Fair and Adaptive Random Forests Classifier

Retiring Adult: New Datasets for Fair Machine Learning

Minimax Group Fairness: Algorithms and Experiments

Variational Fair Clustering

Effect of Information Presentation on Fairness Perceptions of Machine Learning Predictors

Fair-Capacitated Clustering

Fairness in rankings and recommendations: an overview

Consequence-aware Sequential Counterfactual Generation

Learning to Generate Fair Clusters from Demonstrations

Making Artificial Intelligence Transparent: Fairness and the Problem of Proxy Variables

Data and its (dis)contents: A survey of dataset development and use in machine learning research

The Crucial Role of Sensitive Attributes in Fair Classification

How Do Fair Decisions Fare in Long-term Qualification?

Making Fair ML Software using Trustworthy Explanation

Minimax Pareto Fairness: A Multi Objective Perspective

How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness

Fair Clustering via Equitable Group Representations

Probabilistic Fair Clustering

Algorithmic Decision Making with Conditional Fairness

Fairness without Demographics through Adversarially Reweighted Learning

Fair Outlier Detection

FairNN- Conjoint Learning of Fair Representations for Fair Decisions

Fairway: a way to build fair ML software

Fair regression via plug-in estimator and recalibration with statistical guarantees

Learning Certified Individually Fair Representations

(Individual) Fairness for k-Clustering

Bias in data‐driven artificial intelligence systems—An introductory survey

Fairness is not static: deeper understanding of long term fairness via simulation studies

Algorithmic Fairness

FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventions

Fair Adversarial Gradient Tree Boosting

On Fairness-Aware Learning for Non-discriminative Decision-Making

Fairness in Clustering with Multiple Sensitive Attributes

AdaFair: Cumulative Fairness Adaptive Boosting

Fairness warnings and fair-MAML: learning fairly with minimal data

A Survey on Bias and Fairness in Machine Learning

Fairness in Deep Learning: A Computational Perspective

FairSight: Visual Analytics for Fairness in Decision Making

FAHT: An Adaptive Fairness-aware Decision Tree Classifier

Operationalizing Individual Fairness with Pairwise Fair Representations

Time-to-Event Prediction with Neural Networks and Cox Regression

Coresets for Clustering with Fairness Constraints

Pairwise Fairness for Ranking and Regression

Learning Fair Naive Bayes Classifiers by Discovering and Eliminating Discrimination Patterns

Subgroup identification for precision medicine: A comparative review of 13 methods

Average Individual Fairness: Algorithms, Generalization and Experiments

Evaluating the Fairness of Predictive Student Models Through Slicing Analysis

Scalable Fair Clustering

A Framework for Benchmarking Discrimination-Aware Models in Machine Learning

Algorithms for Fairness in Sequential Decision Making

Fair Algorithms for Clustering

Taking Advantage of Multitask Learning for Fair Classification

Hunting for Discriminatory Proxies in Linear Regression Models

Fairness through Causal Awareness: Learning Causal Latent-Variable Models for Biased Data

An Empirical Study of Rich Subgroup Fairness for Machine Learning

Multicalibration: Calibration for the (Computationally-Identifiable) Masses

Preventing Disparate Treatment in Sequential Decision Making

Fairness Behind a Veil of Ignorance: A Welfare Analysis for Automated Decision Making

Fairness Definitions Explained

Beyond Distributive Fairness in Algorithmic Decision Making: Feature Selection for Procedurally Fair Learning

Adaptive Sensitive Reweighting to Mitigate Bias in Fairness-aware Classification

Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods

Delayed Impact of Fair Machine Learning

A Reductions Approach to Fair Classification

Fair Clustering Through Fairlets

A comparative study of fairness-enhancing interventions in machine learning

Mitigating Unwanted Biases with Adversarial Learning

Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification

Recycling Privileged Learning and Distribution Matching for Fairness

When Worlds Collide: Integrating Different Counterfactual Assumptions in Fairness

Open University Learning Analytics dataset

Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness

Proxy Non-Discrimination in Data-Driven Systems

Penalizing Unfairness in Binary Classification