Proposed Guidelines for the Responsible Use of Explainable Machine Learning. (2019-06-08T00:00:00.000000Z)

TL;DR

This short text presents internal definitions and a few examples before covering the proposed guidelines for explainable ML, and concludes with a seemingly natural argument for the use of interpretable models and explanatory, debugging, and disparate impact testing methods in life- or mission-critical ML systems.

Abstract

Explainable machine learning (ML) enables human learning from ML, human appeal of automated model decisions, regulatory compliance, and security audits of ML models. Explainable ML (i.e. explainable artificial intelligence or XAI) has been implemented in numerous open source and commercial packages and explainable ML is also an important, mandatory, or embedded aspect of commercial predictive modeling in industries like financial services. However, like many technologies, explainable ML can be misused, particularly as a faulty safeguard for harmful black-boxes, e.g. fairwashing or scaffolding, and for other malevolent purposes like stealing models and sensitive training data. To promote best-practice discussions for this already in-flight technology, this short text presents internal definitions and a few examples before covering the proposed guidelines. This text concludes with a seemingly natural argument for the use of interpretable models and explanatory, debugging, and disparate impact testing methods in life- or mission-critical ML systems.

Authors

Patrick Hall

1 papers

Navdeep Gill

1 papers

N. Schmidt

1 papers

TL;DR

Abstract

Authors

References56 items

Interpretable Machine Learning

Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods

How can we fool LIME and SHAP? Adversarial Attacks on Post hoc Explanation Methods

Privacy Risks of Explaining Machine Learning Models

Quantifying Interpretability of Arbitrary Machine Learning Models Through Functional Decomposition

Quantifying Model Complexity via Functional Decomposition for Better Post-hoc Interpretability

SAFE ML: Surrogate Assisted Feature Extraction for Model Learning

Assessing the Local Interpretability of Machine Learning Models

Fairwashing: the risk of rationalization

Definitions, methods, and applications in interpretable machine learning

Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead

Please Stop Explaining Black Box Models for High Stakes Decisions

On the Art and Science of Machine Learning Explanations

Explainable Neural Networks based on Additive Index Models

Locally Interpretable Models and Effects based on Supervised Partitioning (LIME-SUP)

Explaining Explanations: An Approach to Evaluating Interpretability of Machine Learning

Explaining Explanations: An Overview of Interpretability of Machine Learning

Verifiable Reinforcement Learning via Policy Extraction

Consistent Individualized Feature Attribution for Tree Ensembles

A Survey of Methods for Explaining Black Box Models

Mitigating Unwanted Biases with Adversarial Learning

Towards better understanding of gradient-based attribution methods for Deep Neural Networks

Challenges for Transparency

Interpreting Blackbox Models via Model Extraction

A Unified Approach to Interpreting Model Predictions

Towards A Rigorous Science of Interpretable Machine Learning

Visualizing the effects of predictor variables in black box supervised learning models

Membership Inference Attacks Against Machine Learning Models

Equality of Opportunity in Supervised Learning

False Positives, False Negatives, and False Analyses: A Rejoinder to "Machine Bias: There's Software Used across the Country to Predict Future Criminals. and It's Biased against Blacks"

Stealing Machine Learning Models via Prediction APIs

The mythos of model interpretability

Scalable Bayesian Rule Lists

“Why Should I Trust You?”: Explaining the Predictions of Any Classifier

ModelTracker: Redesigning Performance Analysis Tools for Machine Learning

Supersparse linear integer models for optimized medical scoring systems

Certifying and Removing Disparate Impact

Deep neural networks are easily fooled: High confidence predictions for unrecognizable images

Intriguing properties of neural networks

Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual Conditional Expectation

Accurate intelligible models with pairwise interactions

Data preprocessing techniques for classification without discrimination

Fairness through awareness

An Efficient Explanation of Individual Classifications using Game Theory

Fair Attribution of Functional Contribution in Artificial and Biological Networks

The Elements of Statistical Learning

Analysis of regression in game theory approach

Transparency: Motivations and Challenges

Fairness and Machine Learning. fairmlbook.org

Interpretability. Fast Forward Labs, 2017

Fast Forward Labs

Machine Bias: There’s Software Used Across the Country to Predict Future Criminals

The Elements of Statistical Learning: Data Mining, Inference, and Prediction

The Shapley Value

in Advances in Neural Information Processing

Fraud Detection using Predictive Modeling

Field of Study

Journal Information

Name