Unsupervised Anomaly Detection for Auditing Data and Impact of Categorical Encodings (2022-10-25T00:00:00.000000Z)

TL;DR

This work compares competitive learning, reconstruction-error, density estimation and contrastive learning approaches for Label, One Hot, GEL encoding and embedding layer to handle categorical values.

Abstract

In this paper, we introduce the Vehicle Claims dataset, consisting of fraudulent insurance claims for automotive repairs. The data belongs to the more broad category of Auditing data, which includes also Journals and Network Intrusion data. Insurance claim data are distinctively different from other auditing data (such as network intrusion data) in their high number of categorical attributes. We tackle the common problem of missing benchmark datasets for anomaly detection: datasets are mostly confidential, and the public tabular datasets do not contain relevant and sufficient categorical attributes. Therefore, a large-sized dataset is created for this purpose and referred to as Vehicle Claims (VC) dataset. The dataset is evaluated on shallow and deep learning methods. Due to the introduction of categorical attributes, we encounter the challenge of encoding them for the large dataset. As One Hot encoding of high cardinal dataset invokes the"curse of dimensionality", we experiment with GEL encoding and embedding layer for representing categorical attributes. Our work compares competitive learning, reconstruction-error, density estimation and contrastive learning approaches for Label, One Hot, GEL encoding and embedding layer to handle categorical values.

Authors

M. Kloft

4 papers

Ajay Chawda

1 papers

S. Grimm

1 papers

TL;DR

Abstract

Authors

References36 items

A Revealing Large-Scale Evaluation of Unsupervised Anomaly Detection Algorithms

Latent Outlier Exposure for Anomaly Detection with Contaminated Data

DVM-CAR: A Large-Scale Automotive Dataset for Visual Marketing Research and Applications

Insurance fraud detection with unsupervised deep learning

Anomaly Detection: How to Artificially Increase your F1-Score with a Biased Evaluation Protocol

Boosted Embeddings for Time Series Forecasting

Neural Transformation Learning for Deep Anomaly Detection Beyond Images

Non-Life Insurance Risk Classification Using Categorical Embedding

Unsupervised anomaly detection for internal auditing: Literature review and research agenda

The Efficacy of Financial Ratios for Fraud Detection Using Self Organising Maps

A Unifying Review of Deep and Shallow Anomaly Detection

Self-Organizing Map assisted Deep Autoencoding Gaussian Mixture Model for Intrusion Detection

AutoEmbedder: A semi-supervised DNN embedding system for clustering

Classification-Based Anomaly Detection for General Data

Robust Subspace Recovery with Adversarial Outliers

Robust Subspace Recovery Layer for Unsupervised Anomaly Detection

Adversarially Learned Anomaly Detection

Generalized Feature Embedding for Supervised, Unsupervised, and Online Learning Tasks

Deep Autoencoding Gaussian Mixture Model for Unsupervised Anomaly Detection

Entity Embedding-Based Anomaly Detection for Heterogeneous Categorical Events

Deep Structured Energy Based Models for Anomaly Detection

Entity Embeddings of Categorical Variables

A survey on unsupervised outlier detection in high‐dimensional numerical data

Isolation Forest

Greedy function approximation: A gradient boosting machine.

Estimating the Support of a High-Dimensional Distribution

LOF: identifying density-based local outliers

The self-organizing map

Multi-scale Self-Organizing Map assisted Deep Autoencoding Gaussian Mixture Model for unsupervised intrusion detection

A Deep-Learned Embedding Technique for Categorical Features Encoding

Causal inference : The mixtape

Kaggle

Vehicle insurance data

MLG-ULB

Random Forests

UCI Repository of machine learning databases

Field of Study

Journal Information

Name

Volume

Venue Information

Name

Type

URL

Alternate Names