An Internal Validity Index Based on Density-Involved Distance (2019-03-22T00:00:00.000000Z)

TL;DR

A new robust distance measure, one into which density is incorporated, is designed to solve the problem, and an internal validity index based on this separation measure is then proposed, which can cope with both the spherical and non-spherical structure of clusters.

Abstract

It is crucial to evaluate the quality of clustering results in cluster analysis. Although many cluster validity indices (CVIs) have been proposed in the literature, they have some limitations when dealing with non-spherical datasets. One reason is that the measure of cluster separation does not consider the impact of outliers and neighborhood clusters. In this paper, a new robust distance measure, one into which density is incorporated, is designed to solve the problem, and an internal validity index based on this separation measure is then proposed. This index can cope with both the spherical and non-spherical structure of clusters. The experimental results indicate that the proposed index outperforms some classical CVIs.

Authors

Lianyu Hu

2 papers

Caiming Zhong

2 papers

TL;DR

Abstract

Authors

References74 items

Ensemble Methods

A Novel Cluster Validity Index Based on Local Cores

Auto-weighted multi-view clustering via kernelized graph learning

Multiview Consensus Graph Clustering

A novel internal validity index based on the cluster centre and the nearest neighbour cluster

ClusterGAN : Latent Space Clustering in Generative Adversarial Networks

To Cluster, or Not to Cluster: An Analysis of Clusterability Methods

An Improved and More Scalable Evolutionary Approach to Multiobjective Clustering

K-means properties on six clustering benchmark datasets

Dimensionally Distributed Density Estimation

Shared-nearest-neighbor-based clustering by fast search and find of density peaks

Robust clustering using a kNN mode seeking ensemble

Efficiency of random swap clustering

Method for Determining the Optimal Number of Clusters Based on Agglomerative Hierarchical Clustering

New internal index for clustering validation based on graphs

Kernel Clustering: Density Biases and Solutions

An Effective Algorithm Based on Density Clustering Framework

Cluster validity index based on Jeffrey divergence

Density-ratio based clustering for discovering clusters with varying densities

Generalizing Centroid Index to Different Clustering Models

Set Matching Measures for External Cluster Validity

Clustering by Fast Search and Find of Density Peaks

Centroid index: Cluster level similarity measure

WB-index: A sum-of-squares based index for cluster validity

Understanding and Enhancement of Internal Clustering Validation Measures

Towards a standard methodology to evaluate internal cluster validity indices

A graph-theoretical clustering method based on two rounds of minimum spanning trees

Clustering: Science or Art?

Measures of Clustering Quality: A Working Set of Axioms for Clustering

A density-based cluster validity approach using multi-representatives

Application of a New Symmetry-Based Cluster Validity Index for Satellite Image Segmentation

Graph-based consensus clustering for class discovery from gene expression data

Consensus Clusterings

Neighbor search with global geometry: a minimax message passing algorithm

Clustering by Passing Messages Between Data Points

An Evolutionary Approach to Multiobjective Clustering

Fast Agglomerative Clustering Using a k-Nearest Neighbor Graph

Iterative shrinking method for clustering problems

Survey of clustering algorithms

Clustering aggregation

Self-Tuning Spectral Clustering

Stability-Based Validation of Clustering Solutions

A General Approach to Clustering in Large Databases with Noise

Path-Based Clustering for Grouping of Smooth Curves and Texture Segmentation

Performance Evaluation of Some Clustering Algorithms and Validity Indices

On Clustering Validation Techniques

Clustering validity assessment: finding the optimal partitioning of a data set

LOF: identifying density-based local outliers

Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.

Data clustering: a review

OPTICS: ordering points to identify the clustering structure

Algorithms for Mining Distance-Based Outliers in Large Datasets

Some new indexes of cluster validity

Normalized cuts and image segmentation

A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise

An Optimal Graph Theoretic Approach to Data Clustering: Theory and Its Application to Image Segmentation

Silhouettes: a graphical aid to the interpretation and validation of cluster analysis

A Cluster Separation Measure

Enhanced Dominant Sets Clustering by Cluster Expansion

From Partition-Based Clustering to Density-Based Clustering: Fast Find Clusters With Diverse Shapes and Densities in Spatial Databases

K-Means-Based Consensus Clustering: A Unified View

Density-Based Clustering Validation

An extensive comparative study of cluster validity indices

Internal versus External cluster validation indexes

Robust path-based spectral clustering

Multi-Objective Clustering and Cluster Validation

Outlier detection using k-nearest neighbour graph

An Impossibility Theorem for Clustering

A Dynamic local search algorithm for the clustering problem

Cluster Kernels for Semi-Supervised Learning

Learning with labeled and unlabeled dataMatthias

A dendrite method for cluster analysis

Well-Separated Clusters and Optimal Fuzzy Partitions

Graph-Theoretical Methods for Detecting and Describing Gestalt Clusters

Field of Study

Journal Information