A Framework for Deep Constrained Clustering - Algorithms and Advances (2019-01-29T00:00:00.000000Z)

TL;DR

It is shown that this framework can not only handle standard together/apart constraints (without the well documented negative effects reported earlier) generated from labeled side information but more complex constraints generated from new types of side information such as continuous values and high-level domain knowledge.

Abstract

The area of constrained clustering has been extensively explored by researchers and used by practitioners. Constrained clustering formulations exist for popular algorithms such as k-means, mixture models, and spectral clustering but have several limitations. A fundamental strength of deep learning is its flexibility, and here we explore a deep learning framework for constrained clustering and in particular explore how it can extend the field of constrained clustering. We show that our framework can not only handle standard together/apart constraints (without the well documented negative effects reported earlier) generated from labeled side information but more complex constraints generated from new types of side information such as continuous values and high-level domain knowledge.

Authors

Hongjing Zhang

1 papers

Sugato Basu

1 papers

I. Davidson

2 papers

TL;DR

Abstract

Authors

References35 items

Hierarchical Clustering with Structural Constraints

Clustering-Driven Deep Embedding With Pairwise Constraints

SpectralNet: Spectral Clustering using Deep Neural Networks

Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms

Improved Deep Embedded Clustering with Local Structure Preservation

Constrained clustering by constraint programming

Probabilistic Formulations of Regression with Mixed Guidance

Variational Deep Embedding: An Unsupervised and Generative Approach to Clustering

Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering

A Framework for Actionable Clustering Using Constraint Programming

Joint Unsupervised Learning of Deep Representations and Image Clusters

Unsupervised Deep Embedding for Clustering Analysis

Neural network-based clustering using pairwise constraints

FaceNet: A unified embedding for face recognition and clustering

Active Spectral Clustering

Flexible constrained spectral clustering

Rectified Linear Units Improve Restricted Boltzmann Machines

Constrained Clustering: Advances in Algorithms, Theory, and Applications

Constrained spectral clustering through affinity propagation

Intractability and clustering with constraints

Measuring Constraint-Set Utility for Partitional Clustering Algorithms

RCV1: A New Benchmark Collection for Text Categorization Research

A probabilistic framework for semi-supervised clustering

Integrating constraints and metric learning in semi-supervised clustering

Learning a Distance Metric from Relative Comparisons

Document clustering based on non-negative matrix factorization

Optimizing search engines using clickthrough data

Constrained K-means Clustering with Background Knowledge

Clustering with Instance-Level Constraints

Creating a Cluster Hierarchy under Constraints of a Partially Known Hierarchy

Visualizing Data using t-SNE

Distance Metric Learning with Application to Clustering with Side-Information

Impact of Similarity Measures on Web-page Clustering

Gradient-based learning applied to document recognition

Constrained Spectral Clustering through Affinity Propagation

Field of Study