Document Type

Journal Article

Department/Unit

Department of Computer Science

Title

Learning a mixture model for clustering with the completed likelihood minimum message length criterion

Language

English

Abstract

Mixture model based clustering (also simply called model-based clustering hereinafter) consists of fitting a mixture model to data and identifying each cluster with one of its components. This paper tackles the model selection and parameter estimation problems in model-based clustering so as to improve the clustering performance on the data sets whose true kernel distribution functions are not in the family of assumed ones, as well as with inherently overlapped clusters. Being tailored to clustering applications, an effective model selection criterion is first proposed. Unlike most criteria that measure the goodness-of-fit of the model only to generate data, the proposed one also evaluates whether the candidate model provides a reasonable partition for the observed data, which enforces a model with well-separated components. Accordingly, an improved method for the estimation of mixture parameters is derived, which aims to suppress the spurious estimates by the standard expectation maximization (EM) algorithm and enforce well-supported components in the mixture model. Finally, the estimation of mixture parameters and the model selection is integrated in a single algorithm which favors a compact mixture model with both the well-supported and well-separated components. Extensive experiments on synthetic and real-world data sets are carried out to show the effectiveness of the proposed approach to the mixture model based clustering. © 2013 Elsevier Ltd. All rights reserved.

Keywords

Clustering, Completed likelihood, Finite mixture model, Minimum message length, Model selection

Publication Date

2014

Source Publication Title

Pattern Recognition

Volume

47

Issue

5

Start Page

2011

End Page

2030

Publisher

Elsevier

DOI

10.1016/j.patcog.2013.09.036

ISSN (print)

00313203

This document is currently not available here.

Share

COinS