Dealing with Label Switching in Mixture Models

In a Bayesian analysis of finite mixture models, parameter estimation and clustering are sometimes less straightforward than might be expected. In particular, the common practice of estimating parameters by their posterior mean, and summarizing joint posterior distributions by marginal distributions...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:Journal of the Royal Statistical Society. Series B (Statistical Methodology). - Blackwell Publishers. - 62(2000), 4, Seite 795-809
1. Verfasser: Stephens, Matthew (VerfasserIn)
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2000
Zugriff auf das übergeordnete Werk:Journal of the Royal Statistical Society. Series B (Statistical Methodology)
Schlagworte:Bayesian Approach Classification Clustering Identifiability Markov Chain Monte Carlo Methods Mixture Model Multimodal Posterior Mathematics Physical sciences Applied sciences mehr... Information science Behavioral sciences
Beschreibung
Zusammenfassung:In a Bayesian analysis of finite mixture models, parameter estimation and clustering are sometimes less straightforward than might be expected. In particular, the common practice of estimating parameters by their posterior mean, and summarizing joint posterior distributions by marginal distributions, often leads to nonsensical answers. This is due to the so-called 'label switching' problem, which is caused by symmetry in the likelihood of the model parameters. A frequent response to this problem is to remove the symmetry by using artificial identifiability constraints. We demonstrate that this fails in general to solve the problem, and we describe an alternative class of approaches, relabelling algorithms, which arise from attempting to minimize the posterior expected loss under a class of loss functions. We describe in detail one particularly simple and general relabelling algorithm and illustrate its success in dealing with the label switching problem on two examples.
ISSN:14679868