Bayesian hierarchical mixture models for detecting non-normal clusters applied to noisy genomic and environmental datasets

Zhang, H., Swallow, B. and Gupta, M. (2022) Bayesian hierarchical mixture models for detecting non-normal clusters applied to noisy genomic and environmental datasets. Australian and New Zealand Journal of Statistics, 64(2), pp. 313-337. (doi: 10.1111/anzs.12370)

Abstract

Clustering to find subgroups with common features is often a necessary first step in the statistical modelling and analysis of large and complex datasets. Although follow-up analyses often make use of complex statistical models that are appropriate for the specific application, most popular clustering approaches are either nonparametric, or based on Gaussian mixture models and their variants, often for reasons of computational efficiency. Certain characteristics in the data, such as the presence of outliers, or non-ellipsoidal cluster shapes, that are common in modern scientific datasets, often lead these methods to fail to detect the cluster components accurately. In this article, we present two efficient and robust Bayesian clustering approaches that seek to overcome these limitations—a model-based ‘tight’ clustering approach to cluster points in the presence of outliers, and a hierarchical Laplace mixture-based approach to cluster heavy-tailed and otherwise non-normal cluster components—and illustrate their power and accuracy in detecting meaningful clusters in datasets from genomics, imaging and the environmental sciences.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Zhang, Miss Huizi and Swallow, Dr Ben and Gupta, Professor Mayetri
• Authors: Zhang, H., Swallow, B., and Gupta, M.
• College/School: College of Science and Engineering > School of Mathematics and Statistics; College of Science and Engineering > School of Mathematics and Statistics > Statistics
• Journal Name: Australian and New Zealand Journal of Statistics
• Publisher: Wiley
• ISSN: 1369-1473
• ISSN (Online): 1467-842X
• Published Online: 01 August 2022
• Copyright Holders: Copyright © 2022 Australian Statistical Publishing Association Inc.
• First Published: First published in Australian and New Zealand Journal of Statistics 64(2):313-337
• Publisher Policy: Reproduced under a Creative Commons License