An information matrix prior for Bayesian analysis in generalized linear models with high dimensional data

Gupta, M. and Ibrahim, J.G. (2009) An information matrix prior for Bayesian analysis in generalized linear models with high dimensional data. Statistica Sinica, 19(4), pp. 1641-1663.

Abstract

An important challenge in analyzing high dimensional data in regression settings is that of facing a situation in which the number of covariates p in the model greatly exceeds the sample size n (sometimes termed the "p > n" problem). In this article, we develop a novel specification for a general class of prior distributions, called Information Matrix (IM) priors, for high-dimensional generalized linear models. The priors are first developed for settings in which p < n, and then extended to the p > n case by defining a ridge parameter in the prior construction, leading to the Information Matrix Ridge (IMR) prior. The IM and IMR priors are based on a broad generalization of Zellner's g-prior for Gaussian linear models. Various theoretical properties of the prior and implied posterior are derived including existence of the prior and posterior moment generating functions, tail behavior, as well as connections to Gaussian priors and Jeffreys' prior. Several simulation studies and an application to a nucleosomal positioning data set demonstrate its advantages over Gaussian, as well as g-priors, in high dimensional settings.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Gupta, Professor Mayetri
• Authors: Gupta, M., and Ibrahim, J.G.
• College/School: College of Science and Engineering > School of Mathematics and Statistics > Statistics
• Journal Name: Statistica Sinica
• ISSN: 1017-0405