Systematic errors in estimation of gravitational-wave candidate significance

Capano, C., Dent, T., Hanna, C., Hendry, M. , Messenger, C. , Hu, Y.-M. and Veitch, J. (2017) Systematic errors in estimation of gravitational-wave candidate significance. Physical Review D, 96(8), 082002. (doi: 10.1103/PhysRevD.96.082002)

152680.pdf - Accepted Version



The statistical significance of a candidate gravitational-wave (GW) event is crucial to the prospects for a confirmed detection, or for its selection as a candidate for follow-up electromagnetic observation. To determine the significance of a GW candidate, a ranking statistic is evaluated and compared to an empirically-estimated background distribution, yielding a false alarm probability or p -value. The reliability of this background estimate is limited by the number of background samples and by the fact that GW detectors cannot be shielded from signals, making it impossible to identify a pure background data set. Different strategies have been proposed: in one method, all samples, including potential signals, are included in the background estimation, whereas in another method, coincidence removal is performed in order to exclude possible signals from the estimated background. Here we report on a mock data challenge, performed prior to the first detections of GW signals by Advanced LIGO, to compare these two methods. The all-samples method is found to be self-consistent in terms of the rate of false positive detection claims, but its p -value estimates are systematically conservative and subject to higher variance. Conversely, the coincidence-removal method yields a mean-unbiased estimate of the p -value but sacrifices self-consistency. We provide a simple formula for the uncertainty in estimate significance and compare it to mock data results. Finally, we discuss the use of different methods in claiming the detection of GW signals.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Messenger, Dr Christopher and Veitch, Dr John and Hu, Mr Yiming and Hendry, Professor Martin
Authors: Capano, C., Dent, T., Hanna, C., Hendry, M., Messenger, C., Hu, Y.-M., and Veitch, J.
College/School:College of Science and Engineering > School of Physics and Astronomy
Research Centre:College of Science and Engineering > School of Physics and Astronomy > Institute for Gravitational Research
Journal Name:Physical Review D
Publisher:American Physical Society
ISSN (Online):2470-0029
Published Online:13 October 2017
Copyright Holders:Copyright © 2017 The AuthorsAmerican Physical Society
First Published:First published in Physical Review D 96(8):082002
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher.

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
624341Investigations in Gravitational Radiation / Particle Astrophysics Capital equipmentSheila RowanScience & Technology Facilities Council (STFC)ST/L000946/1S&E P&A - PHYSICS & ASTRONOMY