Investigating the psychometric properties of the Suicide Stroop task

Wilson, K. M., Millner, A. J., Auerbach, R. P., Glenn, C. R., Kearns, J. C., Kirtley, O. J., Najmi, S., O'Connor, R. C. , Stewart, J. G. and Cha, C. B. (2019) Investigating the psychometric properties of the Suicide Stroop task. Psychological Assessment, 31(8), pp. 1052-1061. (doi: 10.1037/pas0000723) (PMID:31070448)

Abstract

Behavioral measures are increasingly used to assess suicidal thoughts and behaviors. Some measures, such as the Suicide Stroop Task, have yielded mixed findings in the literature. An understudied feature of these behavioral measures has been their psychometric properties, which may affect the probability of detecting significant effects and reproducibility. In the largest investigation of its kind, we tested the internal consistency and concurrent validity of the Suicide Stroop Task in its current form, drawing from seven separate studies (N = 875 participants, 64% female, aged 12 to 81 years). Results indicated that the most common Suicide Stroop scoring approach, interference scores, yielded unacceptably low internal consistency (rs = -.09-.13) and failed to demonstrate concurrent validity. Internal consistency coefficients for mean reaction times (RTs) to each stimulus type ranged from rs = .93-.94. All scoring approaches for suicide-related interference demonstrated poor classification accuracy (AUCs = .52-.56) indicating that scores performed near chance in their ability to classify suicide attempters from nonattempters. In the case of mean RTs, we did not find evidence for concurrent validity despite our excellent reliability findings, highlighting that reliability does not guarantee a measure is clinically useful. These results are discussed in the context of the wider implications for testing and reporting psychometric properties of behavioral measures in mental health research.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: O'Connor, Professor Rory
• Authors: Wilson, K. M., Millner, A. J., Auerbach, R. P., Glenn, C. R., Kearns, J. C., Kirtley, O. J., Najmi, S., O'Connor, R. C., Stewart, J. G., and Cha, C. B.
• College/School: College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > Mental Health and Wellbeing
• Journal Name: Psychological Assessment
• Publisher: American Psychological Association
• ISSN: 1040-3590
• ISSN (Online): 1939-134X
• Published Online: 09 May 2019
• Copyright Holders: Copyright © 2019 APA
• First Published: First published in Psychological Assessment 31(8):1052-1061
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher