The extent and quality of qualitative evidence included in health technology assessments: a review of submissions to NICE and CADTH

Szabo, S. M., Hawkins, N. S. and Germeni, E. (2023) The extent and quality of qualitative evidence included in health technology assessments: a review of submissions to NICE and CADTH. International Journal of Technology Assessment in Health Care, (doi: 10.1017/S0266462323002829) (PMID:38126273) (Early Online Publication)

Abstract

Objectives: Qualitative methods allow in-depth exploration of patient experiences and can provide context for healthcare decision-making. Frameworks for patient-based evidence in health technology assessment (HTA) are expanding; yet, how extensively qualitative methods are currently used is unclear. This review characterized the extent and quality of qualitative data submitted to NICE (National Institute for Health and Care Excellence) and CADTH (Canadian Agency for Drugs and Technologies in Health) for HTA. Methods: NICE and CADTH submissions from 09/2019 to 08/2021 were reviewed. Submission characteristics and features of patient-based evidence included within submissions were extracted. The quality of qualitative reporting was assessed using the CASP checklist. Results: Patient-based evidence was included in 83/107 NICE and 119/124 CADTH submissions. A small proportion of submissions described qualitative data collection (NICE=14; CADTH=24) and analysis (NICE=6; CADTH=9) methods. One-to-one interviews were the most common data collection method, and thematic analysis was exclusively used. Thirty-three percent of NICE submissions scored >7 yes responses on CASP, versus 78 percent of CADTH submissions. Conclusions: Although patient-based evidence was common in the 107 NICE and 124 CADTH submissions reviewed, only 14 NICE and 24 CADTH submissions involved formal qualitative data collection. Use of formal analysis methods was even rarer and reporting tended to be brief. At present, there is little guidance about qualitative evidence most likely to be informative and therefore to potentially impact decision-making. Ensuring, however, that qualitative data are collected and analyzed in a systematic, rigorous way will maximize their usefulness and ensure that patient voices are clearly heard.

• Item Type: Articles
• Status: Early Online Publication
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Szabo, Shelagh and Hawkins, Professor Neil and Germeni, Dr Evi
• Authors: Szabo, S. M., Hawkins, N. S., and Germeni, E.
• College/School: College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > Health Economics and Health Technology Assessment
• Journal Name: International Journal of Technology Assessment in Health Care
• Publisher: Cambridge University Press
• ISSN: 0266-4623
• ISSN (Online): 1471-6348
• Published Online: 21 December 2023
• Copyright Holders: Copyright © 2023 The Authors
• First Published: First published in International Journal of Technology Assessment in Health Care 2023
• Publisher Policy: Reproduced in accordance with the publisher copyright policy