Development of guidance for feasibility studies to decide whether and how to proceed to full-scale evaluation of complex public health interventions: a systematic review

Craig, P. et al. (2018) Development of guidance for feasibility studies to decide whether and how to proceed to full-scale evaluation of complex public health interventions: a systematic review. The Lancet 392(S2):S7. Meeting abstract: Public Health Science 2018, Belfast, Northern Ireland, 23 Nov 2018. (doi: 10.1016/s0140-6736(18)32265-7)

Full text not currently available from Enlighten.

Abstract

Background: The importance of feasibility studies (also referred to as exploratory or pilot studies) for optimising complex public health interventions and evaluation designs before evaluating effectiveness is widely acknowledged. In a systematic review of guidance on feasibility studies, we found that guidance is lacking or inconsistent on many aspects of their purpose, design, and conduct, and that it is lacking on the evidence needed to inform decisions about when to proceed to an effectiveness study. This work, building on that review, aimed to develop guidance for researchers, peer reviewers, and funders. Methods: The systematic review was followed by a three-round web-based, Delphi exercise. We identified novel approaches to intervention optimisation and study designs from beyond public health through a scoping review and qualitative interviews with 15 experts in intervention design and evaluation. We discussed key aspects of the draft guidance with evaluation design specialists, funders, and journal editors in a consensus workshop (n=30), and we revised the guidance accordingly. The review is registered with PROSPERO, number CRD42016047843. Findings: Our systematic review had identified 25 unique sets of guidance. The Delphi identified consensus on many aspects of feasibility study methodology, but disagreement on others, including terminology, how feasibility study data can inform decisions about sample size, how progression criteria should be set, and how progression decisions should be made. A number of study designs typically used in clinical studies (eg, n of 1), digital health (eg, A–B testing), and engineering (eg, fractional factorial designs) have the potential to be applied more widely in feasibility studies of complex public health interventions—for example, to optimise interventions or to explore variation in intervention effects. Interpretation: The guidance will help researchers to develop and conduct feasibility studies, and take appropriate decisions on progression to an effectiveness study. It will provide peer reviewers and research funders with objective criteria against which to assess bids and publications. Study limitations include a lower response from less experienced researchers than from more experienced research methodologists in the Delphi exercise. The systematic review of guidance covered seven health-related bibliographic databases but might have missed guidance from other areas of social intervention research.

Item Type:Conference or Workshop Item
Additional Information:Funding: Medical Research Council (MRC)/National Institute of Health Research (NIHR) Methodology Research Panel (MR/N015843/1). LM, SAS, DW, and AM are supported by the UK MRC (MC_UU_12017/14) and the Chief Scientist Office (SPHSU14). SAS is also supported by a MRC Strategic Award (MC-PC-13027). PC is supported by the UK MRC (MC_UU_12017/15) and the Chief Scientist Office (SPHSU15). MR is supported by Health and Care Research Wales.
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Wight, Professor Daniel and Martin, Dr Anne and Moore, Professor Laurence and Browne, Dr Susan and Craig, Professor Peter and Simpson, Professor Sharon
Authors: Craig, P., Martin, A., Browne, S., Simpson, S. A., Wight, D., Robling, M., Moore, G., Hallingberg, B., Segrott, J., Turley, R., Murphy, S., and Moore, L.
College/School:College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > General Practice and Primary Care
College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > MRC/CSO SPHSU
Journal Name:The Lancet
Publisher:Elsevier BV
ISSN:0140-6736

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
727661Complexity in Health ImprovementLaurence MooreMedical Research Council (MRC)MC_UU_12017/14HW - MRC/CSO Social and Public Health Sciences Unit
727671Informing Healthy Public PolicyPeter CraigMedical Research Council (MRC)MC_UU_12017/15HW - MRC/CSO Social and Public Health Sciences Unit
620221MRC SPHSU/GU Transfer FellowshipsLaurence MooreMedical Research Council (MRC)MC_PC_13027IHW - MRC/CSO SPHU
727661Complexity in Health ImprovementLaurence MooreOffice of the Chief Scientific Adviser (CSO)SPHSU14HW - MRC/CSO Social and Public Health Sciences Unit
727671Informing Healthy Public PolicyPeter CraigOffice of the Chief Scientific Adviser (CSO)SPHSU15HW - MRC/CSO Social and Public Health Sciences Unit