Katikireddi, S. V. , Egan, M. and Petticrew, M. (2014) How do systematic reviews incorporate risk of bias assessments into the synthesis of evidence? A methodological study. Journal of Epidemiology and Community Health, 69(2), pp. 189-195. (doi: 10.1136/jech-2014-204711) (PMID:25481532) (PMCID:PMC4316857)
|
Text
99572.pdf - Accepted Version Available under License Creative Commons Attribution. 2MB |
Abstract
Background: Systematic reviews (SRs) are expected to critically appraise included studies and privilege those at lowest risk of bias (RoB) in the synthesis. This study examines if and how critical appraisals inform the synthesis and interpretation of evidence in SRs.<p></p> Methods: All SRs published in March–May 2012 in 14 high-ranked medical journals and a sample from the Cochrane library were systematically assessed by two reviewers to determine if and how: critical appraisal was conducted; RoB was summarised at study, domain and review levels; and RoB appraisals informed the synthesis process.<p></p> Results: Of the 59 SRs studied, all except six (90%) conducted a critical appraisal of the included studies, with most using or adapting existing tools. Almost half of the SRs reported critical appraisal in a manner that did not allow readers to determine which studies included in a review were most robust. RoB assessments were not incorporated into synthesis in one-third (20) of the SRs, with their consideration more likely when reviews focused on randomised controlled trials. Common methods for incorporating critical appraisals into the synthesis process were sensitivity analysis, narrative discussion and exclusion of studies at high RoB. Nearly half of the reviews which investigated multiple outcomes and carried out study-level RoB summaries did not consider the potential for RoB to vary across outcomes.<p></p> Conclusions: The conclusions of the SRs, published in major journals, are frequently uninformed by the critical appraisal process, even when conducted. This may be particularly problematic for SRs of public health topics that often draw on diverse study designs.
| Item Type: | Articles |
|---|---|
| Status: | Published |
| Refereed: | Yes |
| Glasgow Author(s) Enlighten ID: | Egan, Dr Matthew and Katikireddi, Professor Vittal and Petticrew, Dr Mark |
| Authors: | Katikireddi, S. V., Egan, M., and Petticrew, M. |
| College/School: | College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > MRC/CSO SPHSU College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > Public Health College of Medical Veterinary and Life Sciences > School of Medicine, Dentistry & Nursing |
| Journal Name: | Journal of Epidemiology and Community Health |
| Publisher: | BMJ Publishing Group |
| ISSN: | 0143-005X |
| ISSN (Online): | 1470-2738 |
| Copyright Holders: | Copyright © 2014 The Authors |
| First Published: | First published in Journal of Epidemiology and Community Health 69(2):189-195 |
| Publisher Policy: | Reproduced under a Creative Commons License |
University Staff: Request a correction | Enlighten Editors: Update this record
Funder and Project Information
Funder and Project Information