Systematic reviews of health effects of social interventions: 2. Best available evidence: how low should you go?

Ogilvie, D., Egan, M., Hamilton, V. and Petticrew, M. (2005) Systematic reviews of health effects of social interventions: 2. Best available evidence: how low should you go? Journal of Epidemiology and Community Health, 59(10), pp. 886-892. (doi: 10.1136/jech.2005.034199)

Abstract

Study objective: There is little guidance on how to select the best available evidence of health effects of social interventions. The aim of this paper was to assess the implications of setting particular inclusion criteria for evidence synthesis. Design: Analysis of all relevant studies for one systematic review, followed by sensitivity analysis of the effects of selecting studies based on a two dimensional hierarchy of study design and study population. Setting: Case study of a systematic review of the effectiveness of interventions in promoting a population shift from using cars towards walking and cycling. Main results: The distribution of available evidence was skewed. Population level interventions were less likely than individual level interventions to have been studied using the most rigorous study designs; nearly all of the population level evidence would have been missed if only randomised controlled trials had been included. Examining the studies that were excluded did not change the overall conclusions about effectiveness, but did identify additional categories of intervention such as health walks and parking charges that merit further research, and provided evidence to challenge assumptions about the actual effects of progressive urban transport policies. Conclusions: Unthinking adherence to a hierarchy of study design as a means of selecting studies may reduce the value of evidence synthesis and reinforce an "inverse evidence law" whereby the least is known about the effects of interventions most likely to influence whole populations. Producing generalisable estimates of effect sizes is only one possible objective of evidence synthesis. Mapping the available evidence and uncertainty about effects may also be important.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Petticrew, Dr Mark and Egan, Dr Matthew and Ogilvie, David
• Authors: Ogilvie, D., Egan, M., Hamilton, V., and Petticrew, M.
• Subjects: R Medicine > RA Public aspects of medicine > RA0421 Public health. Hygiene. Preventive Medicine
• College/School: College of Medical Veterinary and Life Sciences > School of Medicine, Dentistry & Nursing > Centre for Population and Health Sciences; College of Medical Veterinary and Life Sciences > School of Health & Wellbeing > MRC/CSO SPHSU
• Journal Name: Journal of Epidemiology and Community Health
• Publisher: BMJ Publishing Group Ltd.
• ISSN: 0143-005X
• Copyright Holders: Copyright © 2005 BMJ Publishing Group Ltd.
• First Published: First published in Journal of Epidemiology and Community Health 59(10):886-892
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher.