Systematic Reviews and Research

David Gough is a Professor of Evidence Informed Policy and Practice, and Director of the EPPI-Centre, University College London. His early research focused on child protection services. For the last 20 years, he has concentrated on methods of research synthesis including a DfE centre on evidence informed education, a node of the ESRC National Centre for Research Methods, and a methods unit for NICE. His research on “research use” include the European Commission EIPPEE network, the Science of Using Science review for the Wellcome Trust, the experimental evaluation of the RISE project to encourage evidence use in schools, a study of the UK what works centres for ESRC, and a study of evidence standards in web evidence portals for the Centre for Homelessness Impact. He is a coinvestigator for DfID’s CEDIL project on developing evaluation methodology in international development. He was the comanaging editor of the journal Evidence and Policy from 2009 to 2017.Sandy Oliver is Professor of Public Policy at UCL Institute of Education and Deputy Director of SSRU and its EPPI-Centre. For twenty five years her interests have focused on the interaction between researchers and people making decisions in their professional and personal lives. With this in mind she has been developing methods to collate knowledge from whole bodies of research – systematic reviews – not just single studies. Most recently this has been in the area of international development where she has conducted systematic reviews and built up a programme of support for research teams conducting reviews elsewhere. She works with DFID and the Alliance for Health Policy and Systems Research at WHO to build capacity in systematic reviewing in developing countries.James Thomas is a Professor in Social Policy, Assistant Director of SSRU and Associate Director of the EPPI-Centre He directs the EPPI-Centre′s Reviews Facility for the Department of Health, England, and undertakes systematic reviews across a range of policy areas. He has specialized in developing methods for research synthesis, in particular for qualitative and mixed methods reviews and in using emerging information technologies in research. He leads a module on synthesis and critical appraisal on the EPPI-Centre′s MSc in Evidence for Public Policy and Practice and development on the Centre′s in-house reviewing software, EPPI-Reviewer.

• VOLUME ONE: AIMS, STRATEGIES, PERSPECTIVES AND CONTEXTSIntroduction - S. Oliver, J. Thomas and D. GoughPart One: Aims of Research SynthesisA Brief History of Research Synthesis - Iain Chalmers, Larry Hedges and Harris CooperContextualizing the Twin Concepts of Systematicity and Transparency in Information Systems Literature Reviews - Guy Pare et al.Formalization and Separation: A Systematic Basis for Interpreting Approaches to Summarizing Science for Climate Policy - Bohlin Sundqvist et alThe Meta-Analytic Big Bang - William Shadish and Jesse LecyHow to Increase Value and Reduce Waste When Research Priorities Are Set - Iain Chalmers et al.The Politics of Evidence and Methodology: Lessons from the EPPI-Centre - Ann Oakley et al.Part Two: Strategies: A Spectrum of Methods; Pragmatism; Relevance; and SpeedMapping the Mixed Methods–Mixed Research Synthesis Terrain - Margarete Sandelowski et alClarifying Differences between Review Designs and Methods - David Gough, James Thomas and Sandy OliverComplex Interventions and Their Implications for Systematic Reviews: A Pragmatic Approach - Mark Petticrew et al.A Research and Development Agenda for Systematic Reviews that Ask Complex Questions about Complex Interventions - Jane Noyes et al.Part Three: PerspectivesConsumer Involvement in Systematic Reviews of Comparative Effectiveness Research - Julia Kreis et al.Public and Patient Involvement in Health Technology Assessment: A Framework for Action - Julia Abelson et al.Producing Policy Relevant Systematic Reviews: Navigating the Policy-Research Interface - S. Oliver, M. Bangpan and K. DicksonPart Four: Contexts: Reviews for Different Purposes; and in Different ContextsPolicy-relevant Systematic Reviews to Strengthen Health Systems: Models and Mechanisms to Support Their Production - Sandra Oliver and Kelly DicksonAdvancing Knowledge of Rapid Reviews: An Analysis of Results, Conclusions and Recommendations from Published Review Articles Examining Rapid Reviews - Robin Featherstone et al.VOLUME TWO: FINDING, DESCRIBING AND MANAGING RELEVANT RESEARCHIntroduction - J. Thomas, D. Gough and S. OliverPart One: Identifying StudiesMethodological Developments in Searching for Studies for Systematic Reviews: Past, Present and Future? - Carol Lefebvre et al.PICO, PICOS and SPIDER: A Comparison Study of Specificity and Sensitivity in Three Search Tools for Qualitative Systematic Reviews - Abigail Methley et alSearching for Qualitative Research for Inclusion in Systematic Reviews: A Structured Methodological Review - Andrew BoothExploring Issues in the Conduct of Website Searching and Other Online Sources for Systematic Reviews: How Can We Be Systematic? - Claire Stansfield, Kelly Dickson and Mukdarat BangpanDe-Duplication of Database Search Results for Systematic Reviews in EndNote - Wichor Bramer et al.Core Keywording Strategy: Data Collection for a Register of Educational Research Version 0.9.4 - EPPI-CentreA Systematic Map and Synthesis Review of the Effectiveness of Personal Development Planning for Improving Student Learning - David Gough et al.Developing and Optimising the Use of Logic Models in Systematic Reviews: Exploring Practice and Good Practice in the Use of Programme Theory in Reviews - Dylan Kneale, James Thomas and Katherine HarrisA Systematic Review and Critical Appraisal of Qualitative Metasynthetic Practice in Public Health to Develop a Taxonomy of Operations of Reciprocal Translation - G.J. Melendez-Torres, Sean Grant and Chris BonellPart Two: Automating ReviewsUsing Text Mining for Study Identification in Systematic Reviews: A Systematic Review of Current Approaches - Alison O’Mara-Eves et al.Automating Data Extraction in Systematic Reviews: A Systematic Review - Siddhartha Jonnalagadda, Pawan Goyal and Mark HuffmanRobotReviewer: Evaluation of a System for Automatically Assessing Bias in Clinical Trials - Iain Marshall, Joel Kuiper and Byron WallaceEnabling Living Systematic Reviews and Clinical Guidelines through Semantic Technologies - Laura SlaughterVOLUME THREE: METHODS OF SYNTHESISIntroduction - J. Thomas, S. Oliver and G. GoughPart One: Introductions, Overviews and Cross-cutting IssuesOngoing Developments in Meta-Analytic and Quantitative Synthesis Methods: Broadening the Types of Research Questions that Can Be Addressed - Alison O’Mara-Eves and James ThomasMethods for the Synthesis of Qualitative Research: A Critical Review - Elaine Barnett-Page and James ThomasSynthesizing Evidence on Complex Interventions: How Meta-Analytical, Qualitative, and Mixed-Method Approaches Can Contribute - Mark Petticrew et al.Part Two: Synthesis Methods for Developing and Exploring Theories, Frameworks or ThemesMethods for the Thematic Synthesis of Qualitative Research in Systematic Reviews - James Thomas and Angela HardenUsing Meta Ethnography to Synthesise Qualitative Research: A Worked Example - Nicky Britten et al.Evidence-based Policy: The Promise of ‘Realist Synthesis’ - Ray PawsonStorylines of Research in Diffusion of Innovation: A Meta-Narrative Approach to Systematic Review - Trisha Greenhalgh et al.Conducting a Critical Interpretive Synthesis of the Literature on Access to Healthcare by Vulnerable Groups - Mary Dixon-Woods et al.Mapping the Mixed-Methods Research Synthesis Terrain - Margarete Sandelowski et al.Using Qualitative Comparative Analysis (QCA) in Systematic Reviews of Complex Interventions: A Worked Example - James Thomas, Alison O’Mara-Eves and Ginny BruntonPart Three: Synthesis Methods for Combining and Configuring Quantitative DataMeta-Analysis: Principles and Procedures - Matthias Egger, George Davey Smith and Andrew PhillipsA Basic Introduction to Fixed-Effect and Random-Effects Models for Meta-Analysis - Michael Borenstein et al.How Should Meta-Regression Analyses Be Undertaken and Interpreted? - Simon Thompson and Julian HigginsAn Overview of Conducting Systematic Reviews with Network Meta-Analysis - Deborah CaldwellMeta-Analysis of Individual Participant Data: Rationale, Conduct, and Reporting - Richard Riley, Paul Lambert and Ghada Abo-ZaidTranslating the Statistical Representation of the Effects of Education Interventions into More Readily Interpretable Forms - Mark Lipsey et al.Multivariate Meta-Analysis: Potential and Promise - Dan Jackson et al.Bayesian Methods in Meta-Analysis and Evidence Synthesis - Alex Sutton and Keith AbramsEvidence Synthesis, Economics and Public Policy - Ian Shemilt et al.VOLUME FOUR: QUALITY, RELEVANCE, AND USEIntroduction - D. Gough, J. Thomas and S. OliverPart One: Appraising Methods of ReviewExtending the PRISMA Statement to Equity-Focused Systematic Reviews (PRISMA-E 2012): Explanation and Elaboration - Vivian Welch et al.Development of AMSTAR: A Measurement Tool to Assess the Methodological Quality of Systematic Reviews - Beverley Shea et al.ROBIS: A New Tool to Assess Risk of Bias in Systematic Reviews Was Developed - Penny Whiting et al.Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study - Matthew Page et al.A Systematic Review of the Content of Critical Appraisal Tools - Persis Katrak et al.GRADE: What Is “Quality of Evidence” and Why Is It Important to Clinicians? - Gordon Guyatt et al.Using Qualitative Evidence in Decision Making for Health and Social Interventions: An Approach to Assess Confidence in Findings from Qualitative Evidence Syntheses (GRADE-CERQual) - Simon Lewin et al.A Matter of Taste: Evaluating the Quality of Qualitative Research - Margarete SandelowskiDigging for Nuggets: How ‘Bad’ Research Can Yield ‘Good’ Evidence - Ray PawsonPart Two: Appraising, Interpreting, and Using Evidence from Systemic ReviewsGRADE Guidelines: 17. Going from Evidence to Recommendations – Considering Resource Use and Modelling Evidence for Cost-Effectiveness - Ian Shemilt et al.Evidence Based Medicine: What It Is and What It Isn’t - David Sackett et al.How Can We Support the Use of Systematic Reviews in Policymaking? - John LavisThe Many Meanings of Research Utilization - Carol Weiss