Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments

376 Pages·2005·7.92 MB·English

by  Hannah R. Rothstein

Publication Bias in
Meta-Analysis
Prevention, Assessment and
Adjustments
Edited by
HANNAH R. ROTHSTEIN
ZicklinSchoolofBusiness,BaruchCollege,USA
ALEXANDER J. SUTTON
UniversityofLeicester,UK
MICHAEL BORENSTEIN
BiostatInc,USA

Publication Bias in Meta-Analysis

Publication Bias in
Meta-Analysis
Prevention, Assessment and
Adjustments
Edited by
HANNAH R. ROTHSTEIN
ZicklinSchoolofBusiness,BaruchCollege,USA
ALEXANDER J. SUTTON
UniversityofLeicester,UK
MICHAEL BORENSTEIN
BiostatInc,USA
Copyright©2005 JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,
WestSussexPO198SQ,England
Telephone [phone]
Email(forordersandcustomerserviceenquiries):[email protected]
VisitourHomePageonwww.wiley.com
AllRightsReserved.Nopartofthispublicationmaybereproduced,storedinaretrievalsystemor
transmittedinanyformorbyanymeans,electronic,mechanical,photocopying,recording,scanningor
otherwise,exceptunderthetermsoftheCopyright,DesignsandPatentsAct1988orunderthetermsof
alicenceissuedbytheCopyrightLicensingAgencyLtd,90TottenhamCourtRoad,LondonW1T4LP,
UK,withoutthepermissioninwritingofthePublisher.RequeststothePublishershouldbeaddressed
tothePermissionsDepartment,JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,West
SussexPO198SQ,England,[email protected],orfaxedto([phone].
Designationsusedbycompaniestodistinguishtheirproductsareoftenclaimedastrademarks.All
brandnamesandproductnamesusedinthisbookaretradenames,servicemarks,trademarksor
registeredtrademarksoftheirrespectiveowners.ThePublisherisnotassociatedwithanyproductor
vendormentionedinthisbook.
Thispublicationisdesignedtoprovideaccurateandauthoritativeinformationinregardtothesubject
mattercovered.ItissoldontheunderstandingthatthePublisherisnotengagedinrendering
professionalservices.Ifprofessionaladviceorotherexpertassistanceisrequired,theservicesofa
competentprofessionalshouldbesought.
OtherWileyEditorialOffices
JohnWiley&SonsInc.,111RiverStreet,Hoboken,NJ07030,USA
Jossey-Bass,989MarketStreet,SanFrancisco,CA94103-1741,USA
Wiley-VCHVerlagGmbH,Boschstr.12,D-69469Weinheim,Germany
JohnWiley&SonsAustraliaLtd,42McDougallStreet,Milton,Queensland4064,Australia
JohnWiley&Sons(Asia)PteLtd,2ClementiLoop#02-01,JinXingDistripark,Singapore129809
JohnWiley&SonsCanadaLtd,22WorcesterRoad,Etobicoke,Ontario,CanadaM9W1L1
Wileyalsopublishesitsbooksinavarietyofelectronicformats.Somecontentthatappearsinprint
maynotbeavailableinelectronicbooks.
LibraryofCongressCataloginginPublicationData
Rothstein,Hannah.
Publicationbiasinmeta-analysis:prevention,assessmentandadjustments/HannahRothstein,
AlexSutton,MichaelBorenstein.
p. cm.
Includesbibliographicalreferencesandindex.
ISBN0-470-87014-1(cloth)
1. Meta-analysis. 2. Meta-analysis—Miscellanea. 3. Medicine—Research—Evaluation.
I. Sutton,A.J. II. Borenstein,Michael. III. Title.
R853.M48R682005
610(cid:1).72—dc22
2005021394
BritishLibraryCataloguinginPublicationData
AcataloguerecordforthisbookisavailablefromtheBritishLibrary
ISBN-13978-0-470-87014-3(HB)
ISBN-100-470-87014-1(HB)
Typesetin10/12ptTimesbyIntegraSoftwareServicesPvt.Ltd,Pondicherry,India
PrintedandboundinGreatBritainbyTJInternational,Padstow,Cornwall
Thisbookisprintedonacid-freepaperresponsiblymanufacturedfromsustainableforestry
inwhichatleasttwotreesareplantedforeachoneusedforpaperproduction.
This book is dedicated to the memory of Richard Tweedie, who played a key role
in planning this volume but, sadly, did not live to see it completed. This book is
part of his legacy.

Contents
Preface ix
Acknowledgements xi
Notes on Contributors xiii
Chapter 1 Publication Bias in Meta-Analysis 1
HannahR.Rothstein,AlexanderJ.Suttonand
MichaelBorenstein
Part A Publication bias in context 9
Chapter2 PublicationBias:RecognizingtheProblem,Understanding
Its Origins and Scope, and Preventing Harm 11
KayDickersin
Chapter 3 Preventing Publication Bias: Registries and Prospective
Meta-Analysis 35
JesseA.BerlinandDavinaGhersi
Chapter 4 Grey Literature and Systematic Reviews 49
SallyHopewell,MikeClarkeandSueMallett
Part B Statistical methods for assessing publication bias 73
Chapter 5 The Funnel Plot 75
JonathanA.C.Sterne,BetsyJaneBeckerandMatthiasEgger
Chapter 6 Regression Methods to Detect Publication and Other Bias
in Meta-Analysis 99
JonathanA.C.SterneandMatthiasEgger
Chapter 7 Failsafe N or File-Drawer Number 111
BetsyJaneBecker
Chapter 8 The Trim and Fill Method 127
SueDuval
viii CONTENTS
Chapter 9 Selection Method Approaches 145
LarryV.HedgesandJackVevea
Chapter 10 Evidence Concerning the Consequences of Publication
and Related Biases 175
AlexanderJ.Sutton
Chapter 11 Software for Publication Bias 193
MichaelBorenstein
Part C Advanced and emerging approaches 221
Chapter 12 Bias in Meta-Analysis Induced by Incompletely Reported
Studies 223
AlexanderJ.SuttonandThereseD.Pigott
Chapter 13 Assessing the Evolution of Effect Sizes over Time 241
ThomasA.TrikalinosandJohnP.A.Ioannidis
Chapter 14 Do Systematic Reviews Based on Individual Patient Data
Offer a Means of Circumventing Biases Associated with
Trial Publications? 261
LesleyStewart,JayneTierneyandSarahBurdett
Chapter 15 Differentiating Biases from Genuine Heterogeneity:
Distinguishing Artifactual from Substantive Effects 287
JohnP.A.Ioannidis
Chapter 16 Beyond Conventional Publication Bias: Other
Determinants of Data Suppression 303
ScottD.HalpernandJesseA.Berlin
Appendices 319
Appendix A Data Sets 321
Appendix B Annotated Bibliography 331
HannahR.RothsteinandAshleyBusing
Glossary 347
Index 353