Measures of Interobserver Agreement and Reliability

286 Pages·2010·2.52 MB·English

by  Mohamed M. Shoukri

Statistics
Second
Edition
Measures of Interobserver Agreement and Reliability, Second
Edition covers important issues related to the design and analysis Measures of
of reliability and agreement studies. It examines factors affecting the A M
degree of measurement errors in reliability generalization studies and g e
Interobserver
characteristics influencing the process of diagnosing each subject in r a
e
s
a reliability study. The book also illustrates the importance of blinding e
u
and random selection of subjects. m r Agreement
e
e
New to the Second Edition s
n
and Reliability
• New chapter that describes various models for methods t o

comparison studies a f

• New chapter on the analysis of reproducibility using the within- n In
Second Edition
d
subjects coefficient of variation t
e
• Emphasis on the definition of the subjects’ and raters’ R
r
population as well as sample size determination e o
l b
i
With applications in medical research and clinical epidemiology, this a s
b e
edition continues to offer guidance on how to run sound reliability and
i r
agreement studies in clinical settings and other types of investigations. l v
i
t e
The author discusses sample size requirements extensively in every y
r
chapter. He also explores two ways of producing one pooled estimate
of agreement from several centers: a fixed-effect approach and a
random sample of centers using a simple meta-analytic approach.
The text includes end-of-chapter exercises as well as a CD-ROM of
data sets and SAS code.
S
h
o
u
k
r
i Mohamed M. Shoukri
K10539
K10539_Cover.indd 1 11/11/10 8:52 AM
This Page Intentionally Left Blank
Measures of
Interobserver
Agreement
and Reliability
Second Edition
Editor-in-Chief
Shein-Chung Chow, Ph.D.
Professor
Department of Biostatistics and Bioinformatics
Duke University School of Medicine
Durham, North Carolina
Series Editors
Byron Jones Jen-pei Liu
Senior Director Professor
Statistical Research and Consulting Centre Division of Biometry
(IPC 193) Department of Agronomy
Pfizer Global Research and Development National Taiwan University
Sandwich, Kent, U.K. Taipei, Taiwan
Karl E. Peace Bruce W. Turnbull
Georgia Cancer Coalition Professor
Distinguished Cancer Scholar School of Operations Research
Senior Research Scientist and and Industrial Engineering
Professor of Biostatistics Cornell University
Jiann-Ping Hsu College of Public Health Ithaca, New York
Georgia Southern University
Statesboro, Georgia
Adaptive Design Theory and Implementation DNA Microarrays and Related Genomics
Using SAS and R, Mark Chang Techniques: Design, Analysis, and Interpretation
of Experiments, David B. Allsion, Grier P. Page,
Advances in Clinical Trial Biostatistics,
T. Mark Beasley, and Jode W. Edwards
Nancy L. Geller
Elementary Bayesian Biostatistics,
Applied Statistical Design for the Researcher,
Lemuel A. Moyé
Daryl S. Paulson
Frailty Models in Survival Analysis,
Basic Statistics and Pharmaceutical Statistical
Andreas Wienke
Applications, Second Edition, James E. De Muth
Handbook of Regression and Modeling:
Bayesian Adaptive Methods for Clinical Trials,
Applications for the Clinical and Pharmaceutical
Scott M. Berry, Bradley P. Carlin, J. Jack Lee,
Industries, Daryl S. Paulson
and Peter Muller
Measures of Interobserver Agreement and
Bayesian Methods for Measures of Agreement,
Reliability, Second Edition,
Lyle D. Broemeling
Mohamed M. Shoukri
Bayesian Missing Data Problems: EM, Data
Medical Biostatistics, Second Edition,
Augmentation and Noniterative Computation,
A. Indrayan
Ming T. Tan, Guo-Liang Tian, and Kai Wang Ng
Meta-Analysis in Medicine and Health Policy,
Bayesian Modeling in Bioinformatics,
Dalene Generalized Linear Models: A Bayesian
Dipak K. Dey, Samiran Ghosh, and Bani K. Mallick
Perspective, Dipak K. Dey, Sujit K. Ghosh, and
Causal Analysis in Biomedicine and
Bani K. Mallick
Epidemiology: Based on Minimal Sufficient
Monte Carlo Simulation for the Pharmaceutical
Causation, Mikel Aickin
Industry: Concepts, Algorithms, and Case
Clinical Trial Methodology, Karl E. Peace and
Studies, Mark Chang
Ding-Geng (Din) Chen
Multiple Testing Problems in Pharmaceutical
Computational Methods in Biomedical Research,
Statistics, Alex Dmitrienko, Ajit C. Tamhane,
Ravindra Khattree and Dayanand N. Naik
and Frank Bretz
Computational Pharmacokinetics, Anders Källén
Sample Size Calculations in Clinical Research,
Data and Safety Monitoring Committees in Second Edition, Shein-Chung Chow, Jun Shao,
Clinical Trials, Jay Herson and Hansheng Wang
Design and Analysis of Animal Studies in Statistical Design and Analysis of Stability
Pharmaceutical Development, Studies, Shein-Chung Chow
Shein-Chung Chow and Jen-pei Liu
Statistical Methods for Clinical Trials,
Design and Analysis of Bioavailability and Mark X. Norleans
Bioequivalence Studies, Third Edition,
Statistics in Drug Research: Methodologies and
Shein-Chung Chow and Jen-pei Liu
Recent Developments, Shein-Chung Chow and
Design and Analysis of Clinical Trials with Time- Jun Shao
to-Event Endpoints, Karl E. Peace
Statistics in the Pharmaceutical Industry, Third
Difference Equations with Public Health Edition, Ralph Buncher and Jia-Yeong Tsay
Applications, Lemuel A. Moyé and
Translational Medicine: Strategies and
Asha Seth Kapadia
Statistical Methods, Dennis Cosmatos and
DNA Methylation Microarrays: Experimental Shein-Chung Chow
Design and Statistical Analysis,
Sun-Chong Wang and Arturas Petronis

Measures of
Interobserver
Agreement
and Reliability
Second Edition
Mohamed M. Shoukri
King Faisal Specialist Hospital & Research Center
Riyadh, Saudi Arabia
Department of Epidemiology and Biostatistics
Schulich School of Medicine and Dentistry
University of Western Ontario
London, Ontario, Canada
MATLAB® is a trademark of The MathWorks, Inc. and is used with permission. The MathWorks does not warrant the accuracy of the text or exer-
cises in this book. This book’s use or discussion of MATLAB® software or related products does not constitute endorsement or sponsorship by The
MathWorks of a particular pedagogical approach or particular use of the MATLAB® software.
CRC Press
Taylor & Francis Group
6000 Broken Sound Parkway NW, Suite 300
Boca Raton, FL 33487-2742
© 2011 by Taylor and Francis Group, LLC
CRC Press is an imprint of Taylor & Francis Group, an Informa business
No claim to original U.S. Government works
Printed in the United States of America on acid-free paper
10 9 8 7 6 5 4 3 2 1
International Standard Book Number-13: 978-1-4398-1081-1 (Ebook-PDF)
This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been made to publish reliable data
and information, but the author and publisher cannot assume responsibility for the validity of all materials or the consequences of their use. The
authors and publishers have attempted to trace the copyright holders of all material reproduced in this publication and apologize to copyright
holders if permission to publish in this form has not been obtained. If any copyright material has not been acknowledged please write and let us
know so we may rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or utilized in any form by any
electronic, mechanical, or other means, now known or hereafter invented, including photocopying, microfilming, and recording, or in any infor-
mation storage or retrieval system, without written permission from the publishers.
For permission to photocopy or use material electronically from this work, please access www.copyright.com (http://www.copyright.com/) or
contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization
that provides licenses and registration for a variety of users. For organizations that have been granted a photocopy license by the CCC, a separate
system of payment has been arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used only for identification and explanation
without intent to infringe.
Visit the Taylor & Francis Web site at
http://www.taylorandfrancis.com
and the CRC Press Web site at
http://www.crcpress.com
This Page Intentionally Left Blank
I would like to dedicate this work to:
My wife Suhair and my children Nader, Nadene, and Tamer
© 2011 by Taylor & Francis Group, LLC