A Guide to Doing Statistics in Second Language Research Using SPSS and R

529 Pages·2015·14.025 MB·

by  Jenifer Larson-Hall

7
1
0
2
h
c
r
a
M
9
1
6
4
:
2
0
t
a

]
o
g
e
i
D
n
a
S
a,
i
n
r
o
f
i
l
a
C
f
o
y
t
i
s
r
e
v
i
n
U
[
y
b
d
e
d
a
o
l
n
w
o
D
A GUIDE TO DOING STATISTICS
IN SECOND LANGUAGE RESEARCH
USING SPSS AND R
7
1
0
2
h
c
r
a
M
9 This valuable book shows second language researchers how to use the statistical program SPSS to
1 conduct statistical tests frequently done in second language acquisition (SLA) research. This second
6
4 edition has additional information on how to use the statistical program R, which is free and strongly
:
2 supported by statisticians. Using data sets from real SLA studies, this book shows newcomers to both
0
t statistics and SPSS or R how to generate descriptive statistics, choose a statistical test, and conduct
a
] and interpret a variety of basic statistical tests including t-tests, correlation, multiple regression and
o
g analysis of variance (ANOVA). In addition, this book represents an excellent way for readers already
e
Di familiar with the SPSS program to cross a bridge into using the more versatile R program. It will gently
n bring readers along step by step, first with a graphical user interface for R, and slowly into understand-
a
S ing and using R code directly. Robust tests, including bootstrapping, that help researchers avoid prob-
a, lems with violating assumptions about the shape of their data are included. The text is abundantly
i
n illustrated with graphs and tables depicting actual data sets, and exercises throughout the book help
r
o
f readers understand concepts (such as the difference between independent and dependent variables)
i
al and work out statistical analyses.
C
f
o Jenifer Larson-Hall is a Second Language Acquisition researcher and Lecturer of English as a Second
y
t Language at Fukuoka JoGakuin University, Japan.
i
s
r
e
v
i
n
U
[
y
b
d
e
d
a
o
l
n
w
o
D
Second Language Acquisition Research Series
Susan M. Gass and Alison Mackey, Series Editors
Monographs on Theoretical Issues:
Schachter/Gass Second Language Classroom Research: Issues and Opportunities (1996)
Birdsong Second Language Acquisition and the Critical Period Hypotheses (1999)
Ohta Second Language Acquisition Processes in the Classroom: Learning Japanese (2001)
Major Foreign Accent: Ontogeny and Phylogeny of Second Language Phonology (2001)
7 VanPatten Processing Instruction: Theory, Research, and Commentary (2003)
1
0 VanPatten/Williams/Rott/Overstreet Form–Meaning Connections in Second Language Acquisition
2
h (2004)
c
r Bardovi-Harlig/Hartford Interlanguage Pragmatics: Exploring Institutional Talk (2005)
a
M Dörnyei The Psychology of the Language Learner: Individual Differences in Second Language
9 Acquisition (2005)
1
6 Long Problems in SLA (2007)
4 VanPatten/Williams Theories in Second Language Acquisition (2007)
:
2
0 Ortega/Byrnes The Longitudinal Study of Advanced L2 Capacities (2008)
at Liceras/Zobl/Goodluck The Role of Formal Features in Second Language Acquisition (2008)
o] Philp/Adams/Iwashita Peer Interaction and Second Language Learning (2013)
g
e VanPatten/Williams Theories in Second Language Acquisition, Second Edition (2014)
i
D Leow Explicit Learning in the L2 Classroom (2015)
n Dörnyei/Ryan The Psychology of the Language Learner – Revisited (2015)
a
S
a,
ni Monographs on Research Methodology:
r
o
if Tarone/Gass/Cohen Research Methodology in Second Language Acquisition (1994)
l
Ca Yule Referential Communication Tasks (1997)
f Gass/Mackey Stimulated Recall Methodology in Second Language Research (2000)
o
y Markee Conversation Analysis (2000)
t
i Gass/Mackey Data Elicitation for Second and Foreign Language Research (2007)
s
r
e Duff Case Study Research in Applied Linguistics (2007)
v
ni McDonough/Trofimovich Using Priming Methods in Second Language Research (2008)
U
Larson-Hall A Guide to Doing Statistics in Second Language Research Using SPSS (2009)
[
y Dörnyei /Taguchi Questionnaires in Second Language Research: Construction, Administration,
b
d and Processing, Second Edition (2009)
de Bowles The Think-Aloud Controversy in Second Language Research (2010)
a
o Jiang Conducting Reaction Time Research for Second Language Studies (2011)
l
n Barkhuizen/Benson/Chik Narrative Inquiry in Language Teaching and Learning Research (2013)
w
o Jegerski/VanPatten Research Methods in Second Language Psycholinguistics (2013)
D
Larson-Hall A Guide to Doing Statistics in Second Language Research Using SPSS and R, Second
Edition (2015)
Plonsky Advancing Quantitative Methods in Second Language Research (2015)
Of Related Interest:
Gass Input, Interaction, and the Second Language Learner (1997)
Gass/Sorace/Selinker Second Language Learning Data Analysis, Second Edition (1998)
Mackey/Gass Second Language Research: Methodology and Design (2005)
Gass/Selinker Second Language Acquisition: An Introductory Course, Third Edition (2008)
A GUIDE TO DOING
STATISTICS IN SECOND
LANGUAGE RESEARCH
7
1
0
2
h USING SPSS AND R
c
r
a
M
9
1
6 Second Edition
4
:
2
0
t
a
]
o
g
e
i
D
n
a
S
a,
i
n
r
o
f
i
l Jenifer Larson-Hall
a
C
of Fukuoka JoGakuin University
y
t
i
s
r
e
v
i
n
U
[
y
b
d
e
d
a
o
l
n
w
o
D
First published 2016
by Routledge
711 Third Avenue, New York, NY 10017
and by Routledge
2 Park Square, Milton Park, Abingdon, Oxon, OX14 4RN
Routledge is an imprint of the Taylor & Francis Group, an informa business
© 2016 Taylor & Francis
The right of Jenifer Larson-Hall to be identified as author of this work has been asserted by her
in accordance with sections 77 and 78 of the Copyright, Designs and Patents Act 1988.
7 All rights reserved. No part of this book may be reprinted or reproduced or utilised in any
1 form or by any electronic, mechanical, or other means, now known or hereafter invented,
0
2 including photocopying and recording, or in any information storage or retrieval system, without
h permission in writing from the publishers.
c
ar Trademark notice: Product or corporate names may be trademarks or registered trademarks, and
M are used only for identification and explanation without intent to infringe.
9 Library of Congress Cataloging in Publication Data
1
6 A catalog record for this book has been requested
4
:
2 ISBN: 978-1-138-02456-4 (hbk)
0
t ISBN: 978-1-138-02457-1 (pbk)
a ISBN: 978-1-315-77566-1 (ebk)
]
o
g Typeset in Goudy
e
i by Swales & Willis Ltd, Exeter, Devon, UK
D
n
a
S
a,
i
n
r
o
f
i
l
a
C
f
o
y
t
i
s
r
e
v
i
n
U
[
y
b
d
e
d
a
o
l
n
w
o
D
7
1
0
2
h
c
r
a
M
For Andrew, who doesn’t care much about numbers, but who has made my life quantitatively
9
1 better
6
4
:
2
0
t
a
]
o
g
e
i
D
n
a
S
a,
i
n
r
o
f
i
l
a
C
f
o
y
t
i
s
r
e
v
i
n
U
[
y
b
d
e
d
a
o
l
n
w
o
D
This page intentionally left blank
7
1
0
2
h
c
r
a
M
9
1
6
4
:
2
0
t
a
]
o
g
e
i
D
n
a
S
a,
i
n
r
o
f
i
l
a
C
f
o
y
t
i
s
r
e
v
i
n
U
[
y
b
d
e
d
a
o
l
n
w
o
D
CONTENTS
7
1
0
2
h
c
r
a
M
Preface xv
9
1 Acknowledgments xix
6
4
:
2
0 PART I
t
a Statistical Ideas 1
]
o
g
ie 1 Getting Started with the Software and Using the Computer
D
n for Experimental Details 3
Sa 1.1 Getting Started with SPSS 3
a, 1.1.1 Opening a Data File 5
i
n 1.1.2 Entering Your Own Data 5
r
o
f 1.1.3 Application Activity for Getting Started with SPSS 10
i
l
a 1.1.4 Importing Data into SPSS 11
C
f 1.1.5 Saving Your Work in SPSS 11
o
y 1.1.6 Application Activities for Importing and Saving Files 13
t
si 1.2 Getting Started with R 13
r
ve 1.2.1 Downloading and Installing R 13
i
n 1.2.2 Customizing R in Windows 15
U
[ 1.2.3 Loading Packages and R Commander 17
y
b 1.2.4 A List of All the R Packages Used in this Book 19
d
e 1.3 Working with Data in R and R Commander 19
d
a 1.3.1 Entering Your Own Data 20
o
nl 1.3.2 Importing Files into R through R Commander 22
w
1.3.3 Viewing Entered Data 25
o
D 1.3.4 Saving Data and Reading It Back In 25
1.3.5 Saving Graphics Files 27
1.3.6 Closing R and R Commander 27
1.3.7 Application Activities Practicing Entering Data into R 28
1.4 Understanding the R Environment 28
1.4.1 Using R as a Calculator 28
1.4.2 Using R as a Calculator Practice Activities 30
1.4.3 Objects in R 31
1.4.4 Creating Objects in R Practice Activities 32
1.4.5 Types of Data in R 33
1.4.6 Types of Data Practice Activities 35
viii Contents
1.4.7 Functions in R 35
1.4.8 Functions in R Practice Activities 36
1.4.9 The R Workspace 37
1.4.10 Specifying Variables within a Data Set, and Attaching
and Detaching Data Sets 37
1.5 Missing Data 38
1.5.1 Missing Data and Multiple Imputation in SPSS 38
1.5.2 Missing Data Application Activity in SPSS 43
1.5.3 Missing Data and Multiple Imputation in R 43
7
1 1.5.4 Missing Data Application Activity in R 46
0
2 1.6 Getting Help 46
h 1.6.1 Getting Help with SPSS 46
c
r
a 1.6.2 Getting Help with R 46
M
9 1.7 Summary 49
1
6
4 2 Some Preliminaries to Understanding Statistics 50
:
2 2.1 Variables 51
0
t 2.1.1 Levels of Measurement of Variables 51
a
o] 2.1.2 Application Activity: Practice in Identifying
g
e Levels of Measurement 53
i
D 2.1.3 Dependent and Independent Variables 54
n
a 2.1.4 Application Activities: Practice in Identifying Variables 56
S
a, 2.1.5 Summary of Variables 57
ni 2.1.6 Fixed versus Random Effects (Advanced Topic) 57
r
o 2.2 Understanding Hidden Assumptions about How Statistical Testing Works 58
f
i
l 2.2.1 Hypothesis Testing 59
a
C
2.2.2 Application Activities: Creating Null Hypotheses 60
f
o 2.2.3 Who Gets Tested? Populations versus Samples and Inferential
y
it Statistics 60
s
er 2.2.4 What Does a P-Value Mean? 62
v
i 2.2.5 Effect Sizes 65
n
U
2.2.6 Understanding Statistical Reporting 65
[
y 2.2.7 Application Activities: Understanding Statistical Reporting 69
b
d 2.2.8 The Inner Workings of Statistical Testing 70
e
d 2.2.9 Application Activity: The Inner Workings of Statistical Testing 73
a
o 2.2.10 Summary of Hidden Assumptions 73
l
n
w 2.3 Parametric and Non-Parametric Statistics 73
o
D 2.3.1 Why Robust Statistics? 74
2.4 Summary 76
3 Describing Data Numerically and Graphically and
Assessing Assumptions for Parametric Tests 77
3.1 Numerical Summaries of Data 77
3.1.1 The Mean, Median and Mode 78
3.1.2 Standard Deviation, Variance and Standard Error 80
3.1.3 Confidence Intervals 85
3.1.4 The Number of Observations and Other Numerical Summaries
You Might Want to Report 89
Contents ix
3.1.5 Reporting Numerical Summaries 89
3.1.6 Data for this Chapter 90
3.2 Using SPSS to Get Numerical Summaries 91
3.2.1 Obtaining Numerical Summaries with SPSS
and Splitting Groups 91
3.2.2 Application Activities for Numerical Summaries in SPSS 94
3.3 Using R to get Numerical Summaries 95
3.3.1 Basic Descriptive Statistics in R 95
3.3.2 Application Activities for Numerical Summaries in R 99
7
1 3.4 Satisfying Assumptions for Parametric Tests 99
0
2 3.5 Graphic Summaries of Data: Examining the Shape of Distributions for Normality 100
h 3.5.1 Histograms 101
c
r
a 3.5.2 Skewness and Kurtosis 104
M
9 3.5.3 Stem and Leaf Plots 106
1 3.5.4 Quantile-Quantile Plots 107
6
4 3.6 Obtaining Exploratory Visual Summaries in SPSS 107
:
2 3.6.1 Application Activities: Looking at Normality Assumptions 112
0
at 3.7 Obtaining Exploratory Visual Summaries in R 112
o] 3.7.1 Creating Histograms with R 113
g
e 3.7.2 Creating Stem and Leaf Plots with R 115
i
D
3.7.3 Creating Q-Q Plots with R 117
n
a 3.7.4 Testing for Normality with R 119
S
a, 3.7.5 Application Activities: Looking at Normality Assumptions with R 120
ni 3.8 Examining the Shape of Distributions: The Assumption of Homogeneity 121
r
o 3.8.1 Checking Homogeneity of Variance (with SPSS or R) 123
f
i
al 3.9 Dealing with Departures from Expectations 124
C
f 3.9.1 Outliers 124
o
y 3.9.2 Transforming Data 124
it 3.10 Summary 126
s
r
e
v
i 4 Changing the Way We Do Statistics: The New Statistics 128
n
U
4.1 Introduction to Confidence Intervals 130
[
y 4.1.1 Application Activity for ESCI and Confidence Intervals 131
b
d 4.1.2 Interpreting Confidence Intervals 133
e
d 4.1.3 Application Activities with Confidence Intervals 137
a
o 4.1.4 Confidence Intervals and the Imprecision of P-Values 139
l
n
w 4.1.5 Application Activities with Confidence Intervals and Precision 141
o
D 4.2 Introduction to Effect Sizes 141
4.2.1 Understanding Effect Size Measures 143
4.2.2 Interpreting Effect Sizes 144
4.2.3 Calculating Effect Sizes Summary 146
4.2.4 Effect Size Confidence Intervals 149
4.3 Some Explanations of the “Old” Statistics 151
4.3.1 Null Hypothesis Significance Tests 151
4.3.2 One-Tailed versus Two-Tailed Tests of Hypotheses 154
4.3.3 Outcomes of Null Hypothesis Significance Testing 156
4.3.4 Power Analysis 157
4.3.5 Calculating Effect Sizes for Power Analysis 158