Assessing the Online Learner: Resources and Strategies for Faculty (Online Teaching and Learning Series (OTL))

176 Pages·2008·0.91 MB·english

by  Rena M. Palloff

Assessing the Online Learner PP Assessing the
RA
AL
Written by Rena M. Palloff and Keith Pratt, experts in the fi eld of online teaching and learning, this TLO
T
hands-on resource helps higher education professionals understand the fundamentals of effective online F
assessment. It offers guidance for designing and implementing creative assessment practices tied directly F Online Learner

to course activities to measure student learning. The book is fi lled with illustrative case studies, authentic
assessments based in real-life application of concepts, and collaborative activities that assess the quality of
student learning rather than relying on the traditional methods of measuring the amount of information
retained.
Praise for Assessing the Online Learner
J A G
O
S s N
“pErsatacbtilcisahl egdu ildeeabdoeorsk ind eosntilnineed lteoa rbneincgo, mPeal lao fcfl aasnsdic P. Irna ttth hea evrea b orof akcecno nuenwta bgriloituy,n tdh iws ittehx tth wisi lsl cphroolvairdlye yet SEY- ses ARNI
administrators, faculty developers, and online teaching faculty with clear direction based in many years BA si LE
of successful virtual classroom experience that will guide the assessment of online learning for years to S n D
S
come.” G g AN
—Judy Witt, dean, School of Educational Leadership and Change, Fielding Graduate University UI th G
D e N
“At a time in which online educators are increasingly called upon to document student learning, Palloff and ES O HI
Pratt have succinctly offered strategies to align assessment, program competencies, learning outcomes, TO n AC Resources and Strategies for Faculty
and c—ou Trinsea Ja. cPtairvsictaiel, sd itrheactt oaru othf eednuticcaatliloyn e anngda pgreo lfeesasrinoenarls satunddi epsr pormogortaem ms, eaningful refl ection.” ON line E TE
Colorado State University–Global Campus L N
IN L LI
E e N
T a O
E r
A n O
C e T
H r S
I E
THE AUTHORS N D
G I
Rena M. Palloff and Keith Pratt are the managing partners of Crossroads Consulting Group, U
A G
working with institutions, organizations, and corporations interested in the development of N
D S
online distance learning and training programs. They are the authors of Building Online Learning S

L A
Communities, Lessons from the Cyberspace Classroom, The Virtual Student, and Collaborating Online, E B
A -
all from Jossey-Bass. R Y
N E
S
IN S
O
G
J
Cover design by Michael Cook EDUCATION & TECHNOLOGY
www.josseybass.com
Rena M. PALLOFF Keith PRATT
ffffiirrss..iinndddd iiii 99//2222//0088 66::3333::3322 PPMM
Assessing the Online Learner
ffffiirrss..iinndddd ii 99//2222//0088 66::3333::3322 PPMM
ffffiirrss..iinndddd iiii 99//2222//0088 66::3333::3322 PPMM
JOSSEY-BASS GUIDES
TO ONLINE TEACHING AND LEARNING
Assessing the Online Learner
RESOURCES AND STRATEGIES
FOR FACULTY
Rena Palloff and
Keith Pratt
ffffiirrss..iinndddd iiiiii 99//2222//0088 66::3333::3322 PPMM
Copyright © 2009 by John Wiley & Sons, Inc. All rights reserved.
Published by Jossey-Bass
A Wiley Imprint
989 Market Street, San Francisco, CA 94103-1741—www.josseybass.com
No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form
or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as
permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior
written permission of the publisher, or authorization through payment of the appropriate per-copy fee
to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400, fax
978-646-8600, or on the Web at www.copyright.com. Requests to the publisher for permission should be
addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030,
201-748-6011, fax [phone], or online at www.wiley.com/go/permissions.
Readers should be aware that Internet Web sites offered as citations and/or sources for further information
may have changed or disappeared between the time this was written and when it is read.
Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts
in preparing this book, they make no representations or warranties with respect to the accuracy or com-
pleteness of the contents of this book and specifi cally disclaim any implied warranties of merchantability
or fi tness for a particular purpose. No warranty may be created or extended by sales representatives or
written sales materials. The advice and strategies contained herein may not be suitable for your situation.
You should consult with a professional where appropriate. Neither the publisher nor author shall be liable
for any loss of profi t or any other commercial damages, including but not limited to special, incidental,
consequential, or other damages.
Jossey-Bass books and products are available through most bookstores. To contact Jossey-Bass directly
call our Customer Care Department within the U.S. at 800-956-7739, outside the U.S. at 317-572-3986,
or fax [phone].
Jossey-Bass also publishes its books in a variety of electronic formats. Some content that appears in print
may not be available in electronic books.
Library of Congress Cataloging-in-Publication Data
Palloff, Rena M., 1950-
Assessing the online learner : resources and strategies for faculty / Rena M. Palloff and Keith Pratt.—
1st ed.
p. cm.—(The Jossey-Bass higher and adult education series)
Includes bibliographical references and index.
ISBN 978-0-470-28386-8 (pbk.)
1. Distance education students—Rating of. 2. College students—Rating of. 3. Web-based
instruction. 4. Internet in higher education. I. Pratt, Keith, 1947- II. Title.
LC5803.C65P34 2009
378.1'7344678—dc22
2008034931
Printed in the United States of America
first edition
PB Printing 10 9 8 7 6 5 4 3 2 1
ffffiirrss..iinndddd iivv 99//2222//0088 66::3333::3344 PPMM
C O N T E N T S
Preface ix
Acknowledgments xv
The Authors xvii
PART ONE Assessment Basics
ONE How Do We Know They Know? 3
Developing Standards of Assessment 4
Getting Down to the Basics 5
Learner-Focused Teaching 24
Applying What We Have Learned 28
TWO Assessment Online 29
Principles of Effective Online Assessment 30
Assessment and the Online Learner 43
Using the Online Environment for Assessment Advantage 44
Plagiarism and Cheating 46
Applying What We Have Learned 47
THREE Course and Program Evaluation 49
Course Evaluation 49
Instructor Evaluation 51
v
ffttoocc..iinndddd vv 99//2222//0088 66::3333::0000 PPMM
Program Evaluation 57
Competency Assessment as Course and Program Evaluation 59
Applying What We Have Learned 62
PART TWO The Assessment and Evaluation Toolkit 65
Introduction to the Assessment and Evaluation Toolkit 67
Rubrics and Rubric Development 68
Using Student Feedback for Assessment 72
How Interactive Is It? 73
Authentic Assessments 76
Performance Assessments 83
Effective Test and Quiz Development 92
Portfolios 100
Portfolios as Assessment 102
Refl ective Assessment and Self-Assessment 104
Collaborative Peer Assessment 116
The Use of Wikis and Blogs in Assessment 121
Effective Online Course Evaluation 125
Effective Faculty Evaluation 127
Additional Resources 135
References 143
Index 149
vi
Contents
ffttoocc..iinndddd vvii 99//2222//0088 66::3333::0000 PPMM
L I S T O F E X H I B I T S
ONE
Exhibit 1.1 Course Development Model 6
Exhibit 1.2 Sample Professional Competencies 8
Exhibit 1.3 Cycle of Course Design 13
Exhibit 1.4 Map of Competencies to Outcomes, 17
Objectives, and Assessments
Exhibit 1.5 The Learning Pyramid 19
Exhibit 1.6 Bloom’s Taxonomy 20
TWO
Exhibit 2.1 Rubric for Participation in Discussions 34
Exhibit 2.2 Sample Feedback Form for Peer Review 38
THREE
Exhibit 3.1 Continuum of Interactivity 54
vii
ffttoocc..iinndddd vviiii 99//2222//0088 66::3333::0011 PPMM
ffttoocc..iinndddd vviiiiii 99//2222//0088 66::3333::0011 PPMM