ERIC ED358183: A Manual for 20/20 Analysis: A Tool for Instructional Planning.

35 Pages·1993·0.77 MB·English

by  ERIC

DOCUMENT RESUME
ED 358 183
UD 029 211
AUTHOR
Reynolds, Maynard C.; Zetlin, Andrea G.
TITLE
A Manual for 20/20 Analysis: A Tool for Instructional
Planning.
INSTITUTION
Temple Univ., Philadelphia. Center for Research in
Human Development and Education.
SPONS AGENCY
Office of Educational Research and Improvement (ED),
Washington, DC.
REPORT NO
CRHDE-Pub-Ser-93-2
PUB DATE
93
NOTE
38p.
PUB TYPE
Guides
Non-Classroom Use (055)
EDRS PRICE
MF01/PCO2 Plus Postage.
DESCRIPTORS
Delivery Systems; Educational Change; Educational
Improvement; *Educational Planning; Educational
Strategies; Elementary Education; Elementary School
Students; High Achievement; *High Risk Students;
*Instructional Development; *Integrated Curriculum;
Low Achievement; Models; Outcomes of Education;
Predictor Variables
IDENTIFIERS
*20 20 Analysis; *Marginal Students
ABSTRACT
This manual is designed to serve as a comprehensive
guide for utilizing 20/20 analysis, an instructional planning
approach that aims to overcome the disjointedness of current,
narrowly formed categorical programs for educating marginal students.
The authors explain that 20/20 analysis is a key element in
developing an integrated service delivery system in which students
showing the most (the top 20 percent) and the least (the bottom 20
percent) progress on significant outcome variables receive intensive
study and instruction. The concept does not involve a fixed program
but rather an "opening up" of fragmented categorical systems (such as
bilingual education and special education). It encourages a broad,
systematic, outcome-oriented approach to school improvement. Within
this manual, practitioners are provided with the 20/20 rationale, key
features and concerns, step-by-step procedures, and follow-through
planning at two sample schools, for use in implementing the 20/20
analysis. This true-life example of the 20/20 analysis, using data
from "Elementary School A" is provided parallel to each step of the
procedure. The manual then offers an illustration of the
followthrough steps, which can be taken to improve instruction based
on the initial data analysis. Finally, data are provided for several
additional schools that have engaged in 20/20 analysis, showing how
crossschool comparisons may be useful. Contains 18 references.
(Author /JB)
***********************************************************************
Reproductions supplied by EDRS are the best that can be made
from the original document.
***********************************************************************
A Manual for
20/20 Analysis:
Instructional Planning
A Tool for
By Maynard C. Reynolds, Ph.D.
and
Andrea G. Zetlin, Ed.D.
EDUCATION
U.S. DEPARTMENT OF
Improvement
()nice of Educational Research and
INFORMATION
EDUCATIONAL RESOURCES
CENTER IERICI
reproduced as
Tens document has been
organizatron
eceived from the person or
originating it
made to improve
O Minor changes have been
reproduction quality
stated in this docu-
Points of view or opinions
represent official
ment do not necessarily
OERI positron or policy
Temple University Center for Research
in Human Development and Education
02
AVAILABLE
LEST COPY
A MANUAL FOR 20/20 ANALYSIS:
A Tool for Instructional Planning
Maynard C. Reynolds, Ph.D.
and
Andrea G. Zetlin, Ed.D.
National Center on Education in the Inner Cities
at the
Temple University Center for Research
in Human Development and Education
the Temple University Center for Research in
The research reported herein is supported in part by
by the Office of Educational Research and
Human Development and Education (CRHDE) and in part
to the National Center on
Improvement (OERI) of the U.S. Department of Education through a grant
The opinions expressed do not necessarily
Education in the Inner Cities (CEIC) at Temple University.
official endorsement should be inferred.
reflect the position of the supporting agencies and no
Abstract
This manual for 20/20 analysis is designed to
serve as a comprehensive
guide for utilizing 20/20 analysis, an instructional planning approach
that aims to
overcome the disjointedness of current, narrowly formed categorical programs for
educating marginal students.
The authors explain that 20/20 analysis is
a key
element in developing an integrated service delivery system in which students
showing the most (the top-20 percent) and the least (the low-20 percent)
progress
on significant outcome variables receive intensive study and instruction.
The
20/20 concept does not involve a fixed
program but rather an "opening up" of
fragmented categorical systems (bilingual education, special education, etc.).
It
encourages
broad,
a
systematic,
outcome-oriented
approach
school
to
improvement. Within this manual, practitioners are provided with such detailed
information as the 20/20 rationale, key features and
concerns, step-by-step
procedures, and follow-through planning at -two sample schools, for
use in
implementing the 20/20 analysis.
TABLE OF CONTENTS
Page
In Brief -- An Introduction to 20/20 Analysis
2
Organization of the Manual
2
Rationale
4
Key Features and Concerns
8
Step-by-Step Procedures
21
Cross-School Comparisons
24
Low Enrollments in Special Education
26
A Tentative Policy Proposal
27
Summary and Significance
28
References
IN BRIEF AN INTRODUCTION TO 20/20 ANALYSIS
The 20/20 analysis is designed as a data-based approach to instructional
It proposes that schools make a special effort to identify and study
planning.
students showing the least progress and the most progress in learning in one or
margins
more of the most important curriculum areas. It involves looking to the
working both
to identify students for whom the existing instructional program is
least and most adequately (those who rank above the 80th percentile and below
the 20th percentile -- hence, "20/20") so efforts for instructional improvements
It is believed that as schools begin to serve their marginal pupils
can follow.
better, services for all students will improve.
Many schools are in a state of disrepair at their margins and need reform,
away" low-achieving students to
as evidenced by schools that frequently "give
a collection of
of education
an uncoordinated and inefficient "second system"
Even in the case of high-achieving
narrowly framed categorical programs.
students, too many schools have programs that are neglectful and non-adaptive
only
offering
procedures
"pull-out"
involve
or
that
learners
for
rapid
disconnected content and untested instructional practices. At a time when many
developing, systematic means for
new and alternative forms of education are
monitoring the progress of marginal students are becoming more important. The
20/20 analysis provides one such procedure.
The 20/20 analysis involves an initial data analysis phase, followed by
adaptations in the instructional program needed for both individuals and total
analysis in this second phase.
programs. There is no fixed program for 20/20
It aims to open up total school programs for creative approaches to instructional
improvement, to achieve coherent school-wide planning, and to enhance learning
opportunities for all students, while always focusing attention on students at the
margins.
The term "20/20" not only indicates the segments of the school
the need
for
the
but also,
metaphorically,
population needing attention,
instructional programs provided to these pupils to have precise, well-focused
examination -- or clear vision. The program proposed here is consistent with
emerging general trends toward the elimination of narrowly framed categorical
the preference of more locally
programs and their attending bureaucracies, and
controlled, creative approaches to public services (Osborne & Gaehler, 1992).
2
ORGANIZATION OF THE MANUAL
This manual is organized to present the rationale for the 20/20 analysis,
procedures. A true-
a summary of its key features, and a step-by-step guide on
to-life example of the 20/20 analysis, using data from Elementary School A, is
The manual then offers
provided parallel to each step of the procedure.
illustrations of follow-through steps which can be taken to improve instruction
based on the initial data analysis. The example of Elementary School A again
Finally, data are provided for
is projected through the follow-through stages.
several additional schools that have engaged in 20/20 analysis, showing how
cross-school comparisons may be useful.
RATIONALE
One indicator of an effective school is its ability to meet the diverse
instructional needs of all students, including those at the margins. Many schools,
particularly those with high concentrations of students in at-risk circumstances,
have served those at the margins of achievement distribution poorly.
A key element in the 20/20 analysis is motivating local school staff to
take the initiative in the systematic study of their students and programs (rather
than have outside agents do the job) without the constraints associated with
categorical programs and student labeling. The procedure should be as simple
and non-technical as possible so that all stakeholders in the schools, especially
As school
parents, can understand and participate in the process at all stages.
staffs and parents grow in their ability to use 20/20 analyses, it is anticipated they
will be able to give attention to increasingly sophisticated approaches to
instructional improvement. Moreover, through repeated use, the 20/20 procedure
provides data on trends in the outcomes of school programs and thus a "built-in"
The 20/20 analysis provides a way of building up the
program evaluation.
research, development, and evaluation capabilities at local school sites.
Hopefully, 20/20 procedures will help educators avoid some of the
The term
disjointedness and proceduralism in present categorical programs.
"procedural ism" refers to complex and expensive systems now used to categorize
(and often to label) children and to the massive paperwork involved in making
It is important to realize
programs accountable to state and federal authorities.
how limited some of the categories are in terms of scientific credibility and
usefulness in planning school programs. The 20/20 analysis proposes to use
meaningful dimensions of learning in diagnosis and planning, rather than
categories and labels which have limited relevance for instruct'qnal practices. In
total, the procedure is quite simple and easy to monitor, but it can lead to
comprehensive changes in school operations.
3
Categorical programs such as those for students who are economically
disadvantaged (Chapter 1), educable mentally retarded (EMR), learning disabled
(LD), emotionally disturbed (ED), limited in English proficiency (LEP), or
rnernbers of migrant families have been established on the basis of presumed
In fact, such presumed causes often have little if
causes of learning problems.
useful. Many schools now
any relation to instructional approaches found most
framed categorical
operate with a great variety of highly disjointed, narrowly
"second system" programs (Wang, Reynolds, & Walberg, 1987, 1988) that
and inefficiency. The
present enormous problems of management, coordination,
based
20/20 analysis proposes that instead of organizing programs by categories
of learning outcomes
on presumed causes, schools proceed directly to measures
learning under
and to very intensive instruction, for children whose progress in
ordinary arrangements is marginal.
Much of the working time of school psychologists has been consumed in
various categorical
simple psychometrics to qualify students for allocation to the
This unfortunate fact has caused morale problems among many
programs.
psychologists and, perhaps more importantly, has meant that broader, more
useful versions of psychology have not been delivered to the schools (Heller,
Holtzman, & Messick, 1982; Hobbs, 1975; Wang, Reynolds, & Walberg, 1987,
1988; Ysseldyke, 1987).
The need to focus greater-than-usual support on students at the margins,
in the
starting with direct assessment of learning progress, has been clear
writings of several leading researchers (Bereiter, 1985; Brophy, 1986; Heller et
al., 1982). For example, Bereiter (1985) put it this way:
learn
For any sort of learning, from swimming to reading, some children
with almost no help and other children need a great deal of help.
Children whom we have labeled educationally disadvantaged are typically
children who need more than ordinary amounts of help with academic
learning. Why they need help is open to all sorts of explanations. But
simply accept the fact
suppose that, instead of reopening that issue, we
(p.
that youngsters vary greatly in how much help they need and why.
541)
Academy
In the early 1980s a special panel was created by the National
Referring
of Sciences (NAS) to study placement practices in special education.
education
to educable mental retardation, learning disabilities, and compensatory
educational justification for
programs, the NAS panel reported that, "We find no
schools"
the current categorization system that separates these three groups in the
Unless and until there is clear refutation of that
(Heller et al., 1982, p. 102).
observation, it is our view that educators should stop making classification and
4
allocation decisions involving those categories. The 20/20 analysis is presented
as an alternative procedure.
KEY FEATURES AND CONCERNS
The first feature of the 20/20 analysis is that it seeks to call attention to
the realities of individual differences (IDs) among students, especially students
whose progress in school learning is marginal. Despite much talk by specialists
about IDs, there has been vast failure to communicate the facts of individual
differences to many educators and to the public at large. The 20/20 analysis is
individual
portray
of
important dimensions
intended
to
differences
on
achievement within classes and schools and to link this to ways schools can
address such differences. This approach in no way diminishes the opportunities
to look at students whose learning progress falls in a middle range but draws
attention to the margins as well.
In references to IDs, it is not implied that the
differences are static or implacable.
All children can learn, and educators serve
best when attending to difference variables which are manipulable and alterable
- those with proven positive effects on learning.
Secondly, the 20/20 analysis focuses on the important outcomes or goals
of education.
In effect, it maintains that schools exist for specific purposes
most basically to cause pupils to learn in areas that may be regarded as "cultural
imperatives," such as learning to read and to think in quantitative terms. When
pupils fail
to learn in important areas, there is reason for urgent concern.
Equally, when pupils master basics readily, there should be concern for making
appropriate adaptations in their school programs so that they are challenged to
proceed to advanced topics and explorations of specialized fields of study.
It is
intended that the 20/20 analysis should focus on these most basic aspects of
student learning.
Thirdly, the 20/20 procedure is intended to undo the common practice
of labeling a child (perhaps as mentally retarded or emotionally disturbed, etc.)
as a first step in diagnosis and classification. Too often this labeling is deeply
resented and resisted by parents.
It can he deeply stigmatic for the child, yet he
mostly useless as a step in formulating plans for instructional improvement. The
20/20 analysis proposes that:
(a) the beginning step in diagnosis he direct
assessment of the rate of progress in learning; and (b) when learning progress is
diagnosed as low, it he taken as the first indicator that the child's instructional
program and/or life situation need(s) to he altered for the better.
5
5
intended to provide a reliable and
Fourthly, the 20/20 analysis
is
accountable system for dealing with instructional and learning problems. T le
hounda y
present categorical ("second system") approach involves numerous
For example, the category of learning disabilities, now the largeit
problems.
single category in special education, is virtually undefined. More importantly,
there is no evidence that distinctly different methods of instruction are required
1986;
by children grouped according to most of the various categories (Brophy,
Jenkins, 1987). Programs for students who are blind or deaf do have distinctive
stated
specialized instructional procedures and provide clear exceptions to what is
However, when classification is unreliable, as is so
more generally above.'
distinctive
often the case, parents have no way of clearly knowing what
expectations they should have regarding school programs or their rights and their
children's rights.
Educators can speak quite clearly and reliably to parents when their child
reading or
falls very low in rates of achievement in basic subjects such as
Educators also might agree to "raise a red flag" (alert parents)
arithmetic.
They
whenever a child falls below the 20th percentile level in rate of progress.
helpful
would then begin collaborative planning with the parents and
all
child.' In sum, the
specialists to arrange for a more favorable program for the
for
20/20 analysis could be helpful in improving the reliability of procedures
accountability for
identifying children with "special" learning needs and focusing
needs.
program adaptations to meet individual
of all
A fifth consideration is that by attending to the distributions
should be
children in learning the most basic school subjects, the 20/20 analysis
which
helpful in bringing about collaborative efforts among advocacy groups
sometimes operate in disjointed and competitive ways. For example, advocates
"flexible pacing"
for "gifted and talented" students sometimes narrowly argue for
students the
of instructional programs focused on giving high-achieving
lock-step programs
opportunity to grow at advanced levels, rather than be held in
Boston, 1985).
that may be repetitive and unchallenging (Cox, Daniel, &
would be
However, "flexible pacing" would be advantageous for all students. It
'The authors acccpt the meaningfulness of categories of students and programs in cases of
These arc instances
blindness, deafness, severe cognitive attenuation, and many speech problems.
instructional procedures
where characteristics of individuals arc definitely related to differences in
therapeutic
There are well-confirmed knowledge bases for educational and
and/or curriculum.
need to be segregated;
practices in these fields. This does not mean that the children in the category
"mainstream" arrangement.
only that the distinctive forms of education arc delivered, preferably in a
given school
2
Here the authors refer to the 20th percentile at a particular school. For example, a
percentile on national norms.
may show that 20% of their students fall below what would be the 10th
is to have a reliable
One could use various norm groups in working out a system; the main concern
means of locating students whose progress is "marginal."
4