ebook img

ERIC ED459185: Guide to Interpreting the 1999 MCAS Reports for Schools and Districts. Massachusetts Comprehensive Assessment System. PDF

54 Pages·1999·0.95 MB·English
by  ERIC
Save to my drive
Quick download
Download
Most books are stored in the elastic cloud where traffic is expensive. For this reason, we have a limit on daily download.

Preview ERIC ED459185: Guide to Interpreting the 1999 MCAS Reports for Schools and Districts. Massachusetts Comprehensive Assessment System.

DOCUMENT RESUME TM 033 461 ED 459 185 Guide to Interpreting the 1999 MCAS Reports for Schools and TITLE Districts. Massachusetts Comprehensive Assessment System. Massachusetts State Dept. of Education, Boston. INSTITUTION PUB DATE 1999-00-00 59p.; For the guide to the spring 2000 reports, see ED 454 NOTE 292. AVAILABLE FROM For full text: http://www.doe.mass.edu. Non-Classroom (055) PUB TYPE Guides MF01/PC03 Plus Postage. EDRS PRICE Academic Achievement; *Achievement Tests; Elementary DESCRIPTORS Secondary Education; School Districts; *Scores; State Programs; Test Interpretation; *Test Results; *Testing Programs *Massachusetts Comprehensive Assessment System IDENTIFIERS ABSTRACT This guide explains results and other information contained in the "Test Item Analysis Report," the "School Report," and the "District Report" for the Massachusetts Comprehensive Assessment System (MCAS) tests for spring 1999. It is designed to help teachers, administrators, and parents understand the MCAS testing program. The guide contains this section: (1) "General Guidelines for the Interpretation and Use of "Document Purpose"; (2) "Understanding the 'Test Item Analysis Report'"; and (4) MCAS Reports"; (3) "Understanding the 'School' and 'District Reports.'" Appendixes contain information on converting raw scores to scale scores, the MCAS reporting categories, content-specific performance level definitions, a list of the MCAS assessment development committee members, and MCAS-related references. (Contains 3 tables and 11 references.) (SLD) Reproductions supplied by EDRS are the best that can be made from the original document. SWART ME AI 0 The OA 4' * ifto MCAS1 Massachusetts 2 Comprehensive MASSACHUSETTS Assessment COMPREHENSIVE ASSESSMENT System SYSTEM PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY TO THE EDUCATIONAL RESOURCES GUIDE TO INFORMATION CENTER (ERIC) 1 INTERPRETING THE U.S. DEPARTMENT OF EDUCATION 1999 MCAS dice el Educational Research and Improvement EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) [WKS document has been reproduced as received from the person or organization originating it. O Minor changes have been made to REPORTS improve reproduction quality. gtr Points of view or opinions stated in this document do not necessarily represent ce) official OERI position or policy. 2 FOR SCHOOLS AND DISTRICTS BEST COPY AVAILABLE Massachusetts Department of Education This document was prepared by the Massachusetts Department of Education. David P. Driscoll, Commissioner of Education 350 Main Street, Malden, Massachusetts 02148-5023 (781) 338-3000 TTY: N.E.T. Relay 1-800-439-2370 This document and many other Department documents and publications are also available on our Internet site at www.doe.mass.edu. Copyright November 1999 by Massachusetts Department of Education. Permission is hereby granted to copy any or all parts of this document for non-commercial educational purposes. Please credit the Massachusetts Department of Education. 3 Commissioner's Foreword Dear Superintendents, Principals, Charter School Leaders, Directors of Collaboratives and Chapter 766 Private Schools, and Other Interested Parties: This guide is intended to further explain results and other information contained within the Test Item Analysis Report, the School Report, and the District Report for the Massachusetts Comprehensive Assessment System (MCAS) tests of spring 1999. We hope that you will find it useful as you review the results for your school and/or district. The MCAS tests are an important part of our state's effort to improve teaching and learning across the Commonwealth. It is vital that all teachers, administrators, and parents understand the MCAS testing program, as all have essential roles to play in helping students to succeed. The state is committed to working in partnership with schools and communities to improve the academic achievement of all public school students in Massachusetts. If you have questions after reviewing this guide, the Test Item Analysis Report, the School Report, or the District Report, please contact MCAS Support Services at 1-800-737-5103. Sincerely, David P. Driscoll Commissioner of Education Table of Contents Commissioner's Foreword Document Purpose I. II. General Guidelines for the Interpretation and Use of MCAS Reports 3 III Understanding the Test Item Analysis Report 5 Overview 5 A. English Language Arts Test Item Analysis Report 7 Individual Student Results 7 Results Aggregated at the School, District, and State Levels 10 B. Mathematics, Science & Technology, and History and Social Science Test Item Analysis Reports 13 14 Individual Student Results Results Aggregated at the School, District, and State Levels 16 IV. Understanding the School and District Reports 19 19 Overview A. Students Tested 21 24 B. Performance Level Results 24 C. Distribution of Results by Scaled Score Interval D. Results by Student Status 25 26 E. Subject Area Subscores 27 Three-Year Comparison of School Results F. Appendices 29 A. Raw Score to Scaled Score Conversions B. 1999 MCAS Reporting Categories by grade and content area 36 C. Content-Specific Performance Level Definitions 41 D 1999 MCAS Assessment Development Committee Members 45 50 E. MCAS-Related References THE MASSACHUSETTS COMPREHENSIVE ASSESSMENT SYSTEM: Guide to Interpreting the 1999 MCAS Reports for Schools and Districts I. Document Purpose The primary purpose of this document is to support local educators' use of reports of results from the spring 1999 administration of the Massachusetts Comprehensive Assessment System (MCAS). This document describes and explains how to interpret information provided in the following MCAS reports: MCAS Tests of Spring 1999: Test Item Analysis Report' MCAS Tests of Spring 1999: School Report MCAS Tests of Spring 1999: District Report These reports contain information that will be valuable to schools and districts in their efforts to better serve the academic needs of individual students and to evaluate and improve curriculum and instruction. In addition, this document can help school and district personnel communicate with their communities about the MCAS test results. , 1 The MCAS Test Item Analysis Report contains confidential test results for individual students. Therefore, the Test Item Analysis Report is a nonpublic document subject to access restrictions dictated by state and federal law. See page 3 for additional details. THE MASSACHUSETTS COMPREHENSIVE ASSESSMENT SYSTEM: 1 Guide to Interpreting the 1999 MCAS Reports for Schools and Districts II. General Guidelines for the Interpretation and Use of MCAS Reports ALIGNMENT OF CURRICULUM AND INSTRUCTION Test results contained in the 1999 reports should be interpreted with caution. At the time these MCAS tests were administered, many schools were still in the process of aligning their curricula with the new state standards defined in the Massachusetts Curriculum Frameworks. As a result, some students may not have been exposed to all of the content covered by the MCAS tests. Also, because the tests were based on the high academic standards in the Frameworks, the tests were likely very challenging for many students. Over time, as students and teachers become more familiar with the new standards, test results should show student progress. USE OF WAS STUDENT-LEVEL RESULTS MCAS results are intended to evaluate how well students and schools are achieving the learning standards contained in the Curriculum Frameworks. Individual student results and school-level results will help teachers and parents focus on areas in which students need assistance in order to improve their individual performance. It is important to note that MCAS is only one indicator of student performance and, therefore, should not be used as the sole basis for referring students to special education. MULTIPLE DATA POINTS NEEDED FOR TREND ANALYSIS Two years' test results provide limited information about a school's or district's overall performance. As with any evaluation, school and district test results are most meaningful when compared with other indicators and when examined over several years for long-term trends in student performance. STATE REGULATIONS REGARDING CONFIDENTIALITY OF STUDENT RECORDS The Massachusetts Student Record Regulations (603 CMR 23.00) and the Family Educational Rights and Privacy Act (FERPA) require that access to individual student results, including those provided in the MCAS Test Item Analysis Report and the MCAS Student Report for Parents/Guardians, be restricted to the student, the student's parents/guardians, and authorized school personnel. Superintendents and principals are responsible for maintaining the privacy and security of all student records. In accordance with these state and federal regulations, authorized school personnel shall have access to the student records of students to whom they are providing services, only when such access is required in the performance of their official duties. MAKING COMPARISONS AMONG STUDENTS, SCHOOLS, AND DISTRICTS Scaled scores are the most appropriate statistic to use when making comparisons of MCAS results among students, schools, and districts. When interpreting the meaning of these comparisons, how- ever, it is important that decision-makersteachers, administrators, and policy makersrecognize that some apparent differences in scaled scores may not be statistically or educationally significant, some guidelines for comparing results are explained on the next page. 3 THE MASSACHUSETTS COMPREHENSIVE ASSESSMENT SYSTEM: Guide to Interpreting the 1999 MCAS Reports for Schools and Districts 7 Comparisons of Student-Level Scores When comparing the scores within a subject area and grade level test of two or more students, or comparing the scores within a subject area and grade level test of a student to that of the school, district, or state, it is critical to examine the probable range of the student's scores displayed in the Student Report for Parents/Guardians. If there is an overlap in the probable ranges of the scores being compared, there is little statistically or educationally significant difference between the two scores. This is true even if the two scores fall on the opposite sides of a performance level threshold. Comparisons of School- and Distrid-Level Scores The statistical significance of these comparisons is based on the number of students tested. Whether making comparisons within a single year or across years, the table below will assist in comparing the scores of two or more schools or districts, comparing the scores of a school to the district and/or state, or the scores of a district to the state. The table shows the smallest differences in scores that represent a statistically significant difference in performance, based on the number of students tested in the school and/or district. It is not appropriate or possible to compare a school's or district's scaled scores across two subject areas since the scaled scores in each subject area were determined by separate standard-setting processes. TABLE I. NUMBER OF SCALED SCORES POINTS DENOTING MINIMALLY STATISTICALLY SIGNIFICANT DIFFERENCES FOR SCHOOL/DISTRICT RESULTS Number of Students Tested in School/District 200 Grade 100 50 Subject 10 25 English Language Arts 2 2 3 1 1 Mathematics 4 4 2 6 2 1 Science & Technology 2 3 5 1 1 English Language Arts 2 5 3 1 1 Mathematics 4 7 3 2 2 8 4 2 Science 8c Technology 3 6 1 History and Social Science 2 3 1 1 .5 English Language Arts 2 4 3 1 1 Mathematics 4 2 7 10 3 1 Science & Technology 2 2 5 3 1 4 THE MASSACHUSETTS COMPREHENSIVE ASSESSMENT SYSTEM: Guide to Interpreting the 1999 MCAS Reports for Schools and Districts 8 III. Understanding the Test Item Analysis Report OVERVIEW The Test Item Analysis Report provides results from the MCAS tests of spring 1999 for students test- ed in grades 4, 8, and 10. This MCAS report shows how each student tested in a school answered every common multiple-choice question performed on each common open-response and short-answer question performed on the English Language Arts Composition (writing prompt) The report also summarizes overall performance at the school, district, and state levels for each of these items. Each school receives a separate Test Item Analysis Report for each subject area and grade tested in the school. Reports for English Language Arts differ slightly in structure from those for Mathematics, Science & Technology, and History and Social Science (see pages 13-18 of this chapter for details). This detailed information at the student, school, and district levels can be used for identifying strengths and weaknesses exhibited by students curriculum evaluation and planning in the classroom, school, and district summary reporting to parents and the public (See caution regarding confidentiality of student records below). As noted above, the Test Item Analysis Report shows results for MCAS common items, the basis for all student-level MCAS scores. The report is designed to be used in conjunction with the publication, The Massachusetts Comprehensive Assessment System: Release of Spring 1999 Test Items, which shows all the questions upon which the Test Item Analysis Report is based. When the report and the publication are used together, educators are provided with a detailed picture of student performance. This picture should be used in combination with other information from the classroom to develop a broad-based overview of students' academic achievement. CAUTION: Confidentiality of Student Records. The Massachusetts Student Record Regulations (603 CMR 23.00) and the federal Family Educational Rights and Privacy Act (FERPA) require that access to individual student results, including those provided in the MCAS Test Item Analysis Report, be restricted to the student, his/her parents/guardians, and authorized school personnel. Since the Test Item Analysis Report provides individual student level results for all students tested in a particular school, schools must not provide parents/guardians with direct access to the school's report. To facili- tate the sharing of individual student results contained in the Test Item Analysis Report with parents/ guardians, individual student labels are provided for each student. Each student label contains all of their student-level results included on the Test Item Analysis Report. Superintendents and principals are responsible for maintaining the privacy and security of all student records. In accordance with these state and federal regulations, authorized school personnel shall have access to the student records of students to whom they are providing services, only when such access is required in the performance of their official duties. 5 THE MASSACHUSETTS COMPREHENSIVE ASSESSMENT SYSTEM: Guide to Interpreting the 1999 MCAS Reports for Schools and Districts 1 1 l e . e f v I I I I I r F F F F F F F F F F F F F F F F F F N N N N N t e e a P L i e r l a p v i n o d d s i r e e g 0 8 6 8 8 8 0 0 0 0 2 0 2 6 6 6 6 8 8 8 0 0 a 4 p t l f i 0 0 1 1 1 1 2 2 2 a 0 0 1 1 1 1 1 1 1 1 1 2 2 1 c p t e r f n e o 2 2 2 2 2 2 2 2 2 e 2 2 2 2 2 2 2 2 2 2 2 2 2 c 2 a S e S r d s s r e m e o i i c r p t t c s e c n n r l o t a o r m 8 t 8 8 2 e e n 4 8 8 9 2 2 2 6 7 9 7 0 3 0 1 1 1 0 2 o o l t c e 2 2 3 2 2 2 2 3 3 3 m m e 1 1 1 o 3 3 3 2 3 2 3 r c e v T m s S p p s 2 3 b e 2 i 1 i o o e d e C T o e l l r 1 C 5 A 3 e e A B A D r D A i B B A A 0 M t r e L 0 B 1 u 4 u : O u v v s r q e t e e e t o c d A c B e B D t C B B B d d 0 A A T m A A u a e g u A + r C A B A M 4 i r L e r a a r s t B t s a p s n e e B s D + A + ' D + + 9 C T d k + o D D d d D A P A e e D + s e e D 3 C L r M C + i i c a p s c e C r r + C D + n n t p n + n o o A C B + + A 8 e o e a + e D + + + A + M c c c + B 3 L t p A h A t n t d n i i i O l p p p s t 2 3 A 1 c e 1 n T 3 7 e R 1 o I e o o o o 1 s a 2 s 1 2 2 3 L l r O 1 i t t t t 1 D I 2 o r = = = = = = + A O 1 C t h T B + 6 A B B D A A + D A 0 + C s + M + L 3 C c D i + R K + X Y P J D C D C C + S C D T + 5 C S T S T T T B D + C + + + M 3 L C + C C s C C s C T 4 C A C A + B D A C C u + B 3 L M u B + A A 1 o D A B o D C B + d C 0 T A 3 + A B DA 0 D A i n M A 3 i L A t O e t B 0 B + B + i d B C T 2 + B A i C B C o C t C e + B + 1 + t 3 L M D c t t C c C D A a g A 0 B i C + A D D A C A i c n A 8 F A A 1 + D A C + 0 F i i M n l L + 3 y + + C p A A D B A n C A B l + : m l : C T A 0 A : B C u i : + g e B l + + # L 3 M f A t o e o e + D D B C - D A d c + A c D + b r D + + C 7 A a o O A 9 + i + + g D n a m M c L + r 2 d n h I i 2 e 1 1 o 1 r t 2 22 e i 7 d 1 1 T R n 8 l r c r s 1 z G l n 2 2 0 2 2 o I f n L 2 O 1 k A 2 i o A i S n m a - A d a a + A - t D a l e e e C - o B p y T 7 D C d g D A + s D AB w w 7 M l - + 2 a r f L a h d + o o + e B o e e d C ++ C T 6 c + r e + r f r + r + + + + e 7 f B + C + e a + + 2 L M c = o y S + s + t n l o D t s B t u B e d B + e n C C + A r a A 5 A 7 T B p b A + e + + d B e + e + t M + + 2 L o i s t d o e v B s A + B u n + C B i B C t b e C B B i 4 T 1 D B D D s n + O C s C C e e 2 M L o s n C e d B C w r r t o + B e e D C C + a a C - + C B C d A o D o 3 + w + e s A B B e - M 2 h - s s e A n D L - t s + i e e A + A s c c c A i A i A D A + A t + A n + b C T B A n + i i - - n g g 2 n n + e L M e n s 2 s n - - B a a + D D B t T D d a + t i D i n + + - B + m A t i h C f t C + B d u e i 2 i i e C C A r D h r c v 1 t d w e w s s s M + e C L B C B 2 B i B + A D m C - m + = = = = = + e C T 0 A C A + A + + + = 1 L 2 M = 0 1 t I + O . 2 2 2 1 C R 0 1 K X Y S T J 0 s 2 T s T 9 A M M 2 2 O M 2 O O O 1 + 0 D L 1 - y + e D F A C C T 8 k C C A C B + + + D + A + C r M + + S 1 L - A C : - o - + + C C +A + C 7 B + C 7 D E B + + T 7 + O c A 1 M 8 L t l B l + r + e + + + - s o + D - 6 + n + + C C T + w 0 + + 1 B l D B , L M C u C e D C C D D d e C f d D A C + n g e B + C 0 T 5 A o n C + + s + m M n A t L 1 y i D u 9 D n C D B 0 , l D C + + A t e a D C T C 4 e D a c + e o B + D t + 9 r + e 1 L M C a s m W y s + A D D r B + + r D C A t r D B j + B A s D e s B o 9 s 3 e T 0 A o t y B e c D i c r M 1 r l i t L + v e C a C t n o r e D + B D + c + D d 1 i + + C p v a m A t D C 2 C C T e C A c e A d + h + + 1 e s r n L M i A g c r l B + D e r A A i p A + o v + t o e o n A d s g A A D s C p A A B A c m m i A e 1 B i + + A t R a d M l L c A 1 s d 2 1 i 2 w n 1 s e e u 2 t e a 2 2 2 O 2 2 o 2 2 T R d 2 C s 0 2 I s e s n 2 2 1 1 s e u L w C 1 A O i u g + h d + A e e a s e B t r A r t B s n c e o C a r + s T C e i e C y a A B 8 a B A + D B B + + w 9 C p e e + e M + a D b L B v s a r k s C + + w f u f + u r a + C o e C C T C D + S B B e d y t l 8 A A m c i a l A L A M r e l u y i C D C a u n t s + g s r t A C + A l e e e o A C t + u T l B s D c i C C C d + + 7 a C + C n f a n r o M D A L i a e n c e o D s + + e o + v C g + i 8 c h + n i C C T g t A B e + r a a A C A n c d g a + 6 + a L M C C u m e + e n e B d D + A e D h g s t + t i s n r m A t i i C d D C L n B A C o m i Y C e r l C + C C 5 + + r a B a w w M l e A L t D o s B i s + A l l r S e C w s + g = + = = = = D A T C B D B m A r + A + + 4 + + L = M h = C h e A B B p B R B S M D B C B B C P t K X Y U U T T A B J s e + 3 + A 3 M + m M 1 O L L L L G G C L D C + B w D B A + + i t C C D D 0 R T D + + D I l 2 D D M S L o e g Y t P M J R C A C d D W n s 1 M e S t P e e s E d C X i S S P f R R R S M s K K S r R C K W g J K T U U o t 1 W M M T M s S S T M D O w M t O G G P u a M t 1 n t l X S d R R K a U y K P f p X X S K Y e Y n R C X R W X o J v l U M O X 1 t W S T M a O O T O L D e T S c S S G T d G D s e l y e a l X S r r X O r a e r u O a P X P K Y P o P C K X P P X Y K J J d O t J U l T W T 1 s u O M c T T O O S S S S n T T n T T T 1 y n G h b S a l d N e i a 6 i e s d v - S S n C - c f 6 c 4 7 6 6 6 7 6 6 6 5 6 6 6 5 5 3 i i I 4 e e 1 6 o l - t E N N W C p c p m v 8 e e p a c - o P S S - 8 T - M f f l a i 1 1 6 9 6 6 7 9 8 8 7 8 6 6 6 i o l f p i W 1 N N C o - I e e 1 1 e - s I o e v l y o d t M r e S s r y l a r e e e r l e d t u e r s h A n A A A A p A s A a A A f o w N N N N N N O N N N N u e t o b e N N N e N y N N N N N N g N t b N N c r s m i T t T T T T T T T T T r T M v a T T T o o T e C T T T T T n s T o i T T S T c S S S S S S S S S n p u S S S t w S m t l A S S S S S S a a S S p R S e N R R R R e R R R R R d R R o R R c u R r R R R R C r e R R R R e C I h R a I I I I a i s I I I I I I I F t I m 1 F F F F t e I s F F F F F I I I I a F F I F I I I s F M s s g I F F F F n F e F F F E m F g , , , , , l , l l e , , , , , i n i i g 3 4 4 0 3 6 , , a a a n 1 2 1 1 1 , s m , , , , 6 8 , t a , t , , , 5 i R t 1 7 8 8 7 t t 4 2 6 4 8 i I l 9 7 3 3 0 0 t c 9 4 1 7 e t i e e s 4 0 a a r 2 i 8 4 8 9 0 0 0 0 0 r e d 6 d d 4 1 1 1 0 u 7 1 5 o 0 1 0 1 t r w 1 O e 0 0 0 0 g E E E E E r 0 0 E E E E 0 0 0 p = = = E E E E r E d E E E E = E E = o e E E E M M M M M M M M M M M M M C l M = P E M M M M C R M M M M M I s A A A A A A A A A I A Y U U A A A X K n A J V S n A A A A A A A E N N N N A A N N N N N D G N D G D D N N I N N a M s N N N N N t N N N T T T T N T u T T T T T B 1 T T T T m M H T T T T T S S S S T T 7 S T S S S S S S S T = S S I c 1 s S S S S S u I A A A A S S A S A A A A A S A A A , A 1 I 1 3 0n e A -E E c 5 G P a A A A A A 5 L L L L 1 A A - L s A L L L 1 L L L m A L M ' n L s r N . L L L L L L L A . . . . . L e . . . . . O L o . a . . . 3 4 5 6 7 1 2 8 9 3 0 o 1 z 0 0 0 0 2 i 3 r N ) - . . . . . C . - p c i N . . u r 1 1 1 1 1 . 3 5 7 9 F 2 1 1 1 1 1 1 0 6 2 4 8 2 2 2 I 1

See more

The list of books you might like

Most books are stored in the elastic cloud where traffic is expensive. For this reason, we have a limit on daily download.