RFCVNIF U0 007 618 ED 023 776 24 By -Haseridge. David G.; And Others A Study ot Selected Exemplary Programs for the Education of Disadvantaged Children:Part I. Final Report. American Inst. for Research in Behavioral Sciences, Palo Alto, Cabl. Spons Agency -Office of Education (DHEW), Washington. DC. Btereau of Research. Report No -AIR -752 4 -68 fR Bureau No-BR -84013 Pub Date Sep 68 Contract -OEC -0 -8 .089013 -3515 (010) Note -118p. EDRS Price MF -S050 HC 4600 Descriptors -Bibliographies. Cognitive Ability, Cognitive Measurement, "Compensatory Education Programs, Cost Effectiveness, Data Analysis. Data Collection. "Disadvantat3ed Youth, Guidelines, "National Surveys, Program Design, "Program Evaluation. Research Methodology, Urban Schools The principal aims of this study were to identify. select, analyze. and describe educational prowams for culturaly disadvantaged children from preschool through Identification grade 12 which had yielded measured benefits of cognitive achievement. and selection were accomplished through a literature search and the advice of a panel of experts. Site visits to .98 programs in 31 urban areas assisted in further selection and provided data for analysis. Twenty-one programs were designated as exemplary: in each. pupils had achieved statistically significantly better scores on I of standarthed tests than had controls, or than national normative figures. In Part the Final Report the study is described and a tentative analysis of the programs' and components is presented. Conclusions include guidelines for program -and design evaluation and possible approaches to cost-effectiveness analysis for compensatory education procjrams. Extensive bibliographies are also included. (For Part II of this report see W 007619) (Author) 9o/s) 41* On/E. AIR-752-9/68-FR FINAL REPORT Project No. 089013 Contract NO. OEC-0-8-089013-3515 (010) A STUDY OF SELECTED EXEMPLARY PROGRAMS FOR THE EDUCATION OF DISADVANTAGED CHILDREN PART I September 1968 U.S. DEPARTMENT OF HEALTH, EDUCATION, AND WELFARE Office of Education Office of Program Planning and Evaluation j U.S. DRAIIMENT Of HEALTH, EDUCATION & WENN OWE Of EDUCATION INS DOCUMENT HAS 11111 REPIONCED EXACTLY AS REMO RON TNE PERSON 01 ORGANIZATION 01161011116 IT. POINTS Of VIEW 01 OP111015 STAR DO NOT NECESSARY NEMESIA OffICIAL Off la Of HIRAM P011101 Olt POUCY. AIR-752-9/68-FR Final Report Project No. 089013 Contract No. OEC -0-8-089013 -3515 (010) A STUDY" OF SELECTED EXEMPLARY PROGRAMS . FOR THE EDUCATION OF DISADVANTAGED CHILDREN Part I David G. Hawkridge Albert B. Chalupsky A. Oscar H. Roberts American Institutes for Research in the Behavioral Sciences Palo Alto, California September 1968 Tht research reported herein was performed pursuant to a contract with the Office of Education, U.S. Department of Health, Education, and Welfare. Contractors undertaking such projects under Govern- ment sponsorship are encouraged to express freely their profes- sional judgment in the canduct of the Points of view project. or opinions stated do not, therefore, necessarily represent official Office of Education position or policy. U.S..DEPARTMENT OF HEALTH, EDUCATION, AND WELFARE Office of Education Office of Program Planning and Evaluation TABLE OF CONTENTS PART I. Page LIST OF TABLES iv LIST OF DIAGRAMS iv ACKNOWLEDGEMENTS SUMMARY 1 INTRODUCTION 3 Background 3 Limits of this Study 7 11, Related Research 8 METHODS ANT PROCEDURES 10 Selection of Programs to Visit 10 Site Visiting 12 P5oblems in the Analysis of Data 14 Methods of Presenting and Summarizing Data 25 RESULTS AND FINDINGS 32 Overview 32 Program Components 32 37 CONCLUSIONS AND RECOMMENDATIONS Guidelines for Program Design and Evaluation 37 Approaches to Cost-effectiveness Analysis in Compensatory Education 47 REFERENCES 57 BIBLIOGRAPHY 60 Organization of Bibliography 60 General Sources 61 ii (71) TABLE OF CONTENTS (Continued) Page Sources for Programs Studied bat not Described 70 APPENDIXES 109 * ERIC REPORT RESUME 113 s iii LIST OF TABLES Table Page Summary of Educational Programs Described 1 33 LIST OF DIAGRAMS Diagram Page 1 National and Disadvantaged Achievement Norms 30 Three Examples of Program Yields 2 31 An Example of no Change in Median but a Change 3 in Distribution 42 4 An Example of a Change in Median and Distribution 43 The Relationship between Equivalence and 5 Regression Lines 44 ACKNOWLEDGEMENTS We are grateful first and foremost to the many people, from superintendents to teachers, who gave time especially during our site visits to tell us about their programs and-to answer our questions. What they said added immeasurably to the written reports, and without their help the program descriptions could not have been prepared. Our consultants were also most helpful. In particular, we should like to acknowledge time unstintingly given by Professor Edmund W. Gordan, formerly of Yeshiva University, now at Teachers College, Columbia University, and Director of the Educational Resources Informa- tion Center (ERIC) for the Disadvantaged. His encyclopedic knowledge of the field prevented us from making needless trips and enhanced what we were already doing. In our literature search we received much assistance from Dr. William Paisley, Deputy Director of the Educational Resources Information Center for Educational Media and Technology at Stanford University, and his staff. This study was the work of a team which included at various times William Abbott, Peggie Campeau, Ettore Coluzzi, Anne Klein, Debbra Michaels, Caroline Smiley, Kasten Tallmadge, and Thomas Tanner, as well as the three authors. David G. Hawkridge Project Director SUMMARY The aims of this study were to identify, select, analyze, and describe educational programs for culturally disadvantaged children from preschool through grade 12 which had yielded measured benefits of cognitive achievement. The written reports of over 1,000 compensatory educational pro- grams were perused in a literature search carried out mainly through Educational Resources Information Centers (ERIC), libraries, and some 300 mail requests. With the assistance of a panel of national experts, a.list was compiled of about 100 programs, selected not on the basis of geographical area, grade level, or type of treatment, but because each.was believed to have enabled its pupils to make greater gains in measured cognitive achievement than they normally would have made had they not received the program. The list was restricted also by con- sidering only programs reported between 1963 and 1968. A schedule of site visits was established and carried out, to include eventually 98 programs in 31 urban areas and 16 states. During the site visits, structured interviews were held to obtain all data necessary to decide whether the program under study had indeed provided measured benefits of cognitive achievement, and if it had, to compile a complete description and to conduct an analysis of the components of the successful programs. The site visits were conducted by five senior staff of the American Institutes for Research, with assistance from other staff on two occasions. The routine for the visits was evolved through a careful pattern of training and adaptation, and normally involved discussions with one or more senior persons in each program, as well as some of their subordinates. Visits were followed up by mail and telephone where necessary. Site data were analyzed in the Palo Alto offices of the American Institutes for Research, and final decisions were made about the in- clusion of each program visited in the set of descriptions which forms Part II of the Final Report. No study was accepted for description unless data available indicated that pupils in the program had achieved statistically significantly better scores on standardized tests than had controls, or than national normative figures. In the analysis of site data it became evident that few if any compensatory education programs are free from blemishes of sampling, design, testing, data recording, or interpretation. Many apparently successful programs could not meet the strict criteria established for this study. Some that did may have done so through the undetected biases in their data, rather than by their educational significance or success. Inclusion of a program description in this report does not guarantee that its results are better than some not described, whether visited or not. 1 Part II of this Final Report compripes the descriptions of 21 Each description was written programs which met the study's criteria. according to a specially developed format, to provide a concise yet readable account of the nature, operation, and results of each program The for principals, *superintendents, and other interested persons. U.S. Office of Education, sponsors of the study, requested that the descriptions be written so that enough detail was offered for a pre- liminary decision to be made in a school district about the desirability The descriptions include of attempting a locally modified replication. seven referring to preschool programs; 14, to elementary pupils, and They range from small-scale experiments six at the high school level. for less than 100 children to major programs involving many thousands. Most are inner- Some operate during school hours, others after school. city projects for Negroes or Spanish-speaking Americans, but some The preschool serve Appalachian white and other minority groups. speaking, programs claim improvements in intelligence ratings, generally while the others show benefits in terms of reading grade-equivalents. Each is unique in the treatment it provided. Part I of this Final Report, although much more technical, is an Apart from intrinsic part of the study and should not be neglected. providing background to the study, and an account of its limits, it contains full details of the methods or procedures followed and of typical characteristics of the programs The problems encountered. described are discussed, followed by a tentative analysis of the The question of apparently well designed pro- programs' components. of cognitive grams which yield unimportant or no measured benefits Guidelines for program design and evaluation achievement is explored. A closing section deals with possible approaches to are proposed. A cost-effectiveness analysis for compensatory education programs. list of references is followed by two extensive bibliographies, one providing general sources on the culturally disadvantaged, the other citing all materials collected during the study and relating to programs not described. In the tentative analysis of programs described, several common com- ponents were identified, such as a pupil-to-adult ratio of no more than It is possible that these are c mponents critical to the seven to one. of cognitive achieve- success of programs in yielding measured benefits the study ment, but no firm conclusions could be drawn on this point, as (successful) did not include a comparison between common components of successful) studied but not described. programs described and ones (not The guidelines offered for program design and evaluation concentrate using appropriate upon a detailed, comprehensive, and accurate approach statistical tools. there needs to The discussion of cost-effectiveness concludes that be a greater number of successful programs to choose among, as well as more comprehensive data on inputs and outputs. 2 INTRODUCTION Background Educational programs for children in poverty areas have become part of the fabric 'of modern America. They represent a determined and widespread series of attempts by political leaders, educators, and others to offset the shortcomings of the environments in which the poor of America live, by providing additional educational facilities. These facilities have been of many kinds, from summer school programs to pre- school programs, from new libraries to field trips. Twenty years ago probably few, besides political representatives from depressed areas and educators serving them, realized the importance to the nation's life of these programs. Today, economists, political scientists, psychologists, physicians, businessmen, industrialists, and others agree that a heavy burden is carried by American society as a whole while such disparity remains between the results of educating the poor minority. This general concern has been reflected in the legislatures, where bills have been passed which provide federal and state funds for programs designed to improve the educational standing of.children who come from culturally different, poverty-stricken districts. Negroes..perhaps by virtue of their presence in inner-city environ- ments, have been the subjects and beneficiaries of more educational pro- grams than have migrant workers, poor families of Spanish-speaking back- ground, Ametican Indians, and Southern rural or mountain whites. But from all these groups, children come to school disadvantaged to the extent that their culture has not prepared them for school because it has not provided the experiences normal for the children the schools have been accustomed to teaching. When such children enter school, the cultural barrier between them and the teacher must be broken down. There have been several ways in which this has been attempted. Some-programs have set out to train the teacher better (Jablonsky, 1966). The curriculum for such training .courses has included the study of behavioral repertoires of children from Negro, Puerto Rican or Mexican cultures, in order to establish learning needs and sttategies for preschool children. Examples of such studies are the Early Childhood Project (Deutsch, in New York City and the Tucson Cooperative Project (Henderson and Wetzel, 1968). Teachers have also studied the few available sets of materials developed specific- ally for use by particular groups of disadvantaged children. 3
Description: