DOCUMENT RESUME ED 359 605 EA 025 019 AUTHOR Stronach, Ian, Ed. TITLE Quality Assurance in Education_: Plans, Targets and Performance Indicators. Current Issues. INSTITUTION Scottish Office Educatior Dept., Edinburgh. HM Inspectors of Schools. REPORT NO ISBN-0-7430-0747-4 PUB DATE 93 NOTE 19p.; For a related document, see EA 025 018. AVAILABLE FROM HM Inspectors of Schools, Audit Unit, New St. Andrews House, Room 4/36, Edinburgh, Scotland EH1 3TG, United Kingdom. PUB TYPE Viewpoints (Opinion/Position Papers, Essays, etc.) (120) EDRS PRICE MF01/PC01 Plus Postage. DESCRIPTORS *Educational Assessment; *Educational Quality; Effective Schools Research; Elementary Secondary Education; *Evaluation Criteria; Evaluation Methods; *Performance; *School Effectiveness; Self Evaluation (Groups) IDENTIFIERS *Scotland ABSTRACT Issues in ensuring educational quality are examined in this document. Section 1 provides information for developing plans and targets. The following areas are highlighted: school-effectiveness research findings; developments in Scotland to improved educational quality; internal and external evaluation of schools; evaluation criteria; the role of the school development plan; and strategies for school self-evaluation. The second section examines performance indicators, with a focus on the role, characteristics, and types of performance indicators; agencies and organizations involved in developing performance indicators; the indicators produced by Her Majesty's Inspectors; the critical performance indicators; and using performance indicators to best effect. (Contains 16 references.) (LMI) ************************************:c********************************** Reproductions supplied by EDRS are the best that can be made from the original document. *********************************************************************** THE SCOTTISH OFFICE Quality Assurance in Education: Plans, Targets and Performance Indicators Current Issues U.S. DEPARTMENT OF EDUCATION Once a Edo Caff0hal RosetocP and Impeommhfh EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) 00Curhht has Wen recooducd as Tnrs reserved from the parson or Orgasm/Man Ongmatmcf Or Changes neve Won mad* to ow/rove C 'eotoducnon ovanty OfhmOnS Stat41 mimsdoeu- Points of wetrr mane do not hCSlashly rOffsSent Oft.C151 OE RI oosdon or DOI.Cy PERMISSION TO REPRODUCE THIS Audit MATERIAL HAS BEEN GRANTED BY o(.4z_aa/z/2-- HM Inspectors of Schools TO THE EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) BEST COPY AVAILABLE ISBN Number 0 7480 0747 4 CO Crown Copyright 1993 HM Inspectors of Schools. Audit Unit commercial purposes. or in This paper may be produced in whole or in part. except for and date thereof arc connection with a prospectus or advertisement, provided that the source stated. INTRODUCTION offered by Headteachers and others in the The idea for this document arose out of comments suggested to us that we number of Audit Unit meetings. It was course of discussions at a discussion issues covered in the keynote talks and should pull together, in one document, the groups. planning, will be of use in school development This we have done. We hope that the document for meetings and seminars on quality assurance. in-service training and as a reference source Assurance in complement to the report on "Quality We feel that the paper provides a useful Education: Current Debates".* HM Inspectors of Schools, Audit Unit May 1993 0 0 University of Stirling, 1993 * Edited by Ian Stronach and published by .1 CONTENTS Page Section 1: Plans and Targets Do Schools Make A Difference? 1 1.0 2 Why The Concern With Issues Of Quality In Education? 2.0 2 Education? What Are We Doing To Improve Further The Quality Of 3.0 4 How Do We Evaluate The Quality Of Education? 4.0 4 Internal Or External Evaluation Of Schools? 5.0 5 Evaluation? What Should Be The Reference Point For Internal 6.0 5 What Is The Role Of The School Development Plan? 7.0 7 How Does A School Evaluate (Audit) Its Performance? 8.0 Section 2: Performance Indicators 8 What Should Performance Indicators Do? 9.0 8 What Forms Do Performance Indicators Take? 10.0 9 What Characteristics Should Performance Indicators Have? 11.0 9 Who Is Developing Performance Indicators? 12.0 10 What Sort Of Indicators Have Been Produced By HMI? 13.0 11 What Are The Critical Performance Indicators? 14.0 11 Using Performance Indicators To Best Effect 15.0 Section 3 13 Further Reading 16.0 I I SECTION 1 DO SCHOOLS MAKE A DIFFERENCE ? 1.0 The overwhelming message of HMI and research findings is that schools do indeed 1.1 make a significant difference to the attainment of their pupils. This apparently common-sense conclusion had been questioned in the mid-1970s. 1.2 Research at that time argued that because parental background and other social factors most important in determining attainment, the contribution of schools could were be regarded as relatively small and unimportant. It is now recognised that individual schools differ widely in terms of the progress made 1.3 by children with similar backgrounds. Thus, according to Mortimore: y than account some schools are more r outcomes. This is an encouraging message for all involved in education. It stresses that schools 1.4 disadvantage and can have a significant effect even where there is considerable deprivation, for as pointed out by Reynolds: is that l soda stns 1007 0 n o r 1 uerice. fey can have aubstantiai ve/opment if they can become upon young The possible magnitude of school effects was illustrated in a Scottish study by Willms 1.5 and Cuttance. After controlling for family background characteristics and pupil ability prior to entering secondary school, they found: cols e s QS Researchers have identified a number of different sets of features linked to school 1.6 effectiveness and these sets have much in common with each other. Hopkins identifies literature is in agreement: two issues in particular on which the school effectiveness BEST COPY AVAILABLE Two of the most 1.7 important features in the culture of an effective school are the presence of high expectations and supportive relationships, as summed up by Hargreaves: 2.0 WHY THE CONCERN WITH ISSUES OF QUALITY IN EDUCATION ? 2.1 There is universal recognition of the right of all pupils in our schools to receive a high quality education. 2.2 The quality and effectiveness of the education system critically affects the economic well-being of the nation. 2.3 There needs to he continual improvement in the standards of provision and attainment because pupils have to be equipped to contribute to, and participate fully in, an increasingly complex and changing society. 2.4 Our future in the wider Europe and the World community depends on us being able to develop and use effectively the human resources available to us. 2.5 Very large sums are expended on education. It is necessary to ensure that there is a good return for this and that schools provide value for money. 3.0 WHAT ARE WE DOING TO FURTHER IMPROVE THE QUALITY OF EDUCATION ? 3.1 National developments in recent years have focused on building a framework within which high quality education can be provided. They have pointed towards a quality culture: to promote improvement as the central thrust of schools' planning; to improve institutional approaches to achieving what has been described as systemic quality, that is, quality that pervades the institution, as distinct from but embracing, and more powerful than, individual quality. Within the overall strategy, there have been a number of related developments on, for example: the curriculum 3.2 The 5-14 programme is a major curricular initiative clarifying learning outcomes. providing a structure for continuity, coherence and progression, and promoting a range of approaches to learning. The associated programme of national testing focuses attention on levels of attainment. 3.3 The Standard Grade programme has resulted in increased numbers of pupils gaining qualifications. It has also promoted a wider range of approaches to teaching and - 2 BEST COPY AVAILABLE learning including, for example, the planned development of practical and problem solving skills. The 16-18 Action Plan greatly extended the range of appropriate courses in the upper 3.4 stages of the secondary school. Follewing the Howie Report consultation period, further developments relating to the 3.5 consideration. upper stages of secondary education are currently under the quality of teaching relevant Planned activity and in-service training facilitates effective staff development 3.6 to local or national priorities. Certain training courses receive national support and resourcing. 3.7 The present introduction of a national scheme of staff development and appraisal 3.8 skills and provides the basis for ensuring that the teaching force can improve their acquire necessary new ones, while balancing the claims of individual career development with the needs of the school. that a Revised guidelines for teacher training courses set out the range of competences 3.9 of his or her career. new teacher is expected to possess at the beginning There is a growing focus on the support given to probationer teachers. 3.10 teachers on A series of HMI reports is in process of publication giving advice to 3.11 other effective teaching and learning in a range of secondary school subjects and on special educational needs. Earlier HMI aspects such as provision for children with primary schools gave more general reports on effective secondary schools and effective advice on teaching and learning strategies. resources Developments in educational technology increasingly enhance the educational process. 3.12 methods Learning is facilitated through the effective and efficient use of new media, the national and materials. The Technical and Vocational Education Initiative and resourcing of developments such as Standard Grade are key promoters of this. parental involvement of positive contacts The introduction of School Boards has fostered the development 3.13 around in the education between schools and parents and heightened awareness of all offered. training of headteachers The significant increase in management training for headteachers promotes 3.14 and capacity to improvements in their leadership qualities, professional competence develop effective working relationships. -3 bring about changes in what All of the developments described above are intended to 3.15 developments have been promoted happens in classrooms to the benefit of pupils. The education authorities, often focused through complementary initiatives in a number of particular schools. Several education authorities have begun on valuable pilot work in S which provide a context for development work to set out their aims in frameworks provision. across all aspects of educational S S EDUCATION ? HOW DO WE EVALUATE THE QUALITY OF 4.0 quality education is actually being There must be means of judging whether a 4.1 quality is to examine the delivered; quality must be assured. One way of judging outcomes of the educational process in the school. the attitudes which young Academic attainment provides one outcome measure but 4.2 balanced and rounded citizens are people acquire and the way in which they develop as no less important. the processes and conditions Judgements on quality should also be made in terms of 4.3 what is taught and the learning within the school: whether what the content of environment created by the school promote desirable outcomes. occurring over a period of years In education, outcomes are the product of processes 4.4 Judgements about overall quality but information is required on an ongoing basis. and outcomes. should be based on a balanced consideration of both processes SCHOOLS ? INTERNAL OR EXTERNAL EVALUATION OF 5.0 know how well schools are There has always been recognition that it is important to 5.1 effectiveness of schools produced performing, and a wide-ranging literature on the established a consensus about common features of over the last 20 or so years has effective schools. begun to shift from setting out such In recent years, the focus of this literature has 5.2 develop and bring about characteristics towards looking at how a school can in achieving its educational improvement in ways that enable it to be more effective goals. by the emphasis within The This concern for school improvement has been highlighted 5.3 education. Parents' Charter in Scotland on standards and quality in the characteristics of effective While research evidence indicates broad agreement on 5.4 should take to establish these schools it may be less clear what action a school is for a school to gain a clear characteristics. The first step on the road to improvement understanding of its current stage of development. internally by the staff of the Evaluation of education in a school might be undertaken 5.5 from a position of strength in school. Those who engage in self-evaluation start and detailed knowledge of the inner that they are informed insiders with a close stakeholders they should readily workings of their organisation. As personal of being consulted, having one.; accept and act upon their findings. The process seriously valued and that they opinions considered, feeling that one's contributions are and ali powerful builders of morale, confidence may result in change for the better are commitment. - 4 - As Turner and Clift point out: 5.6 .::..14740! -.71#4,Foredwomaiiii- *****04it ---.--4:he.iatititzui.bilw: ..: ..:::::::::,..,::,...,,..,.,:::::::,, , ei' i:ggslimi.l'i :-:. 6001000k* . 4:441* owz.::::peeiuman: ...Pan ::: .::040440007 by a school can be Alternatively or additionally, evaluation of the education provided 5.7 and support can undertaken by the responsible authority. External prompting, guidance quality of the education be important in assisting a school to make judgements on the might simply provided. Indeed in the absence of such factors a school's own evaluation consideration. of difficult reinforce its existing impression of its situation or avoid the areas. inspection of schools' The Parents' Charter restates the case for independent 5.8 performance. A system of independent national inspection addresses national concerns and reporting on the for standards and quality in education through HMI evaluation strengths and weaknesses of provision. is a more focused Following a revision of HMI inspection procedures, an inspection 5.9 authority have to produce a paper agent of change than in the past. Schools and the and there is a setting out how they plan to address the recommendations in the report further inspection about one year later to assess and confirm progress. POINT FOR INTERNAL WHAT SHOULD BE THE REFERENCE 6.0 EVALUATION ? they must be aware The starting point is a recognition on the part of all concerned that 6.1 of the quality of what they do and the need for improvement. And building on that, schools need a structure, the parts of which are: 6.2 clear set of aims, targets and standards to be achieved; other of which mechanisms for delivering them, some of which may exist, may require development; and against expectation/aspiration and ways of assessing performance communicating the result. PLAN ? WHAT IS THE ROLE OF THE SCHOOL DEVELOPMENT 7.0 information about a A school development plan is a way of organising relevant 7.1 The consultation paper school's current position and its intentions for the future. good reference point. "School Development Plans in Scotland" issued by SOED is a The plan provides the means of: and the articulating and publicising the school's aims and aspirations, specific targets to be addressed in the s'iort and long term; be achieved; expressing priorities for development and when these will offering evaluation (audit) of performance against the first two. BEST COPY AVAILABLE 5 -