ERIC ED382094: Accountability Review: Progress Report 1. Report and Conclusions.

54 Pages·1994·1.3 MB·English

by  ERIC

DOCUMENT RESUME
HE 028 295
ED 382 094
Accountability Review: Progress Report 1. Report and
TITLE
Conclusions.
Florida State Postsecondary Education Planning
INSTITUTION
Commission, Tallahassee.
94
PUB DATE
55p.; For a related document, see HE 028 296.
NOTE
Postsecondary Education Planning Commission, 231
AVAILABLE FROM
Collins Building, Department of Education,
Tallahassee, FL 32399-0400.
Evaluative/Feasibility (142)
Reports
PUB TYPE
MF01/PC03 Plus Postage.
EDRS PRICE
*Accountability; *Evaluation Criteria; Government
DESCRIPTORS
School Relationship; Higher Education; In State
Students; Private Colleges; Public Colleges; State
Legislation; State Universities; Statewide Planning;
Student Financial Aid
*Florida; Florida Resident Access Grant
IDENTIFIERS
ABSTRACT
In response to Florida legislative mandate, this
document reports on accountability measures and an accountability
higher education that
process for independent institutions of
participate in the Florida resident access grant program and on the
design and implementation of the accountability processes of the
state postsecondary institutions. After an introductory chapter,
accountability
chapter 2 suggests a two-tier approach for conducting
public
reviews: an annual review of accountability information form
and a
system reports and from public and private institution reports,
cumulative review every 5 years. Annual reviews of public
institutions would include a representative sample of 10 institutions
(7 community colleges and 3 universities). Chapter 3 describes an
accountability process and measur-is for independent institutions and
Florida
provides a benefits and cost effectiveness analysis of the
Resident Access Grant program. Chapter 4 summarizes findings and
conclusions and proposes: (1) annual Commission review of
accountability processes and reports for public and private systems;
(2) annual review of public institutional reports and plans; (3)
(4) annual
performance indicators for independent institutions;
Universities
accountability reports from the Independent Colleges and
improved quality
of Florida (ICUF); and (5) new reporting dates for
summative evaluation
of data. Also included are recommendations for
and incentive funding. Extensive appendixes contain statutory
and
language, evaluation questions, lists of ICUF member institutions
of a survey of Access
resource group members, tables, and results
Grant recipients, Fall 1994.
(JB)
***********************************************************************
*
Reproductions supplied by EDRS are the best that can be made
*
*
from the original document.
***********************************************************************
ACCOUNTABILITY REVIEW:
PROGRESS REPORT
EDUCATION
U S DEPARTMENT OF
and improvement
"PERMISSION TO REPRODUCE THIS
Of Ste of EA acabonal Research
INFORMATION
EDUCATIONAL RESOURCES
MATERIAL HAS BEEN GRANTED BY
CENTER (ERIC)
er:This document has been reproduced as
Florida Postsecondar
organization
received from the person or
originating it
Education Planning
made to
0 Minor changes have been
quality
improve reproduction
stated in this
Points of view or opinions
TO THE EDUCATIONAL RESOURCES
represent
document do not necessarily
INFORMATION CENTER (ERICI.-
official OERI position or pc'-
Report and Conclusions of the
Commission
Florida Postsecondary Education Planning
Y AVAILABLE Report 1
1994
BEST C
-
POSTSECONDARY EDUCATION PLANNING COMMISSION
Robert B. Mautz
Vihna T. Diaz
H. Clyde Hobby, Chairman
Gainesville
Margate
New Port Richey
Karen L. Plunkett
Sally M. Gillespie
Richard C. Alterman
Orlando
New Smyrna Beach
Opa Locka
Mark K. Wheeler
Thomas J. Haynes
Inez W. Bailey
Fort Lauderdale
Tallahassee
Niceville
Ramiro J. Inguanzo
Ivie R. Burch
Miami
Panama City
William B. Proctor, Executive Director
The Postsecondary Education Planning Commission, initially created by executive order in 1980 and subsequently given statutory
authority (SS 240.145 and 240.147, Florida Statutes), serves as a citizen board to coordinate the efforts of postsecondary institution and
provide independent policy analyses and recommendations to the State Board of Education and the Legislature. The Commission is
composed of 11 members of the general public and one full-time student registered at a postsecondary education institution in Florida.
Maybes are appointed by the Governor with the approval of three members of the State Board of Education and subject to confirmation
by the Senate.
The major respoontray of the Commission is preparing and updating every five years a master plan for postsecondary education. The
enabling legislation provides that the Plan "shall include consideration of the promotion of quality, fundamental educational goals,
proverunatic access, ands for remedial education, regional and state economic development, international education programs,
demographic patinas, student demand for programs, needs of particular subgroups of the population, implementation of innovative
adwafioosi techniques and technology, and the requirenseats of the labor market. The capacity of existing programs, in both public and
indepaulan istitution, to respond to identified needs shall be evaluated and a plan shall be developed to respond efficiently to unmet
needs.
Other rencesdbikim idude recommending to the State Board of Education program contracts with independent butitution; advising
the State Board regarding the need for and location of new programs, branch campuses and enters of public postsecondary education
inetilufiors; pseiodically reviewing the accountability processes and reports of the public and independent postsecondary sectors; reviewing
special studies,
public poebsesdary education budget requests for compliance with the State Master Plan; and periodically conducting
aselyaes, and evaluation related to specific postsecondary education issues and programs.
Farther informatics about the Conanissiou, its publications, meetings and other activities may be obtained from the Commission office,
231 Collies Building, Department of Education, Tallahassee, Florida, 32399-0400; telephone [phone]; FAX '04) 922-5388.
AVAILABLE
BEST COPY
COMMISSION
POSTSECONDARY EDUCATION PLANNING
ACCOUNTABILITY REVIEW:
PROGRESS REPORT
Prepared in Response to Specific Appropriation 573
of the
1994 General Appropriations Act
Chapter 94-357, Laws of Florida
and
Chapter 94-230, Laws of Florida
December, 1994
1
(I
TABLE OF CONTENTS
i
EXECUTIVE SUMMARY
I.
INTRODUCTION
1
STATE-LEVEL EVALUATION OF ACCOUNTABILITY IN
II.
4
POSTSECONDARY EDUCATION
Annual Evaluation
Summative (Fifth-Year) Evaluation
8
ACCOUNTABILITY FOR THE INDEPENDENT SECTOR
III.
Accountability Measures for ICUF Institutions
The Florida Resident Access Grant: Background
Assessment of the FRAG
14
FINDINGS AND CONCLUSIONS
IV.
Annual Review of Accountability
Summative Evaluation
Incentive Funding
REFERENCES
APPENDICES
A Statutory References for Accountability
B Questions for State-Level Accountability Evaluations
C Independent Colleges and Universities of Florida: Member Institutions
Resource Group
D Independent Colleges and Universities of Florida Accountability
E Tables Related to Independent Colleges and Universities of Florida
F Survey of Florida Resident Access Grant Recipients, Fall 1994
EXECUTIVE SUMMARY
education and report to the State Board of
Specific
accompanying
language
Proviso
Education, the President of the Senate, and
Appropriation 573 of the
1994 General
the Speaker of the House of Representatives
Appropriations Act directed the Commission
with recommendations on any changes needed
to review and evaluate public postsecondary
in the accountability process or plans.
education accountability plans as they relate to
the mission and goals of each system and its
the
report
addresses
This
progress
respective institutions as well as the goals
Commission's activities in both of these areas.
articulated by the Legislature. A report was
First, the Commission suggests a process to
This
to be submitted by January 1, 1995.
review system and institutional reports in
language continues the accountability work
state goals
for postsecondary
to
relation
initiated by the Commission in its study,
The second chapter describes an
education.
Accountability in Florida's Postsecondary
for
measures
and
process
Education System, submitted to the State
accountability
a
provides
and
institutions
independent
Board of Education and the Legislature in
benefits and cost-effectiveness analysis of the
the
1994
Additionally,
January
1994.
Florida Resident Access Grant program. The
Legislature revised the Commission's statutory
closing chapter summarizes the Commission's
authority (Section 240.147, Florida Statutes)
findings and conclusions.
with inclusion of two directives relative to
accountability:
The Commission suggests a two-tier approach
for conducting the accountability reviews: (1)
in consultation with the independent Colleges
an annual review of accountability information
and Universities of Florida, recommend to the
from public system reports and public and
Legislature accountability measures and an
a
(2)
and
reports,
for
institution
private
independent
process
accountability
cumulative review every five years.
Annual
institutions that participate in the Florida
reviews of public institutions will include a
The process
resident access grant progrzm.
representative sample of ten institutions (seven
shall make use
of existing
information
community colleges and three universities).
and
state
federal
the
to
submitted
Over a period of four years,
all public
governments. The process shall provide for an
universities and community colleges will be
of
and
cost-
the
benefits
assessment
The major focus of the annual
reviewed.
effectiveness of the Florida resident access
reviews will be on institutional improvement
grant program in providing state residents
between
the
relationship
examining
and
with access to 4-year college programs and
of
a
implementing accountability and improvement
completion
successful
the
with
Accountability
in institutional effectiveness.
The commission shall
baccalaureate degree.
of this
which focuses on institutional improvement
accountability
oversight
provide
places the major responsibility for assessment
process.
level.
at
campus
the
reporting
and
of
monitoring
state-level
and
Additionally,
design
the
review
Periodically
provides
an
accountability
postsecondary
implementation of the accountability processes
to promote stronger linkages
opportunity
and reports of the State University System,
between accountability in higher education and
State Community College System, and public
key state-level processes such as strategic
and independent postsecondary institutions. At
planning and performance-based budgeting.
least every 5 years, evaluate the extent to
which each plan
the
to
contributing
is
achievement of state goals for postsecondary
Based on findings arising from the study, the
A second area of concentration will be an
Commission submits the following conclusions:
analysis of progress toward achieving state
the
examine
will
priorities.
Analyses
Annual Review of Accountability
contributions of public institutions as well as
independent
state's
accredited
23
the
The Commission will prepare a report
of
the
(1)
the
achievement
to
institutions
annually which reviews the design and
priorities. Fiscal realities impose restraints on
of
the
accountability
implementation
accountability and expectations for meeting
processes and reports of the public systems as
state needs. In addressing this problem, the
well as of public and private institutions.
Master Plan for Florida Postsecondary
The purpose of the Commission's annual
EducationChallenges, Realities, Strategies- -
(a) examine the
report will be twofold:
endorsed the targeting of a few priorities.
and
accountability
between
relationship
Based on a review of all current postsecondary
in
continual
improvement
achieving
master plans in Florida as well as strategic
institutional effectiveness, and (b) assess
of
Department
the
by
prepared
plans
progress toward achieving state priorities.
Education and the Office of the Governor,
Accountability in Florida's Postsecondary
Submission of an annual review of a
(2)
Education System identified three common
representative sample of public institutional
for a focused
concerns as state priority areas
reports and plans rather than a review of all
access/diversity,
review:
accountability
the
allow
reports- -will
institutional
quality of undergraduate education, and
Commission to meet statutory
reporting
productivity. These priority areas also support
requirements in a short time frame.
All
the State Comprehensive Plan's goal statement
institutions in the public systems will be
for education.
Thus,
reviewed within a four-year period.
annually
review
the
will
Commission
In addition to describing an accountability
accountability plans and reports from three
evaluations,
process for annual and summative
universities and seven community colleges.
the
addresses
report
progress
the
Each year's group of approximately ten
Commission's responsibility to consult with
institutions will be selected jointly with staff
the Independent Colleges and Universities of
from the State University System and the
an
recommend
to
(ICUF)
Florida
represent
to
Community College system
for
process and
measures
accountability
To the extent
diversity within each system.
independent institutions that participate in the
will be based on
the selection
possible,
Florida Resident Access Grant program.
institutional mission, geographic location,
the
ICUF,
with
Through
collaboration
and size.
and
measures
identified
Commission
developed strategies to assess the benefits and
for
indicators
performance
The
(3)
cost-effectiveness of the Florida Resident
independent institutions proposed in this
Access Grant. The Commission's assessment
report are appropriate initial accountability
focuses primarily on the program's benefits
contribution of
assess the
measures to
and cost-effectiveness to the State.
This
accredited independent institutions in the
report contains initial analyses and outlines a
achievement of the statewide priorities for
plan for conducting such analyses on an
education,
undergraduate
quality
ongoing basis.
access/diversity, and productivity. A review of
1CUF reports over the first few years may
reports and the sylem reports after they are
indicate that current measures need to be
finalized rather than during the process of
amended.
The Commission will submit
development.
the first annual accountability evaluation by
be
the
will
Commission
Since
(4)
November 1, 1993 and annually thereafter.
requesting system reports from the public
sector, a parallel procedure will be for
1
&mat& Evaluation
Independent Colleges and Universities of
Florida to compile an accountability report
To meet statutory requirements to "at
with aggregate and individual institutional
(7)
least every 5 years, evaluate the extent to
data on each measure for its member
which each plan is contributing to the
ICUF members will reach
institutions.
achievement of state got.* for postsecondary
agreement on a standardized method of
education," the Commission will submit a
reporting data related to each measure. The
fifth-year or summative report recapitulating
Commission's role will be one of review and
and synthesizing the results of the prior four
The
analysis of sector-wide information.
years reviews into a single report which
Commission's annual review will summarize
The
evaluates progress toward state goals.
the contribution of ICUF institutions to the
Commission will submit the first summative
achievement of statewide priorities and will
analysis of progress toward State goals by
through
data
institution-specific
display
November 1, 1999.
appendices. Additionally, the annual review
will include cost effectiveness analyses such
of
evaluation
the State to
summatip?
The
as (1) comparisons of cost to
(8)
accountability will also include an analysis of
educate in the public sector those Florida
the benefits and cost-effectiveness of FRAG,
with
Grant
recipients
Access
Resident
such as enrollment trends,
utilizing data
financial need and (2) comparisons of cost to
and
results,
student perceptions
and
survey
public
the
graduates
in
produce
comparisons of state costs to enroll and
independent sectors.
and
public
the
in
graduate
students
independent sectors.
Changing annual reporting dates for
(5)
reports from
accountability
system-level
the periodic
In
conjunction
with
(9)
December 31st to March 1st will enhance the
analysis of progress toward state goals, the
quality of the data and the analyses submitted
Commission will strive for a comprehensive
It is understood that
to the Legislature.
evaluation, including analysis of support
extending the annual system reporting dates
from those state-level bodies with the funding
from December to March will enable the
and policy-making authorzly to influence
systems to use prior year's data for their
accountability.
Additionally,
annual accountability report.
of
ICUF
annual
the
submission
Incentive Funding
accountability report by March 1st
will
of
Commission's analysis
the
facilitate
Provision for each public community
(10)
comparabk year information and completion
compete for
and
to
university
college
of its annual accountability report.
accountability incentive grants will support
State and institutional comnsiiment to the
A reporting date of November 1st for
(6)
Incentive initiatives will be
the Commission's annual evaluation of
priority areas.
to performance and attainment of
tied
institutional accountability reports will allow
specified objectives for the priori), areas of
opportunity to review individual institutional
(J
1
access/diversity, productivity, and quality.
Speck objectives might include increases in
minority graduation rates, graduates in high
cost programs serving targeted economic
development occupational clusters, and other
objectives tied to attainment of accountability
goals.
-iv-
I. INTRODUCTION
and
itriodically
the
design
review
Specific
accompanying
Proviso
language
Appropriation 573 of the 1994 General
implementation of the accountability processes
and reports of the State University System,
Appropriations Act directed the Postsecondary
State Community College System, and public
Education Planning Commission to:
and independent postsecondary institutions. At
least every 5 years, evaluate the extent to
review and evaluate the accountability plans in
to the
which each plan
contributing
is
public postsecondary education as they relate
achievement of state goals for postsecondary
to the mission and goals of each system and its
education and report to the State Board of
respective institutions as well as the goals as
Education, the President of the Senate, and
articulated by the Legislature. The review and
the. Speaker of the House of Representatives
evaluation shall specifically address the extent
with recommendations on any changes needed
to which the institutional and systemwide plans
in die. accountability process or plans.
should be modified to provide for specific,
The report, including any
measurable goals.
This document reports on the Commission's
suggested modifications to the plans, shall be
First, the
progress in both of these areas.
submitted to the Legislature and the State
Commission suggests a process to review
Board of Education by January 1, 1995.
system and institutional reports in relation to
state goals for postsecondary education. The
This language continues the accountability
following section suggests an accountability
work initiated by the Commission in its study,
for
independent
measures
process
and
Accountability in Florida's Postsecondary
institutions and reports on a benefits and cost-
Education System, submitted to the State
effectiveness analysis of the Florida Resident
Board of Education and the Legislature in
Access Grant program.
the
1994
Additionally,
January
1994.
Legislature revised the Commission's statutory
The Commission anticipates that accountability
authority (Section 240.147, Florida Statutes)
reports will address ongoing concerns with
with inclusion of two directives relative to
issues such as comparability, consistency,
accountability:
accuracy, and timeliness of data, relationship
of accountability to master plan goals, state
In consultation with the Independent Colleges
plans,
strategic
priority
agency
areas,
and Universities of Florida, recommen 9 the
institutional
and
procedures,
budgeting
Legislature accountability measures and an
monitoring of
for
State-level
improvement.
independent
process
accountability
provides
accountability
institutions that participate in the Florida
postsecondary
occasion to promote stronger linkages between
The process
resident access grant program.
accountability in higher education and key
shall make use of existing
information
state-level processes such as strategic planning
state
federal
and
the
to
submitted
The
and performance-based
budgeting.
governments. The process shall provide for an
of the
that
to
believe
continues
Commission
and
cost-
benefits
assessment
accountability provides an opportunity for
effectiveness of the Florida resident access
change as well as a challenge--through the
grant program in providing state residents
system and institutional plans and reports,
with access to 4-year college programs and
of a
has
an
education
postsecondary
public
completion
the
successful
with
opportunity to reassert its ability to define and
The commission shall
baccalaureate degree.
of this
manage its direction.
accountability
oversight
provide
process.
10