Assessing PBL&I and SBP: Formal Tools

51 Pages·2009·0.49 MB·English

Assessing PBL&I and SBP:
Formal Tools
University of Wisconsin
July 2009
Objectives
(cid:131) Discuss important principles and tools in
quality improvement
(cid:131) Review and apply methods and tools for
assessment in PBLI and SBP
“Formal” Approaches for SBP
(cid:131) CTM-3 Tool
– Can be used as formal performance measure
for team (see specifics from NQF)
(cid:131) Multi-source feedback
– “Twofer”: Interactions with systems and
interpersonal and communication skills
(cid:131) Simulation
– Growing evidence of value to assess
“capability” to work in teams
SBP: It’s not just about the doctors
Hollis Day, University of Pittsburgh
Multi-source Feedback
Norcini: 5 step implementation process
1. Purpose of assessment should be stated,
preferably in writing
2. Assessment criteria must be developed and
communicated to participants
3. Participants should receive training
4. Monitor results throughout implementation
5. Provide feedback to all participants
MSF: Strengths
(cid:131) Focuses on actual “workplace” performance
(cid:131) Captures different perspectives:
– Patients and nurses - evaluate humanism,
professionalism, communication
– Peers – work ethic, team approach,
professionalism
– Others – unique observations on key attributes
(cid:131) Communicates the importance of teamwork
(cid:131) Adaptable:
– Assessment of Communication / IPS and SBP
6
MSF: Limitations
(cid:131) Limited information in medical education and
practice
(cid:131) Measurement issues:
– Uncontrolled environment
– Usual limitations of global rating forms:
• Reliability and validity
(cid:131) Feasibility issues: logistics of data collection, entry,
analysis and reporting results
(cid:131) Cultural issues:
– Personal feedback, rater and learner resistance,
confidentiality
7
MSF: Conclusions
(cid:131) Uses – Professionalism; Systems-based Practice,
Interpersonal and Communication Skills
(cid:131) Raters should be appropriately trained to provide
ratings based upon the context of observation and
qualifications
(cid:131) Communication of objectives through assessment
(cid:198) importance of team approach and patient-
centeredness
8
Practice-based Learning and
Improvement
Important Principles
Residents and QI skills
(cid:131) Understand key definitions and IOM rules
(cid:131) How to measure quality
(cid:131) Understand micro-systems
(cid:131) Process tools:
– PDSA
– Flowcharts