Effective educator preparation programs track, monitor, and objectively assess candidates’ performance as they progress through their studies in course work and clinical experience to ensure their success and to make data-driven informed decisions. UED has established an assessment and evaluation system that aids in data collection and analysis which inform decisions for ongoing program and unit evaluation and continuous improvement. The assessment system is comprehensive as it uses multiple measures that reflect the UED’s conceptual framework as well as state and professional standards and unit-defined dispositions; consistent as it uses standards-based rubrics and a regular review-cycle to analyze unit and program-level data along with the validity and utility of assessment instruments, working to avoid bias; and useful as it provides relevant information that informs candidate-, program-, and unit-level decisions. Figure 3.1 depicts the continuous improvement cycle of the UED assessment system in regards to candidate performance. The preparation of a competent and effective urban education teacher is central to the system. The UED Conceptual Framework provides a foundation for the assessment system. Overall, the assessment system is designed to promote teacher candidate learning, by providing the program with feedback for improvement, enhanced opportunities for growth and clear opportunities for accountability.
Figure 3.1. UED Assessment Cycle: Continuous Improvement of Candidate Performance for Student Learning
The UED assessment system has been developed collaboratively over more than a decade. First, it includes being guided by the School of Urban Education’s mission and Conceptual Framework. Incorporating professional and state standards, the system has been developed to collect and analyze data from multiple sources (i.e., surveys, clinical experiences, signature assessments, standardized assessments (MTLE and edTPA) to support the improvement of candidate performance, program quality, unit operations and resource allocation (see Figure 3.2).
Figure 3.2. School of Urban Education (UED) Assessment System Collects and Analyzes Multiple Sources of Data Related to Candidate Performance.
Figure 3.3 shows the data-driven decision making process at UED. Data are regularly and systematically collected, compiled, aggregated, summarized, and analyzed by the Coordinator of Assessment. Data is then shared and analyzed with the UED Assessment Committee each semester. The Committee's specific responsibilities and activities include (1) monitoring development, implementation, and refinement of the Unit assessment system, (2) analyzing aggregated performance data toward improving programs, candidate outcomes and unit operations, and (3) communicating with others in the Unit. The assessment coordinator also shares data with licensure program coordinators for a deep-dive into their specific program data.
During spring semester, the whole unit has a Data Day to analyze and discuss aggregated data analyzed by the Assessment Committee. At the Data Day during an All School meeting, all faculty and staff in UED can participate in reviewing data and making data-driven recommendations for unit and program improvement. These recommendations are then brought back to the Assessment Committee to review and disseminate to the UED Advisory Group of unit stakeholders. The UED Advisory Group reviews and analyzes unit and program data for accountability purposes, and they provide feedback on ways to improve the Unit and its programs for strengthened student outcomes.
Figure 3.3 Data Driven Decision Making for Program Improvement Process & Flowchart
Most data on candidates is collected and analyzed using reports created in Taskstream; an electronic data management system of the UED (not the entire university) used since 2011 that provides a variety of functions. Candidates submit signature assignments in TaskStream that are aligned with licensure standards and these are assessed to monitor candidate progress in meeting licensure standards and UED-defined dispositions through required coursework, clinical field experiences, and student teaching. The Coordinator of Assessment gathers data from TaskStream and other platforms and prepares aggregated reports about candidates, programs and the unit to inform areas of focus for continuous improvement. Some surveys about candidates are also administered through TaskStream. Candidates also complete and submit applications for program admission and admission to student teaching. Other data management and reporting tools used include Pearson’s Results Analyzer, SurveyMonkey, Qualtrics and PowerBi. Advanced queries of the University database for enrollment reports are provided by the Universities Office of Institutional Research.
Please wait...
