POSITION OBJECTIVE 

The evaluation manager takes leadership in designing, developing, and implementing ongoing evaluation of medical education programs, curricula, faculty teaching, and medical student achievement in a learner-centered curriculum. This role is responsible for oversight of evaluation tool development, data collection, management, analysis and visualization related to medical education. The evaluation manager provides expertise and support in designing, developing, and implementing evaluations to all projects overseen by the Office of Medical Education Research and Evaluation (MERE). 

The evaluation manager will work collaboratively in a fast-paced multi-disciplinary environment with faculty and students in a variety of areas, including but not limited to Curricular Affairs, Student Affairs, educational research and evaluation across the School of Medicine, and medical education programs in the Office of Medical Education. 

Responsibilities of the evaluation manager focus on the evaluation of the undergraduate medical education efforts, and other programs as prioritized by the Office of Medical Education, with attention to program quality and effectiveness, including courses, clerkships, faculty teaching, and data collection, management, analysis, and visualization. This role coordinates the design, development, and implementation of the evaluation program, including tools and dashboards with limited supervision. In addition, this position is responsible for providing support for key initiatives across MERE's portfolio and the Office of Medical Education as requested by the Associate Dean of Accreditation, CQI, and Academic Analytics, and Vice Dean for Medical Education.

ESSENTIAL FUNCTIONS 

1. Design and manage ongoing program evaluation and quality improvement efforts with specific attention to the careful administration of a high volume of time-sensitive instruments, analyzing results, preparing reports, datasets, and visualizations. Manage, monitor, and update all data collection procedures, including conducting advanced quantitative and qualitative data collection, managing databases and all data collection relevant to medical education research and evaluation initiatives. Develop and present summary evaluation data for necessary committees. Analyze program evaluation data and compare current and prior classes as part of the overall evaluation of the program. Lead reporting of data trends. Present reports to committees and councils as requested. 20%
2. Direct efforts related to the evaluation of the MD program(s) in collaboration with the Director of MERE. Work collaboratively with educational leaders and other faculty to develop and implement program evaluation projects. Collaborate with faculty and staff in designing, assessing, updating, and revising evaluation procedures in compliance with AAMC recommendations and LCME requirements. 20%
3. Lead program evaluation analysis efforts, including but not limited to exporting, maintaining, creating and managing data and data visualizations. Maintain and improve a robust program evaluation tracking and management database which combines recent and historical data from various sources. Manage communication and collaboration with the School of Medicine and University technology teams to develop and maintain dashboards using Tableau, PowerBI, and other tools. Document and distribute materials for process improvement, data management, and automation within the designated groups. Act as the primary point of contact for process data inquiries, management, and visualization related to program evaluation. 20%
4. Primary responsibility of evaluation operations within the learning management system. This includes ensuring evaluation activities are implemented with accuracy and timeliness from programing and piloting evaluation tools to aggregation and dissemination of evaluation results to required stakeholders. Responsible for addressing student and concerns related to evaluation (within and outside of the learning management system) as they arise. 15%
5. Execute with minimal supervision other program evaluation activities and assume tasks and activities as required by the Director of the Office of Medical Education Research and Evaluation in a timely manner. Manage communication and collaboration with other Offices (e.g., Curriculum, Assessment) for daily operations as well as strategic requests for data that consider evaluation and student performance (assessment). 10%

NONESSENTIAL FUNCTIONS

1. Respond to requests, both within and outside of the school, for evaluation information. Including information needed for required AAMC annual surveys; working with University and School departments to integrate evaluation data into centralized systems. 5%
2. Manage and prepare requests for data from the Educational Data Registry. Obtain IRB approval and/or uphold ethical standards and work within IRB approved protocols as appropriate. Collaborate on and/or initiate educational research and evaluation projects and proposals. Engage in educational scholarship and produce scholarly reports, publications, and presentations. 5%
3. Coordinate all logistics, providing minutes of meetings and preparing reports evaluation related committee requirements. Provide high level data summaries, reports, and data visualizations for committees as requested. 5%
4. Perform other duties as assigned. 

CONTACTS 

Department: Continuous contact with Director of the Office of Medical Education Research and Evaluation (MERE), MERE team, Associate Dean for Accreditation, CQI, and Educational Analytics, the Vice Dean for Medical Education, Associate Dean for Curricular Affairs, Associate Dean for Student Affairs, Society Deans, Director of Student Assessment, Executive Director of Curricular Affairs, Director of Clinical Curriculum, Clinical Assistant Deans, Block Leaders, Clerkship Directors, educational and technology staff as needed 

University: Frequent contact with educational leaders across the Health Sciences Campus, the Cleveland Clinic Lerner College of Medicine, the School of Medicine leadership, and University Technology 

External: Occasional contact with the AAMC to respond to annual questionnaires. 

Students: Frequent contact with students enrolled in the School of Medicine.

SUPERVISORY RESPONSIBILITIES

No supervisory responsibility.

QUALIFICATIONS

Experience: 3 to 5 years related work experience; experience in evaluation of medical education programs preferred.

Education/Licensing: Bachelor's degree required; Master's degree preferred.

REQUIRED SKILLS

1. Innovative and creative evaluation professional.
2. Familiarity with educational innovations and best practices for education programs and student performance evaluation in other health professions at educational institutions.
3. Leadership skills and ability to work collaboratively and efficiently with others in various settings on a timely basis.
4. Excellent communication skills, with the ability to convey complex concepts and findings to various audiences.
5. Demonstrates expertise in Microsoft Office, Google Suite, and database management. Advanced knowledge of Microsoft Excel. 
6. Experience with dashboard platforms such as Power BI, Google Dashboard, Looker Studio, Tableau, Excel, etc.
7. Mastery of common evaluation platforms (e.g., Qualtrics, Elentra) or similar web applications for building and managing online surveys and databases.
8. Experience with accreditation processes and standards in medical education (e.g., LCME).
9. Strong knowledge of evaluation methodologies, including quantitative and qualitative research methods, survey design, and data analysis techniques.
10. Excellent knowledge of data analysis tools such as SPSS, Stata, and Excel.
11. Demonstrated history of successful support, education, and advocacy for all students, aligned with the values, mission, and messaging of the university, while adhering to the staff policy on conflict of commitment and interest.
12. Ability to interact with colleagues, supervisors, and customers face to face.
13. Ability to meet consistent attendance.
14. Willingness to learn and utilize Artificial Intelligence (AI).

WORKING CONDITIONS

This position is performed in a typical office environment. Duties involve repetitive motions such as typing and using a computer mouse, with prolonged periods of sitting and occasional standing. Chemical exposure is minimal and limited to routine office products such as sanitizer wipes. This position is eligible for hybrid work. Occasional evening work may be requested.

Apply online at jobs.case.edu search job 14431