Job Summary:

The ECHO Evaluation Manager position will be responsible for leading, supporting and managing evaluation team responsible for evaluation for all ECHO Colorado activities. ECHO is an innovative telementoring program designed to create virtual communities of learners by bringing together healthcare providers and subject matter experts using videoconference technology, brief lecture presentations, and case-based learning, fostering an “all learn, all teach” approach. This position will work collaboratively with the Development and Implementation (D&I) Team to develop, plan, and implement multiple evaluation projects concurrently. This may include the development and validation of new data collection surveys, the use of disparate data collection platforms and varied analytical approaches. The position will support clinical project leads with interpretation and translation of evaluation and research findings into practice and program settings. This position requires familiarity with range of evaluation methodology and design, competency running basic descriptive and inferential statistics (t-test, ANOVA) and qualitative analysis skills. The successful candidate will work autonomously in order to lead and/or collaboratively contribute to projects as circumstances sometimes change and require ability to work with rapidly changing demands. The position will also be responsible for ensuring timely and high-quality deliverables, including internal and external reports and presentations.

Key Responsibilities:

• Serve as subject matter expert during project planning meetings to develop appropriate evaluation plan, identify and refine specific metrics, talk through any data collection barriers or limitations.
• Work collaboratively with internal project coordinators and external clinical partners to design program-level evaluation plans for ECHO Colorado.
• Customize and contextualize ECHO series evaluation services to different clinical topics and stakeholder needs.
• Develop weekly team meeting agendas & facilitate team meeting with direction from executive leadership.
• Streamline data infrastructure(s) and automate report deliverables where possible.
• Develop, implement and monitor data processes to ensure best-practice is being followed throughout the process from project initiation to completion.
• Work collaboratively to develop and maintain reporting processes for the ECHO Colorado leadership, funders, and partners.
• Lead projects by establishing project work plans, timelines, deliverables, and resources needed to successfully support projects.
• Assist in the development of instrument design.
• Represent the evaluation team at meetings with internal partners as well as external clinical partners.
• Conduct regular stakeholder meetings of key partners related to progress and implementation.
• Create and maintain custom queries to scrub, aggregate and visualize data according to unique project specifications.
• Align scripting language across projects and platforms to the degree possible to eliminate duplicate work.
• Provide feedback for improvement in data infrastructure and departmental SOPs which will allow improvements in how data is extracted, analyzed and visualized.
• Running data queries to identify coding issues and data exceptions.
• Perform QC of all department outputs including analyses and reports.
• Present findings and recommendations from evaluation studies to advance organizational mission.
• Maintain knowledge of best practices related to program evaluation.
• Report data analysis findings to leadership to inform business decisions and prioritize information system needs.
• Functions as a liaison between the employees, physicians, executive leadership and operations team.
• Regularly review literature for best practice and innovative evaluation methods.

Why Join Us:

The PMCC aims to improve the quality of care and the patient experience while reducing overall costs. Here is the PMCC model:

The Peer Mentored Care Collaborative (PMCC) consists of two innovative and highly regarded programs, ECHO Colorado (Extension for Community Health Outcomes) and Project CORE (Coordinating Optimal Referral Experiences). Through these programs, primary care providers are offered tools to partner with colleagues at the Anschutz Medical Campus to build a virtual, patient-centered medical neighborhood that enables communication, reduces the potential for fragmented care, promotes enhanced coordination and ultimately improves access to specialty care for patients..

The PMCC aims to leverage partnerships with stakeholders across the state of Colorado to meet rural providers where they are with the goal of improving each domain of the quadruple aim: increasing access to care, reducing costs and unnecessary care, improving patient outcomes and improving patient and provider satisfaction with care.

The University of Colorado offers a comprehensive benefits package that includes health insurance, life insurance, retirement plans, tuition benefits, ECO pass, paid time off – vacation, sick, and holidays and more. To see what benefits are available, please visit:

Diversity and Equity:

The University of Colorado Anschutz Medical Campus is committed to recruiting and supporting a diverse student body, faculty, and administrative staff. The university strives to promote a culture of inclusiveness, respect, communication and understanding. We encourage applications from women, ethnic minorities, persons with disabilities, persons within the LGBTQ+ community and all veterans. The University of Colorado is committed to diversity and equality in education and employment.

Qualifications:

Minimum Qualifications:

• Bachelor’s degree in healthcare or a related field.
  • Substitution: A combination of education and related technical/paraprofessional experience may be substituted for the bachelor’s degree on a year for year basis.
• At least five (5) years of experience with organization/ team strategy, alignment of goals, process development and improvement, learning management, and data systems.
• At least one (1) year of experience providing supervision, mentoring, and training.

Applicants must meet minimum qualifications at the time of hire.

Preferred Qualifications:

• Master’s degree in healthcare, public health, or a related field.
• 1-3 years complex project management experience.
• Experience in applied research/evaluation.
• Experience working with other health care professionals.
• Experience evaluating ECHO-like education/training programs.
• Prior experience with project coordination and cohort management of ECHO series.
• Basic to intermediate skill using statistical software such as SPSS or R and online survey design software such as Qualtrics (preferred) or REDCap.

Knowledge, Skills, and Abilities:

• Familiarity with HIPAA regulations and management of PHI.
• Strong analytical and organizational skills.
• Ability to interface with stakeholders at all levels.
• Ability to communicate effectively, both in writing and orally.
• Ability to establish and maintain effective working relationships with employees at all levels throughout the institution.
• Solid written and verbal presentation skills, with a strength at making complex topics, data, and analysis understandable to a variety of audiences using narratives, tables, graphics, and maps.
• Ability to understand and relate to the needs of staff and ECHO participants of diverse ethnic, cultural, educational, and socioeconomic backgrounds.
• Familiarity with the principles, practices, and procedures of research and evaluation methodologies.

How to Apply:

For full consideration, please submit the following document(s):

Questions should be directed to: Kathryn Michel at Kathryn.Michel@cuanschutz.edu

Screening of Applications Begins:

Immediately and continues until the position is filled.

Anticipated Pay Range:

The starting salary range (or hiring range) for this position has been established as $66,429 to $84,306.

The above hiring range represents the University’s good faith and reasonable estimate of the range of possible compensation at the time of posting. This position may be eligible for overtime compensation depending on the level.

Your total compensation goes beyond the number on your paycheck. The University of Colorado provides generous leave, health plans and retirement contributions that add to your bottom line.

Total Compensation Calculator:

ADA Statement:

The University will provide reasonable accommodations to applicants with disabilities throughout the employment application process. To request an accommodation pursuant to the Americans with Disabilities Act, please contact the Human Resources ADA Coordinator at hr.adacoordinator@ucdenver.edu.

Background Check Statement:

The University of Colorado Anschutz Medical Campus is dedicated to ensuring a safe and secure environment for our faculty, staff, students, and visitors. To assist in achieving that goal, we conduct background investigations for all prospective employees.

Vaccination Statement:

The University of Colorado has a requirement for COVID-19 vaccinations and full completion thereof by 9/1/21 or upon start date. Information regarding this requirement, and exemptions can be found at:

Unit-Specific Exemptions:

• Anschutz Campus – Accommodations may be granted for medical or religious reasons.

The University of Colorado seeks individuals with demonstrated commitment to creating an inclusive learning and working environment. We value the ability to engage effectively with students, faculty, and staff of diverse backgrounds.