Why the EvaluateUR Method is Effective
A Method Based on Student Metacognition
The EvaluateUR Method is shown to be effective because is built on metacognition and improves students' ability to reflect on their learning and direct their efforts.
Read more about Metacognition in the EvaluateUR Method
What Users Are Saying
Users of the EvaluateUR Method provide valuable feedback how the EvaluateUR Method is effective in improving their students' learning.
Associate Professor of Mathematics
Chair, Department of Mathematics
Southern Nazarene University
Kerry F. Milch, Ph.D.
Assistant Director for Undergraduate Enrichment
EvaluateUR Method shown effective with research
Findings from EvaluateUR NSF Project
An award from the National Science Foundation's WIDER program supported the scaling up and dissemination of the EvaluateUR method. In 2019, the final year of NSF funding, EvaluateUR was implemented by undergraduate research directors at 37 institutions with 700 student-mentor research pairs completing all of the EvaluateUR steps.
Changes in assessment scores for this group and feedback from user surveys support a number of conclusions about the method:
- EvaluateUR succeeded in introducing student participants to a comprehensive list of competencies and skills they would need in order to go on to graduate work and/or succeed in the workplace.
- All EvaluateUR assessment components saw statistically significant positive growth for both students and mentors when tested by a paired sample t test (alpha =.05). Further, the Cohen's d effect size showed medium and large magnitudes of effect for almost all components for both mentors and students. The medium and large effect size suggest that the significance is not just due to chance or large sample size but to genuine impacts on student outcomes.
- Post-assessment student-mentor conversations contributed to the development and enhancement of student metacognitive skills,characterizedby learners becoming awareof what learning strategies they are pursuing and why, and then using that awareness to make intentional adjustments to those strategies in order to learn more effectively. These conversations also helped most students confirm their plans for graduate school or employment in their major field.
- Research mentors found it easier to identify the academic strengths and weaknesses of the students they mentored, enabling them to focus their mentoring efforts more productively.
- The mentors could also more easily see areas where students might be over- or under- estimating their competencies and could help students gain new insights into their academic strengths and weaknesses and the relative efficacy of their learning strategies.
- EvaluateUR provided undergraduate research program directors with tools to help them manage their research program as well as provide them with reliable, readily understandable evidence of the potential benefits of their undergraduate research program.
Read more about the findings from the 2019 implementation of EvaluateUR
Summary report of the findings from the 2019 implementation (Acrobat (PDF) 287kB Apr9 20)
Read about the assessment of student learning outcomes using EvaluateUR-CURE
ETAC ABET and EvaluateUR-CURE: Findings from Combining Two Assessment Approaches as Indicators of Student Learning Outcomes (Acrobat (PDF) 736kB Mar2 22) ©2021 American Society for Engineering Education
Read more about the development of EvaluateUR
- Article from CUR Quarterly about the Assessments (Acrobat (PDF) 991kB Mar7 12)
- A Longitudinal Student Outcomes Evaluation of the Buffalo State College Undergraduate Research Program (Acrobat (PDF) 2.3MB Apr23 19)