Evaluating Pathway Impact
The EarthConnections system of shared metrics is used to monitor the progress of students along regional pathways and toward geoscience-related careers. The metrics and structure of the alliance facilitate opportunities to share data, analyze results, and adapt in response to that information.
Student progress instruments are a primary focus of project, but these and measurements of alliance health are inter-related in that a diverse geoscience workforce is necessary in order to achieve resilience in diverse communities, and an educational focus on local geoscience issues of societal importance will help to attract more diverse students into careers in geosciences. We envision that these goals can most effectively be achieved by cooperation of multiple stake holders, and improved geoscience educational capacity in the region may be required.
Student Progress Instruments
A set of instruments to be field tested in student activities was identified by the metrics working group. These instruments:
- Have proven validity
- Demonstrate evidence that the relevant student measures (Competency, Values, and Engagement) are predictive of student success
- Align with IRB-approved inquiry design
- Demonstrate usability with age groups and duration of activities (as identified through metrics working group/regional alliance meeting that determines timeline of activities, age groups involved, and identify which of selected measures are most appropriate
- Career Interest Survey: Tyler-Wood, T., Knezek, G., & Christensen, R. (2010). Instruments for assessing interest in STEM content and careers. Journal of Technology and Teacher Education, 18(2), 341-363.
- Values in Science Survey: Measures Technical Brief: Values in Science. (2016). Science Learning Activation Lab.
- Engagement in Science Survey: Measures Technical Brief: Engagement in Science. (2016). Science Learning Activation Lab
More Planning Tools
Building Educational Pathways
The EarthConnections Alliance brings together scientists, educators, and community leaders the create locally contextualized pathways for students that emphasize connections between science and community. Regional Alliances draw upon the assets and expertise of Program Partners, the National Alliance, and local partners to build and enhance these pathways. Learn more about Building Educational Pathways
Monitoring Pathway Development
Using structured practices for monitoring progress enables alliance participants to reinforce their shared vision and enhance their mutually reinforcing activities. The EarthConnections Alliance developed a Checkpoint Process to monitor regional pathway development to allow for routine reporting and communication on key areas of the development process. The Checkpoint Reporting process involves three steps: reporting, evaluation, and feedback. Learn more about Monitoring Pathway Development
Monitoring Alliance Health
EarthConnections monitors alliance health using indicators for the five pillars of a successful collective impact alliance: common agenda, shared measurement, systems, mutually reinforcing activities, continuous communication, and a backbone support organization. Alliance health is also measured using a real-time data analytics dashboard which allows for observation of communication and participation. Learn more about Monitoring Alliance Health