On the Cutting Edge Evaluation

The evaluation plan addresses two major effort domains of the project: the workshops and the website. All evaluations provide information to enable project staff to answer the following questions:"What are the results we are trying to achieve?" "Given these, who do we have to reach?" "What programs do we have with which to reach them?" "What evidence do we have that we did what we planned?"

The intent of the evaluation is both formative and summative. From a formative perspective, we look to improve our overall program including the workshops, website collections, and leadership program.The current objectives of the summative evaluation plan are to assess the impact of the workshops and website on faculty teaching and student learning. A second aim is to evaluate how the program contributes to the research base on effective faculty development.

The evaluation plan uses a theory of change to examine and identify the strongest and most compelling evidence for the program impacts.

Jump to: Evaluation Reports

National Geoscience Faculty Survey

Publications and Presentations

  • Beane, R., McNeal, K. and Macdonald, R. H. (2019). Probing the National Geoscience Faculty survey for reported use of education practices that support inclusive learning environments in undergraduate courses. Journal of Geoscience Education. (Published online July 2019) (Abstract)
  • Egger, A. E. (2019). The Role of Introductory Geoscience Courses in Preparing Teachers—And All Students—For the Future: Are We Making the Grade?. GSA Today. (Abstract)
  • Lally, D., Forbes, C. T., McNeal, K. S., & Soltis, N. A. (2019). National Geoscience Faculty Survey 2016: Prevalence of systems thinking and scientific modeling learning opportunities. Journal of Geoscience Education, 67(2), 174-191. (Abstract)
  • Riihimaki, C. & Viskupic, K. (2019) Motivators and inhibitors to change: how and why do geoscience faculty modify their course content and teaching methods. Journal of Geoscience Education, In Press
  • Soltis, N. A., McNeal, K. S., Forbes, C. T. & Lally, D. (2019) The relationship between active learning, course innovation and teaching Earth system thinking: A structural equation modeling approach. Geosphere, In Press
  • Manduca, C. A., Iverson, E. R., Luxenberg, M., Macdonald, R. H., McConnell, D. A., Mogk, D. W., & Tewksbury, B. J. (2017). Improving undergraduate STEM education: The efficacy of discipline-based professional development. Science Advances, 3(2). (Abstract)
  • Teasdale, R., Viskupic, K., Bartley, J. K., McConnell, D., Manduca, C., Bruckner, M., Farthing, D., Iverson, E. (2017). A multi-dimensional assessment of reformed teaching practice in geoscience classrooms. Geosphere, 13(2).
  • Iverson, Ellen. (2016). Understanding the Factors that Support the Use of Active Learning Teaching in STEM Undergraduate Courses: Case Studies in the Field of Geoscience. Retrieved from the University of Minnesota Digital Conservancy, Abstract.
  • Iverson, E.R. (2016). How Geoscience Faculty Learn about Improving Their Teaching Practice: Lessons from Ten Years of Interviews. Earth Educators' Rendezvous, Madison, WI. (Abstract)
  • Iverson, E., Bruckner, M., Larsen, K., Manduca, C., (2015) "Replicating the effects ongoing treatment through sustained networks: the Impact of the On the Cutting Edge Professional Development Program for Geoscience Faculty (CE) on faculty learning about teaching," Earth Educators' Rendezvous, Boulder, CO (Abstract)
  • Ryker, Katherine, Iverson, Ellen, Bruckner, Monica Z, Mcconnell, David, Manduca, Cathryn, and Larsen, Krista (2014). Connecting Beliefs To Action: How Geoscience Faculty Perceptions Of Their Professional Environment Impact Teaching, Geological Society of America, Abstracts with Programs, Vol. 46, No 6.
  • Teasdale, Rachel, Cathryn Manduca, David Mcconnell, Julie Bartley, Monica Bruckner, Dori Farthing, Ellen Iverson, Karen Viskupic (2014). Observations of Undergraduate Geoscience Instruction in the US: Measuring Student Centered Teaching, AGU Fall Meeting, San Francisco, CA
  • Viskupic, Karen, Steer, D., Kortz, K. M., Perkins, D., Wirth, K., Herbert, B., Singer, J., Manduca, C. A., (2014). Monitoring Undergraduate Growth Through The Major Using Embedded Assessment Questions, Abstracts with Programs, Vol. 46, No 6.
  • Bruckner, M.Z., Iverson, E., Manduca, C.McConnell, D., Bartley, J., Farthing, D., Teasdale, R., Viskupic, K. (2013). Using the on the Cutting Edge RTOP instrument to characterize how geoscience is taught. Geological Society of America Abstracts with Programs. Vol. 45, No. 7, p.313 abstract)
  • McConnell, David, Iverson, Ellen, Budd, David, Henry, Darrell, Kraft, Katrien J. van der Hoeven, McDaris, John R., MacDonald, Heather, Manduca, Cathryn, Srogi, LeeAnn, and Viskupic, Karen (2011). A Preliminary Snapshot of Geoscience Teaching at US Colleges and Universities. Geological Society of America Abstracts with Programs, Vol. 43, No. 5, p. 136. (Abstract)
  • Bruckner, Monica Z., Rachel J. Beane, and Heather Macdonald (2011), On the Cutting Edge Webinar Series Supports Graduate Students and Post-Docs Pursuing an Academic Career (Acrobat (PDF) 1.8MB Dec18 11), Geological Society of America Abstracts with Programs, Vol. 43, No. 5, p. 255 (Abstract)
  • Fox, Sean, Ellen A. Iverson, Cathryn A. Manduca, Karin B. Kirk, John R. McDaris, Carol J. Ormand, Monica Z. Bruckner (2011), Supporting Faculty Learning About Teaching: The On the Cutting Edge Website, Abstract ED23A-0612 Poster presented at 2011 Fall Meeting, AGU, San Francisco, Calif., 5-9 Dec. (Abstract)
  • Teasdale, Rachel, David Budd, Cinzia Cervato, Ellen Iverson, Katrien J. van der Hoeven Kraft, Cathryn Manduca, David A. McConnell, John R. McDaris, Daniel P. Murray, and William Slattery (2011). Enhancing Student-Centered Teaching Practices: Approaches Developed On the New Cutting Edge Geosciences RTOP Website, Geological Society of America Abstracts with Programs, Vol. 43, No. 5, p. 255. (Abstract)
  • Manduca, Cathryn A., David W. Mogk, Barbara Tewksbury, R. Heather Macdonald, Sean P. Fox, Ellen R. Iverson, Karin Kirk, John McDaris, Carol Ormand, and Monica Bruckner (2010). SPORE: Science Prize for Online Resources in Education: On the Cutting Edge: Teaching Help For Geoscience Faculty: Science, v. 327, no. 5969, pp. 1095-1096.
  • Iverson, E.R., McLaughlin, J.A., Manduca, C.A. (2006) The Logic Model as Compass: Guiding Stakeholders Through the Consequences of Evaluation. Presented at American Evaluation Association 2006 Annual Conference.presentation (PowerPoint 1.5MB Nov29 06)
  • Manduca, C.A., H. Macdonald, D. Mogk, and B. Tewksbury (2006). On the Cutting Edge: Evolving Themes, Enduring Impact (Acrobat (PDF) 335kB Apr25 06). Northfield, MN: Science Education Resource Center.
  • Macdonald, R.H., C.A. Manduca, D.W. Mogk, and B.J. Tewksbury (2005). "Teaching Methods in Undergraduate Geoscience Courses: Results of the 2004 On the Cutting Edge Survey of US Faculty." Journal of Geoscience Education, 53(3): 237.
  • Iverson, E.R., C.A. Manduca, J.A. McLaughlin, R.H. Macdonald, (2005), Enhancing your Teaching and Developing New Leadership: Impact of the On the Cutting Edge Professional Development Program (PowerPoint 2.6MB Jan18 06), Eos Trans. AGU, 86(52), Fall Meet. Suppl., Abstract ED42A-02
  • Manduca, C.A. and E.R. Iverson (2005). Understanding Faculty Work Habits as a Foundation for Professional Development (PowerPoint 1.8MB Jan18 06). Presented at POD Network 2005 Annual Conference.
  • Fox, S., Manduca, C. A., Iverson, E., (2005). Building Educational Portals atop Digital Libraries D-Lib, 11(1).
  • Macdonald, R. H., C. A. Manduca, D. W. Mogk and B. J. Tewksbury (2004). "On the Cutting Edge: Improving Learning by Enhancing Teaching." In, Invention and Impact: Building Excellence in Undergraduate Science, Technology, Engineering, and Mathematics (STEM) Education. Washington, D.C., AAAS: 381.

Evaluation Reports

Overarching summary evaluation

The following comprehensive reports evaluate all components of the Cutting Edge project over long periods of time and utilize a variety of evaluation techniques (surveys, interviews, other analysis).

Interview studies

The following reports present findings of interview studies related to either the Cutting Edge workshop program or website.

Survey studies

The following reports present findings of surveys related to the Cutting Edge workshop program or website.