Even in a classroom focused on investigation and design, students need high-quality resources to support their learning, and thus one of the objectives of the TIDeS project is to develop freely available, high-quality readings for students through Visionlearning.
Developing and testing the Visionlearning rubric
We began with an early draft of the TIDeS Rubric for Curriculum Development and the existing Visionlearning (VL) guidelines for authors. We were seeking strong alignment between the two rubrics, and knew they would have to be different given the nature of the materials that they would be used to assess. Initially, we maintained the number of sections in the TIDeS rubric, but modified them to better assess the VL modules as follows:
Within each section, the Visionlearning leadership developed criteria that align with the guiding principles and the VL author guidelines. At the same, we developed a guidelines document with more explanation of the criteria and examples to help authors and editors implement the rubric. Both the criteria and explanations were developed iteratively as we tested the rubric on existing modules and looked for areas of disagreement and/or confusion.
With the final version, the Visionlearning team assessed inter-rater reliability of the rubric with six raters: one member of the research staff, two content editors, and three content authors. The value of Cronbach's alpha across all 25 criteria was Î± =.78 indicating good inter-rater reliability.
Implementing the rubric
The rubric is being used by the Visionlearning editorial team to guide authors' work.