Initial Publication Date: May 15, 2013

Related Links

Continuing 2012 teams agenda

New 2013 teams agenda

Assessment Team Agenda

Jump to: Tuesday | Wednesday | Thursday

Meeting Goals

  • Analyze assessment data and return to teams
  • Consult on old team revision plans
  • Meet new teams
  • Analyze GLE data and determine what changes are needed in GLE based on year 1 data
  • Decide how to grade student responses
  • Reflect on year 1 and discuss plans for year 2

Arrivals on Sunday: Leilani (11am), David (2pm), Emily (6pm)

Arrivals on Monday: Mary, Barbara (11am but attending another meeting on Monday), Josh (1pm), Stuart (2pm), Aida (2pm), Karen (7:30pm)

Agenda Items in blue context box are sessions with the module author teams. Workshop will take place at Weitz Center for Creativity, Carleton College, Larson Room 236. The assessment team will be working out of Weitz 008.

May 19, Sunday

Early arrivals are welcome to attend the opening activities on the New 2013 teams agenda which begins at 5:00PM.

May 20, Monday

Courtesy breakfast - Country Inn of Northfield (for the Sunday arrivals)

*All workshop activities will take place at the Carleton College Weitz Center for Creativity

Arrive

8:30AM -9:15AM Introduction to the overarching project goals as part of rubric with examples - David MCConnell

9:15AM - 11:00AM Early arrivals work on grading and analyzing embedded assessments from modules

11:00am - Noon(if available) Introduction to learning objectives and assessments - David Steer

12:00 PM Lunch at the Language/Dining Hall on campus

1:00 PM Continue grading and analyzing embedded assessments

2:00 PM-2:30 PM Welcome to team and review module team assignments for new teams

2:30PM-3:00pm Visit with newly assigned teams (Who is available: Leilani, Emily, Josh, Stuart, Aida, Mary, David and Ellen)

3:00 PM -3:45 PM Work plan discussion (Karen is a late arrival and Barbara may not be available)

3:45 PM - 5:15 PM Breakout groups (Who is available: Leilani, Emily, Josh, Stuart, Aida, Mary, David and Ellen)

  • Matrix mapping to embedded assessments
  • GLE multiple choice analysis
  • Grading, analysis and summary for Pilot tested modules
5:15-5:45 PM Report outs

6:00 PM Dinner (Ole Store-6:30 p.m. reservations) (transportation provided)

(7:30 PM Karen arrives)

May 21, Tuesday

Courtesy breakfast - Country Inn of Northfield

8:30 AM - 8:45 AM Plan for the day

  • Brief recap for Barbara and Karen
  • Plan for the day

8:45 AM-10:15 AM David Steer will be presenting breakout session on "Matching learning objectives with assessments" for new teams

8:45 AM - 10:15 AM Consultants continue to work on analysis activities

10:15AM Break

10:30 AM Analysis activities and time for evaluation focus groups (Carol B.)

12:30 PM Lunch at the Language/Dining Hall on campus

1:30 PM Plenary: Presentation of the development process and general timeline - Ellen will be presenting with Cathy and David Gosselin.

1:30 PM Consultants continue analysis activities and time for evaluation focus groups (Carol B.)

3:30 PM Meet with new teams regarding consultant role and timelines

4:30 PM Plenary: Presentation about testing process and assessment components (GLE, IRB, etc) - David Steer, Ellen and Assessment team

6:30 PM Dinner - barbecue 1st floor Weitz Center with cash-only bar

7:30 PM Meet and greet with all teams

  • Overview of what worked/what didn't

May 22, Wednesday

Courtesy breakfast - Country Inn of Northfield

8:30 AM Assessment analysis

10:30 AM Plenary: What it means to finish (with continuing 2012 teams)

  • Student material
  • Faculty material and case studies
  • Website publishing
(Aida departs at 11:30am)
12:00 PM Lunch at the Language/Dining Hall on campus

2:00 PM Assessment analysis: Finalize module analysis and reports

6:00 PM Dinner on the town (see restaurant selection handout in folder)

May 23, Thursday

Courtesy breakfast - Country Inn of Northfield

*Check out of hotel and bring your luggage to the Weitz Center —shuttles to the airport will leave from Weitz Center (see shuttle schedule in folder)

8:30 AM Plenary: Assessment and evaluation results overview - David and Jackie (evaluation attitudinal survey)

Assessment Brief (PowerPoint 2007 (.pptx) 1.1MB May23 13)

Evaluation Brief (PowerPoint 2007 (.pptx) 123kB May23 13)

(Leilani departs at 9AM)

9:30 AM Assessment consultants meet individually with teams

  • Discuss assessment results for individual modules
  • Discuss plans for incorporating assessment and evaluation results into revisions
  • Revise draft plan (in team pages in the CMS as needed)

11:30 AM Report out: Good news and challenges you see incorporating results of assessment

  • This session was with leaders (David G, David Mc, David S, Anne, Cathy, Ellen), all consultants who were present, and Carol B.
  • Mary's notes from that session here:

12:00 PM Lunch at the Language/Dining Hall on campus

1:00 PM Consultants discuss reflect on year 1 and plan going forward for year 2

  • Debrief about conversations with teams. Hurricanes would like the data for the two embedded assessments that were scored. David said to hold off on providing this for other teams unless it would inform their work. The narrative provided by each consultant about the embedded assessments should be sufficient. David is concerned that they might read too much into the data.
  • Student engagement measure:
    • Kristin explained the wide range of ways faculty have provided student engagement measure. Matt (SERC programmer) has tool currently designed to be one number per student but of course this could be changed.
    • David explained that 60% of variance can be explained by attendance and prior knowledge
    • Team decided that if faculty could provide attendance percentage per student (when it is easy such as using classroom response systems or online class)
  • Change in GLE essay procedure going forward (NOTE: The documentation and communication to teams needs to make this change clear):
    • All faculty use new InTeGrate question at the end of their term
    • All faculty select a GLE essay question that most closely aligns with the InTeGrate goals of their module/course. This essay question should be administered close to the end of the teaching of the applicable module (which could be within a course).
  • Climate of change data still coming in:
    • Kristin explained that there are many 2YC (~7) courses that tested the Climate of change and have data in or coming in (3 in already)
    • Cynthia Fadem brought data:
      • however, it all has student names so would be very time consuming to analyze
      • she also brought all assessment not just the one's identified for the module
      • Emily will find out whether Climate of change still would like consultants to score/analyze any of this data. The climate team had already told David that we should not score the El Nino assessment as it is completely changed now.

Upcoming work:

  • 2YC GLE essays to grade for Q17 and Q18
  • David's class other GLE essay questions
    • these are typed
    • we will not be scoring as much as reading to determine whether questions are good and getting expected answers
  • Hurricanes: Mary indicated that they have a third embedded assessment that we didn't grade. Mary will find out whether the assessment consultant scoring would help inform their work.
  • We need student rubrics for GLE essay questions:
    • Leilani is working on Q17 and Q18
    • Barbara drafted one for the new question

(Josh departs at 3PM)

4:00 PM End of Meeting Survey

(Emily and Karen depart at 7PM)

7:00 PM Dinner at Chapati

(Barbara departs at 5AM on Friday)

May 24, Friday

Courtesy breakfast - Country Inn of Northfield

*Check out of hotel and bring your luggage to the Weitz Center —shuttles to the airport will leave from Weitz Center (see shuttle schedule in folder)

Those departing on Friday are welcome to attend the morning sessions of the Continuing 2012 teams agenda

(Stuart and David depart at 2PM on Friday)