Metacognition Group 3: Clark, GSU Perimeter, Houston, Lane, Suffolk

Considering our discussion about metacognition in Activity 4, the videos, Self-Regulated Learner website, slides, Tanner's article, and/or other resources, write a response to ONE (1) or more of these questions.

  • What is something you currently do to incorporate metacognition in your courses? Do you have evidence that indicate it's been successful? Any suggestions for others who might want to implement something similar?
  • What are some (new) ways you might apply metacognition in one or more of your courses?
  • What more do you want to know?


« Activity 5 Discussions

Metacognition Group 3: Clark, GSU Perimeter, Houston, Lane, Suffolk  

What is something you currently do to incorporate metacognition in your courses? Do you have evidence that indicate it's been successful? Any suggestions for others who might want to implement something similar?

Because of Sean Tvelia's workshop's and personal interaction, I have included much metacognition into my courses. I use Bloom's Taxonomy extensively in all of my classes. I always ask students what they think the context is at the beginning of class and I tell them they need to ask all of their other teachers about context each class. I explain that they can only really understand a concept if they can teach it to a friend. For example, after they learn about temperature vs heat I tell them to consider a cup of tea at 160F vs a one mile wide iceberg at 32F and then ask a friend the following two questions:

1) Which has a higher temperature and why?
2) Which has more heat and why?

I also joke that this is an excellent way to test their relationship with that person because if that person is willing to help you with math/science homework they do really love you! ;)

I also explain how short-term vs long-term memory works and that is why repetition/study helps write that information to the student's hard drive while taking notes in class is short-term RAM memory that goes away after power down.

Finally, I always suggest that students look away from their notes and try to form a mental picture and then to explain what they are "seeing" in their brain. In this way, they are not just simply using wrote memory and it tends to relax them because describing a picture is so much easier than doing so for abstract words.

What are some (new) ways you might apply metacognition in one or more of your courses?
The Study Cycle and the Study Sessions images from Dr. Sandra McGuire's PowerPoint are excellent! I already added them to my Blackboard "How to Study" page, alerted students, and will walk them through these next week. I showed my wife and she will be suing them in her classes and on Google Classroom next week. She teaches History and Economics in a high school.

I will also try the Exam Wrapper and the Exam Autopsy.

P.S. The UCLA data clearly shows grade inflation! Wow.

14250:43288

Share edittextuser=46736 post_id=43288 initial_post_id=0 thread_id=14250

What are some (new) ways you might apply metacognition in one or more of your courses?
In the next problem-solving session I do with my physics students, I'm going to break the students into groups of two, or one group of three if there is an odd number, to work on a problem. I will have them begin by coming up with a plan to solve the problem and developing a strategy. After 10 minutes or so, the students will regroup with the other students in the row who were working on the same problem. They will compare their results and their progress. They will have an additional 10 minutes to work on the problem if they haven't already solved it. Then one student from each row will go up to the board and present a solution to the problem. At the end of the class, I will ask the students if their plan and strategy worked, and if not, what they think they could do better for the next time.

14250:43290

Share edittextuser=136014 post_id=43290 initial_post_id=0 thread_id=14250

What are some (new) ways you might apply metacognition in one or more of your courses?

Hi everyone - I find this topic to be really intriguing. Many of the activities are very simple yet the evidence supports that they work well for student success. I've used concept mapping before but I plan to try a 2 minute pause with a quick think-pair-share activity every 5-8 minutes when I use lecture. I reviewed the PowerPoint on the SAGE site (https://serc.carleton.edu/sage2yc/self_regulated/activities.html ), "Helping students learn how to learn" which is on self-regulation. There are concrete examples of the results teachers experienced when implementing the strategy. Those results convinced me that this is important.

I also plan to discuss the video on metacognition from LSU. The checkpoint of studying as if you were going to teach the information to someone else seems very tangible for students.

I was inspired by Tanner's article as well. I do have students self-reflect after large projects where they write two sections: what would they do differently if they could continue this work or start over AND a summary of their learning about the process. I should incorporate that reflection sooner in the process so they can make those adjustments as they go rather than as an evaluation at the end.

Thank you for the readings - Rebecca

14250:43293

Share edittextuser=138539 post_id=43293 initial_post_id=0 thread_id=14250

Originally Posted by Rebecca Martin


What are some (new) ways you might apply metacognition in one or more of your courses?

Hi everyone - I find this topic to be really intriguing. Many of the activities are very simple yet the evidence supports that they work well for student success. I've used concept mapping before but I plan to try a 2 minute pause with a quick think-pair-share activity every 5-8 minutes when I use lecture. I reviewed the PowerPoint on the SAGE site (https://serc.carleton.edu/sage2yc/self_regulated/activities.html ), "Helping students learn how to learn" which is on self-regulation. There are concrete examples of the results teachers experienced when implementing the strategy. Those results convinced me that this is important.

I also plan to discuss the video on metacognition from LSU. The checkpoint of studying as if you were going to teach the information to someone else seems very tangible for students.

I was inspired by Tanner's article as well. I do have students self-reflect after large projects where they write two sections: what would they do differently if they could continue this work or start over AND a summary of their learning about the process. I should incorporate that reflection sooner in the process so they can make those adjustments as they go rather than as an evaluation at the end.

Thank you for the readings - Rebecca



Melanie Will-Cole (CNM) comment:
Rebecca, thank you for your interesting insights. I too resonated with the Tanner's article. In my Honors STEM Climate Science classes the students are required to perform an authentic research project and I too plan to employ the self-reflection idea, i.e. have students address what would they do differently if they could continue this work or start over and a summary of their learning about the process. I think that reflection of this type will help my students to identify both the short-falls in their research approach and celebrate their positive accomplishments. As scientists it is important to recognize both our science short-falls as well as our impacts. From my perspective I realize that I learn the most from understanding where and why I made incorrect decisions/mistakes so that next time I will have more in-sight with respect to my "approach" with respect to performing research. thank you for your helpful comments.

14250:43297

Share edittextuser=44378 post_id=43297 initial_post_id=0 thread_id=14250

So i posted one of the slides that told how to study in smaller segments 'Plan, Study, break, Recap, Choose' to help students figure out when they get tired, overwhelmed, do they stop or continue? It is a good self assessment when thinking about how they are preparing for their exams. That professor's student commented that they took her advise on studying and it was very helpful to them (so i added it to my online classes why not?) this goes with their post exam reflections (which are optional and for extra credit).

Student Regulated Learning Activities: Should most definitely be a part of the courses... I always tell my students that you need to learn how to learn ... we all have had a point when we figured out what we need to do to prepare for an exam. I've been getting feedback from students on what they are and aren't doing-- also they are telling me what they like (especially videos).

I'd like to incorporate PREassessments-- let them tell me what they think/know about whatever topic is.... coming back to that after the lesson would be very eye opening... Not only does it show them they actually learned something but they had something (an idea) they can tie their new learning to (whether it was correct or incorrect). I think this is something neat that can be done online (in discussions or assignments).

14250:43304

Share edittextuser=9712 post_id=43304 initial_post_id=0 thread_id=14250

I watched the short video about metacognition and in it they talked about having students practice teaching others as a metacognitive tool. For the last 1.5 yrs I have been asking physical geology students to produce short (1.5 min) videos for each lecture topic, that are narrated and include appropriate visuals (not just ppt slides) to explain that topic. I leave the instructions very open ended and generic and then see what the students produce. Using these, students get practice "teaching" the content to others without taking valuable class time. I also strongly encourage students to take written notes, and I use exam wrappers after each exam.

I would like to start including some more pre-lecture prompts to get students thinking about what they already know, and then end with muddiest point or minute paper. Today I used a prompt about weathering and erosion (saw it in the example and I was on that topic today!), and it was actually a very interesting way to get started. Of course this took time away from class like we all worry about, so I am still figuring all of the timing out.

Finally, I would like to incorporate a short discussion of metacognition into my class so that they understand the point of some of the things we are doing. It isn't just busy work. What I ask them to do is designed to help them to LEARN.

I find this topic very interesting.

14250:43310

Share edittextuser=1053 post_id=43310 initial_post_id=0 thread_id=14250

The metacognitive practices I currently use are:
1) Assigning reading reflections on every pre-class homework assignment for my hybrid astronomy class. I read these reflections just before class each day and get a good idea of what is clicking and what is confusing.
2) Students complete weekly reflections online after class. I ask them “what worked” and didn’t work each week, and ask them to summarize the week’s main points and their muddiest point. I don’t have evidence that it has been successful for student learning (that correlation would be self-fulfilling: the students completing the reflections are also doing the reading, homework, attending class, etc). However, their feedback is essential for my own reflective teaching practice. I can easily see common sticking points and incorporate student feedback. Generally, students will tell me which activities (lecture tutorials, primarily) they found particularly helpful. This is especially helpful to me since this is my first time teaching this course.

Ideas for implementation:
These resources made me realize the breadth of possibilities for implementing metacognitive reflection! I love Dr. Kraft's notebook idea, but I don't want to bite off more than I can chew. A better place to start for me will be using Table 2 from Kimberly Tanner’s “Promoting Student Metacognition” to integrate metacognition into classroom activities I am already doing, such as think-pair-share (or clicker questions) and lecture tutorials. I'd also like to try the exam wrapper and "metacognition talk" that Bryn Benford mentioned last week, and will incorporate that into our first assessment next term. This talk could include the self-regulated learning cycle, reading methods, and effective study processes (a couple of slides in the Saundra McGuire's powerpoint had great diagrams that I will definitely borrow).

I want to learn more about...
Providing structured feedback efficiently, and assessing to allow students to make mistakes, grow, and demonstrate mastery down the line. I find it difficult to provide meaningful feedback when gathering lecture tutorials daily and quizzes weekly - with 46 students it's hard to give each student a lot of individual attention. I'm toying with not gathering those anymore, implementing self-grading (and making the weekly quizzes formative instead of summative), and instead providing feedback on (short!) daily exit tickets which target higher Bloom's levels. I'm also curious if anyone uses a standards-based assessment approach despite being in the sciences, which often requires sequential and summative mastery. I can provide all the metacognitive reflection I want, but if the student demonstrates that they have grown as a learner but has no chance to "prove" it on assessments, it may be discouraging. This may not be the time or place for this conversation, but if anyone has thoughts on assessment and course design that addresses this issue, please contact me!

14250:43331

Share edittextuser=137827 post_id=43331 initial_post_id=0 thread_id=14250

Hello all-
I have addressed two of the questions for this discussion:

1) What do I currently incorporate?
I currently administer an exam wrapper after the first lecture exam, and I also use clicker-type questions and think-pair-share activities that incorporate students to address how a question was answered and what information is needed to address it. Unfortunately, I have no firm evidence that any of this is successful! I suppose that I am able to see an immediate change in response to follow-up clicker questions, but to determine whether the first exam wrapper is successful, I would need to follow it up with a second similar exam wrapper, which I do not do. I would love to hear how others measure this.

2) What are new ways I could incorporate metacognition?
I found that Kimberly Tanner’s paper (Promoting Student Metacognition) gave me a few ideas as to how I might incorporate some reflective activities immediately. In particular, I plan to add a reflective question onto each of my remaining online lab exercises, such as “To what extent did I successfully accomplish the goals of this task?” or “If I were the instructor, what would I identify as strengths of my work and flaws in my work?” or “When I do an assignment like this again, what would I do differently?”.

I also was particularly inspired by Dr. Kraft’s SAGE 2YC page “One Instructor’s Approach to Developing Self-Regulated Learners”. I love the idea of a term-long notebook but cannot see myself incorporating something like that this or even next term. I do think her idea of using initial and final prompts as ways of self-reflection might be strategies that I will try next term. I think this needs to happen at the beginning of a term, though, so that students get into the habit of this practice. If other also do this, I would love to hear how it has worked.

I look forward to reading about everyone else's experiences with metacognition in their courses, and hope to get some advice!

-Michelle

14250:43346

Share edittextuser=25762 post_id=43346 initial_post_id=0 thread_id=14250

Hi Everyone,

I really liked learning about metacognition because although I've seen the word before in some educational type readings, I've never delved deeply into this topic before. I chose this question to answer:

What are some (new) ways you might apply metacognition in one or more of your courses?

After watching the video and reading Kimberly Tanner's article, I am thinking of two concrete ways to apply metacognition in my classes.

1. One the first day of a class I usually give a syllabus quiz or game type activity and then a lite lecture highlighting what types of topics we will be covering in the class - just to get everyone on board and excited. After the syllabus game, I plan on creating a metacognition activity which infuses the types of topical ideas I usually present with learning strategies so students can learn to assess their own learning and set up a plan for their approach to the class from day one. I think this will be a fun and challenging activity for me to create and I look forward to running it in my first classes in spring quarter.

2. The second strategy I plan on implementing - starting next week - is a post activity question for the students to answer just after they engage in an active learning portion of the class that asks - "Why did my instructor have me do this activity?" I will give each student an index card so they can jot down their answer. Then I will show a "reveal" slide where I post the reason I had them do the activity or the take home idea of that lesson. They can compare their ideas with mine to see if we are on the same page. If not, they will at least see what I hoped the point of the activity would be. As an option, I will give them another minute to write out a question they still have or an improvement to the activity that would help bring the main idea into clearer focus. I will collect the cards and review before the next meeting so I can clear up any misconceptions and keep the improvement ideas for the next time I run that activity. I think this will be a fun and relatively easy way to provide a bit of metacognition for the student learning and my own teaching.

I look forward to seeing what others plan to do (or already do) with metacognition to get some more easy to incorporate ideas.

Kathleen

14250:43347

Share edittextuser=138540 post_id=43347 initial_post_id=0 thread_id=14250

Hi Scott,
It sounds like you are using some great techniques in your class. Have you graded or looked over notes so that you can student improvement in their note taking skills? Have you seen an improvement with test or homework scores? I love the idea of encouraging the students in being able to teach the material. I am considering having students video short clips of teaching some part of the material and using those in both my seated and online classes. It is wonderful that you are covering Bloom's with your students. I would be curious to know if students are relating the levels of Blooms you are providing with activities etc with how they study that topic?

Adrianne Leinbach (Cohort 1)

14250:43357

Share edittextuser=18408 post_id=43357 initial_post_id=0 thread_id=14250

Scott,
It sounds like a great idea to have students work together on the problem solving. I wonder if it might be beneficial to have students not only share their solution but how they approached it. Whether right or wrong it might be beneficial for students to see the thought process of the other groups.

Adrianne Leinbach (Cohort 1)

14250:43358

Share edittextuser=18408 post_id=43358 initial_post_id=0 thread_id=14250

Rebecca,
Mixing in those think pair shares and other activities will definitely keep the students engaged. I would like to hear if you see changes in test scores or student evaluations. Adding the reflections early is also a great idea, allowing the students to reflect on what they did and how they might do things differently can work on anything from group work, projects, note taking, studying and test taking.

Adrianne Leinbach (Cohort 1)

14250:43361

Share edittextuser=18408 post_id=43361 initial_post_id=0 thread_id=14250

Deniz,
It is a great idea to use this in your online class. I will be curious to see how you implement. I know my biggest issue with online students is getting them logged in multiple times a week if I wanted them to do a pre and post discussion. Your ideas made me think that perhaps I could use it and do the thoughts for upcoming lesson in one week and in the next week do the post where they refelct on how it was different than what they expected and perhaps tell me if there was anything I could have done differently in the activity or assignment that might have helped in their learning.

Adrianne (Cohort 1)

14250:43363

Share edittextuser=18408 post_id=43363 initial_post_id=0 thread_id=14250

Polly,
I love the activity where the students make the short videos. Are these ever posted for other students to see? It is a wonderful idea if you share the metacognition information, blooms and other information on what you are trying to do. Students can take an active roll if they understand what you are trying to accomplish and that it might help them in other classes not just geology.

Adrianne (Cohort 1)

14250:43364

Share edittextuser=18408 post_id=43364 initial_post_id=0 thread_id=14250

This post was edited by Mary Baxter on Feb, 2020
What is something I currently do to incorporate metacognition in my courses?
Not enough! With my larger classes (200 & 80 students at the U of Oregon) almost every day I do what I call in-class sheets. They are a way of taking attendance, but also function (somewhat) as mini-quizzes. These are 4 to 5 questions (often on a ½ sheet) on content of the previous days lecture, and some from the current day. It provides a chance for my students to get up and use the restroom, refill their water, talk with each other, and get a bit of a break. After giving them ~ 5-8 minutes, I then ask for students to volunteer the correct answers. If no one does, I give them the answer (writing it all out with the document camera so that all can see). That way the students know the correct answers to those questions before they leave the room. I know some don’t bother to fill them out themselves, they just wait for me/other students to give them the answers, but it still puts that information through their mind and out their pen/pencil onto paper. Perhaps this fits under Retrieval Practice?
I often ask my students pointed questions so that I can use their life examples to illustrate a concept of some type. I try my best to call on students who typically haven’t put their hand up when I’ve asked questions on the material directly from lecture. I feel that students might be more willing to talk about their life experiences than answer a question that they might be wrong about.
I believe that students hearing how the life experiences of their fellow students can relate to lecture content will increase the comprehension and retention of the subject material under discussion. Do I know this for a fact? Certainly there is a connection between attendance and test scores in that the more conscientious students are often more likely to study better/more successfully. But I have gotten answers on tests when students have used those student experience examples correctly in their answers, so I know, for some, it works.
What are some (new) ways you might apply metacognition in one or more of your courses?
I definitely want to use some (many!) of the slides in Sandra McGuire’s Powerpoint about metacognition to post to the on-line learning system so that students can access them, and also to use some in the first few days of class. Anything that can help students think about their own “learning” processes would be good.
I want to incorporate more think-pair-share into my smaller class size courses, and really liked the idea of setting up students to each give a mini-tutorial about one particular aspect of a subject (with no ehs, or ums, allowed!). I also think that Concept Maps would be a great way to get students to learn about the different types of rocks: Igneous rocks and where they fit into Plate Tectonics, and Sedimentary rocks and how they fit into different sedimentary environments.
I enjoyed reading Kaatje Kraft’s approach to developing self-regulated learners. I can see myself using many of her ideas in my smaller class size courses at LaneCC, particularly the KWLH. Students should be aware that learning never ends as you go through life, and that is a good thing, not bad!
What more do I want to know?
I haven’t yet read everyone else’s submissions yet, and I will as I want to see what insights the rest of the cohort got from the readings, etc. When I read the previous submission board, I realized that I didn’t “get” all of the information, and it was enlightening to read about my colleagues thoughts on the subjects, and what they do that works for students.
Mary Baxter, LaneCC, Eugene,OR

14250:43374

Share edittextuser=137816 post_id=43374 initial_post_id=0 thread_id=14250

-What is something you currently do to incorporate metacognition in your courses? Do you have evidence that indicate it's been successful? Any suggestions for others who might want to implement something similar?

I realized that I barely incorporate metacognition activities in my class. One activity that I incorporated in my current class was to ask students to think and write down their own question and answer about the material that they needed to review for a quiz. I told students that even though I am usually the one providing the questions for the quizzes, this time they needed to formulate their own creative question and provide a good answer for it. I could see how the students were positively engaged with this new type of “creative” quiz. My goals with this active-learning activity were: to promote a self-reflection process in the students about their ability to evaluate their own teaching process, and to know what topics that students feel like they command. I do not have evidence that indicated that this was a successful activity. If somebody is interested in implementing something similar, I would suggest asking the students to think/write down two questions about the prep material: one question for which they know the answer, and second question for which they do not know the answer.

-What are some (new) ways you might apply metacognition in one or more of your courses?

I will implement a before and after exam questionnaire (Wrapper exam). In the before questionnaire, I will include the following questions: How do you plan on preparing for the next exam? What resources are available to support you? Ask three students about their studying strategies. Regarding the after exam questionnaire, I will include these questions: What about the exam preparation worked well that I should remember to do next time? and What did not work so well that I should do not do on the next exam?

-What more do you want to know?

How to objectively assess the success of using metacognition activities.

14250:43383

Share edittextuser=137820 post_id=43383 initial_post_id=0 thread_id=14250

14250:43384

Share edittextuser=137820 post_id=43384 initial_post_id=0 thread_id=14250

What is something you currently do to incorporate metacognition in your courses? Do you have evidence that indicate it's been successful? Any suggestions for others who might want to implement something similar?

After exams, I have asked students "How many hours did you spend studying for the exam?".
The most telling moment was when a student piped up and said "You mean minutes!".
And now I know that this is part of an Exam Wrapper. It is helpful to know some additional questions I can ask after the exam to instill in the students some notion that they need to be spending time doing particular things and thinking about how they approach studying. It is nice to have some particular things I can ask them now.

So when I started this training, I did not really know what metacognition was, or exactly what "reflection" was. Nothing I had heard about these terms really made sense. This module (Activity 5) was a great introduction, and it was fun to see that I had actually done some of the things mentioned. I often do the think-pair-share activity when starting a new topic, asking students what they know about a topic, then sharing notes with a partner, and reporting back to the class. The post-exam reflection handout is very helpful.

14250:43389

Share edittextuser=1197 post_id=43389 initial_post_id=0 thread_id=14250

What more do you want to know?

What is a good way to present Bloom's Taxonomy to a class? Should I post it and ask students to write a question for each level of the taxonomy, for practice?
If I give a lot of "remembering" questions on a quiz, how would I incorporate some higher level questions into a test? Would they have to be short answer or essay? Or can you do multiple choice questions on higher level topics?
One thing I do in labs is have students interpret depositional environments of sedimentary rocks from short descriptions of the rocks that include critical features (such as red color and fining upward sequences). I guess that falls in the "analyze" category? Anyway, it would be good to have some example questions that address Bloom's Taxonomy, that I could use and adapt to the topic at hand. Thanks.

14250:43390

Share edittextuser=1197 post_id=43390 initial_post_id=0 thread_id=14250

What do I currently do with metacognition?
I spend a fair amount of time talking with students about the adaptive learning assignments that we use (via our eText). I explain the cognitive science behind them and the idea of a flipped classroom.

What more do I want to know? What might I implement?
I used to implement exam wrappers when I gave paper tests, but I have been having trouble with them since I have switched over to administering exams via Canvas. I used to add an extra page at the end of the exam with some reflection questions, and I had them tear it off and hold on to it when they turned in their exams. Then I would grade the exams, hand them back in the next class and we would go over answers (often I would have them make corrections by talking with peers to find the correct answer) and have a brief discussion about metacognition. I'm struggling to translate that procedure to the new, online exams. They take the exam in-person, and they can see which answers they got incorrect (and I have the option of showing the correct answer) immediately after submitting their exam. So, each student takes a different amount of time to finish, they see their score immediately and then they leave for the day. So the next class session there isn't anything for me to hand back, or for them to look at and compare with their peers, so I am at a loss for how to create that "moment" of analyzing their results. Does anybody else do exam wrappers on Canvas? Advice on walking them through correcting their mistakes when they can't have the test directly in their hands?

14250:43394

Share edittextuser=17427 post_id=43394 initial_post_id=0 thread_id=14250

Originally Posted by Scott Gianelli


What are some (new) ways you might apply metacognition in one or more of your courses?
In the next problem-solving session I do with my physics students, I'm going to break the students into groups of two, or one group of three if there is an odd number, to work on a problem. I will have them begin by coming up with a plan to solve the problem and developing a strategy. After 10 minutes or so, the students will regroup with the other students in the row who were working on the same problem. They will compare their results and their progress. They will have an additional 10 minutes to work on the problem if they haven't already solved it. Then one student from each row will go up to the board and present a solution to the problem. At the end of the class, I will ask the students if their plan and strategy worked, and if not, what they think they could do better for the next time.



I really like that idea, Scott. I also remember Saundra saying about having students practice without having example problems in front of them because then they really saw what they understood and what they didn't, and it got them used to solving problems as they would on an exam.

14250:43397

Share edittextuser=31805 post_id=43397 initial_post_id=0 thread_id=14250

Originally Posted by Pamela Gore


What more do you want to know?

What is a good way to present Bloom's Taxonomy to a class? Should I post it and ask students to write a question for each level of the taxonomy, for practice?
If I give a lot of "remembering" questions on a quiz, how would I incorporate some higher level questions into a test? Would they have to be short answer or essay? Or can you do multiple choice questions on higher level topics?
One thing I do in labs is have students interpret depositional environments of sedimentary rocks from short descriptions of the rocks that include critical features (such as red color and fining upward sequences). I guess that falls in the "analyze" category? Anyway, it would be good to have some example questions that address Bloom's Taxonomy, that I could use and adapt to the topic at hand. Thanks.



One way I present Bloom's to a class is I ask them first if anyone knows what Bloom's Taxonomy is. I usually have some education students in my class, and so they might raise their hands. I then ask them if they want to explain it. I usually get the response, "Well, I remember learning it, but that's about it." I then flip to a slide that shows the levels of Bloom's taxonomy and say, "Okay, so you "remember Bloom's." We then start to talk about the levels of understanding, and I say remembering is the first level, but then we go up through the levels. one of my favorite examples is to use the example of, "Have you ever been singing a song in the car, and you know all of the words, and then suddenly, you go, 'Oh! That's what that song is about! I should not have been singing it in front of my parents!'". We talk about how that is moving from just remembering the words of the song to actually understanding what they are about. Eventually, they could be in a situation and be like, "That song should be playing in the background right now because this is exactly what that song is about." We go through analyze and evaluate and then end up at create where that would be the equivalent of them understanding the song so well that they could write another verse to the song. For me, that example seems to help students.

For exam questions, I tend do concept sketches where they have to explain and sketch a concept, but if you want to do a multiple choice exam, I think the way to think about it is they need to already know the definitions, but how do they use that information to answer something like a real-world example. I know that the Steve Reynolds book "Exploring Geology" has multiple choice exam questions on Connect, and you can filter the questions based on what level of Bloom's you want to focus on. I think other books might have that feature as well.

14250:43398

Share edittextuser=31805 post_id=43398 initial_post_id=0 thread_id=14250

Originally Posted by Robin Nagy


What do I currently do with metacognition?
I spend a fair amount of time talking with students about the adaptive learning assignments that we use (via our eText). I explain the cognitive science behind them and the idea of a flipped classroom.

What more do I want to know? What might I implement?
I used to implement exam wrappers when I gave paper tests, but I have been having trouble with them since I have switched over to administering exams via Canvas. I used to add an extra page at the end of the exam with some reflection questions, and I had them tear it off and hold on to it when they turned in their exams. Then I would grade the exams, hand them back in the next class and we would go over answers (often I would have them make corrections by talking with peers to find the correct answer) and have a brief discussion about metacognition. I'm struggling to translate that procedure to the new, online exams. They take the exam in-person, and they can see which answers they got incorrect (and I have the option of showing the correct answer) immediately after submitting their exam. So, each student takes a different amount of time to finish, they see their score immediately and then they leave for the day. So the next class session there isn't anything for me to hand back, or for them to look at and compare with their peers, so I am at a loss for how to create that "moment" of analyzing their results. Does anybody else do exam wrappers on Canvas? Advice on walking them through correcting their mistakes when they can't have the test directly in their hands?



First off, I don't have any experience with Canvas, but do you have a way to look at which questions are missed most fequently? If you could do that, you could bring that to the next class as a starting point and then focus the discussion with them on why they struggled with those topics. Alternatively, if they are all leaving class already knowing what they got wrong, could they try one of those exam autopsies prior to coming back to the next class? Maybe with a tiny bit of extra credit associated with it...

14250:43399

Share edittextuser=31805 post_id=43399 initial_post_id=0 thread_id=14250

Originally Posted by Pamela Gore


What is something you currently do to incorporate metacognition in your courses? Do you have evidence that indicate it's been successful? Any suggestions for others who might want to implement something similar?

After exams, I have asked students "How many hours did you spend studying for the exam?".
The most telling moment was when a student piped up and said "You mean minutes!".
And now I know that this is part of an Exam Wrapper. It is helpful to know some additional questions I can ask after the exam to instill in the students some notion that they need to be spending time doing particular things and thinking about how they approach studying. It is nice to have some particular things I can ask them now.

So when I started this training, I did not really know what metacognition was, or exactly what "reflection" was. Nothing I had heard about these terms really made sense. This module (Activity 5) was a great introduction, and it was fun to see that I had actually done some of the things mentioned. I often do the think-pair-share activity when starting a new topic, asking students what they know about a topic, then sharing notes with a partner, and reporting back to the class. The post-exam reflection handout is very helpful.



I love the "You mean minutes!" comment. So telling. I also like to ask them how they prepared and I tell them that just saying "studying" my notes or book is not enough. I want to know what "studying" actually entails for them, and then we all talk about the different ways people are studying/learning and what is being more effective for them.

14250:43400

Share edittextuser=31805 post_id=43400 initial_post_id=0 thread_id=14250

Andrea,
Thanks for sharing! I think it is so great how you are already gathering student feedback through your formative assessments. I really hear you about "biting off more than you can chew!." I use write-pair-share multiple times in each class. I think giving students a minute to think and write a response individually is a great way to weave in metacognition in each class. When you use clickers, do you use them as a T-P-S? For instance, have students respond individually to a question, then show the class response poll, and then have students discuss why they chose the answer they did? That format really forces students to explain their thinking. I teach astronomy, too. Have you found the UNL Class Action resources? There are tons of clicker questions there. Just google it, or happy to share resources.

14250:43420

Share edittextuser=10235 post_id=43420 initial_post_id=0 thread_id=14250

Michelle--Thanks for the thoughtful insights! It's great to see all the metacognition you currently use in your classes. I think you pose a great question about how to assess if all of this is working. I use a variety of these techniques, too, and have never assessed their impact. However, I try to take solace in knowing that most, if not all, of these practices have been studied by others and published in peer-reviewed journals as research-backed, effective forms of teaching. So, I'm hoping if they have worked for other students, they will work for the students I teach!

14250:43421

Share edittextuser=10235 post_id=43421 initial_post_id=0 thread_id=14250

Hi Kathleen,
Great ideas! I really like your idea of introducing metacognition on the first day. I also like your idea of using notecards. I often have students do an end-of-class evaluation everyday. Sometimes it is a short, ungraded quiz (I give them answers after taking it), or a sketch, or just a general question like "what is one new thing you learned today, and what is one question you still have."

14250:43427

Share edittextuser=10235 post_id=43427 initial_post_id=0 thread_id=14250

Hi Mary,
Thanks for sharing. I was especially interested in reading about how you use your in-class sheets in a large lecture format. It's also great to read how open you are to these new ideas. One thing I really liked about this session is how we can reframe grades and learning with students. I find myself explicitly reminding students that grades are not really a measure of how smart you are, but more of a reflection of your practices and skills regarding learning. This is how metacognition fits in; it is a tool that can be used to improve success in all courses.

14250:43428

Share edittextuser=10235 post_id=43428 initial_post_id=0 thread_id=14250

What is something you currently do to incorporate metacognition in your courses? Do you have evidence that indicate it's been successful? Any suggestions for others who might want to implement something similar?
I have heard about metacognition before, but have always had difficulty in implementing it into my courses. I have used Exam Wrappers for a few semesters now, principally after the first exam is handed back, and offer some extra points as incentive for students to submit them. But I have not effectively used them as post-assessment tools. I need to find better ways to follow up. I do go through a short introduction of metacognition with my students before passing the Exam wrapper sheets out, and often get some ah-ha's from the education majors. Do I have evidence that indicates they have been successful? Not really - for some students they seem to be a positive experience, and they report that they did change up their studying techniques for the next exam. But it seems inconsistent - other students do not seem to make the same connection about study technique and outcomes.

What are some (new) ways you might apply metacognition in one or more of your courses?
There really is so much on this topic that I never was aware of! I must confess to losing myself in many of these pages, and then realizing it was several hours later! I think that some of the slides from Saundra McGuire's presentation would be helpful to introduce my students to the concept of metacognition. Some of the techniques discussed, especially by Tanner seem very adaptable to geoscience courses. I particular want to incorporate the Muddiest point, and Pre- and Retrospective Post assessments. Additionally, I want to look into incorporating Clicker questions (or Kahoots) as a pre-lecture tool.

What more do you want to know?
I want to find ways to integrate these techniques better with my online courses, particularly the pre-assessments and Muddiest points. I'm not sure if doing it as a Discussion post would be the best way or not.

14250:43447

Share edittextuser=17143 post_id=43447 initial_post_id=0 thread_id=14250

Andrea,
Thanks for sharing! I think your points about how to integrate metacognition into course design and assessment are well taken. I guess my advice is that just giving students opportunities and tasks that require metacognition will improve their student toolbox. I really like Sandra's point that we are trying to teach students skills that can apply to all sorts of classes. As far as assessment goes, Kimberly Tanner and Jeff Schniske wrote a really nice paper, "Teaching More By Grading Less," in CBE biology that provided me a lot of great ideas to chew on about incorporating activities like the ones you mention in assessment. That might be a great place to start. It really gave me a whole different perspective on assessment and grading.

14250:43451

Share edittextuser=10235 post_id=43451 initial_post_id=0 thread_id=14250

Edgar,
It's great to see how metacognitive you are being in your teaching! I think it's great that you are considering using wrappers. Today, I gave a two-stage exam, with individual and group portions. Overhearing the discussions during the group exam made me think of how students are really thinking deeply about why they chose an answer by having to justify it to their group. Metacognition right there! I think there is a natural tie in to what you covered early about active learning and metacognition; i.e. many types of active learning already integrate metacognition into them.

14250:43452

Share edittextuser=10235 post_id=43452 initial_post_id=0 thread_id=14250

Originally Posted by Andrea Goering


The metacognitive practices I currently use are:
1) Assigning reading reflections on every pre-class homework assignment for my hybrid astronomy class. I read these reflections just before class each day and get a good idea of what is clicking and what is confusing.
2) Students complete weekly reflections online after class. I ask them “what worked” and didn’t work each week, and ask them to summarize the week’s main points and their muddiest point. I don’t have evidence that it has been successful for student learning (that correlation would be self-fulfilling: the students completing the reflections are also doing the reading, homework, attending class, etc). However, their feedback is essential for my own reflective teaching practice. I can easily see common sticking points and incorporate student feedback. Generally, students will tell me which activities (lecture tutorials, primarily) they found particularly helpful. This is especially helpful to me since this is my first time teaching this course.

Ideas for implementation:
These resources made me realize the breadth of possibilities for implementing metacognitive reflection! I love Dr. Kraft's notebook idea, but I don't want to bite off more than I can chew. A better place to start for me will be using Table 2 from Kimberly Tanner’s “Promoting Student Metacognition” to integrate metacognition into classroom activities I am already doing, such as think-pair-share (or clicker questions) and lecture tutorials. I'd also like to try the exam wrapper and "metacognition talk" that Bryn Benford mentioned last week, and will incorporate that into our first assessment next term. This talk could include the self-regulated learning cycle, reading methods, and effective study processes (a couple of slides in the Saundra McGuire's powerpoint had great diagrams that I will definitely borrow).

I want to learn more about...
Providing structured feedback efficiently, and assessing to allow students to make mistakes, grow, and demonstrate mastery down the line. I find it difficult to provide meaningful feedback when gathering lecture tutorials daily and quizzes weekly - with 46 students it's hard to give each student a lot of individual attention. I'm toying with not gathering those anymore, implementing self-grading (and making the weekly quizzes formative instead of summative), and instead providing feedback on (short!) daily exit tickets which target higher Bloom's levels. I'm also curious if anyone uses a standards-based assessment approach despite being in the sciences, which often requires sequential and summative mastery. I can provide all the metacognitive reflection I want, but if the student demonstrates that they have grown as a learner but has no chance to "prove" it on assessments, it may be discouraging. This may not be the time or place for this conversation, but if anyone has thoughts on assessment and course design that addresses this issue, please contact me!


Andrea,
Using student reflections is a great way to include students in their learning. I have found in my classes that if I use the reflections to make a slight change in something that I am teaching, the students feel like I am listening to them and it makes them take ownership in their learning. They often become much more verbal with their ideas in both my online and seated classes. I also agree that I want to implement lots of ideas but the grading often gets the best of me. One semester I graded all of my students notes each week to help their note taking skills. Grades did improve that semester but I need to find a way to reduce the grading but come up with the same results. Perhaps we can share ideas as we have them.

14250:43466

Share edittextuser=18408 post_id=43466 initial_post_id=0 thread_id=14250

Michelle,
Do you have your second test scores from before you started doing the first exam wrappers. Are giving similar test? If so you could take a look at whether test scores have improved.

Adrianne Leinbach (Cohort 1)

14250:43467

Share edittextuser=18408 post_id=43467 initial_post_id=0 thread_id=14250

Kathleen,
I think both the activities you plan to implement sounds like a great idea. The index cards will likely be very eye opening on why students think they are doing an activity and what they should be getting out of it. If you continue to do this activity throughout the semester I would love to hear how your students answers improve throughout the semester.

Adrianne Leinbach (Cohort 1)

14250:43468

Share edittextuser=18408 post_id=43468 initial_post_id=0 thread_id=14250

Mary,
I like the ideas of these quizzes/ mini assignments. I wonder how it could work if you made them into think pair shares then picked a group each time to either answer or put their answers under the document camera. You could even warn the first pair or two that you would like to show theirs and that might inspire everyone.

Adriane Leinbach (Cohort 1)

14250:43469

Share edittextuser=18408 post_id=43469 initial_post_id=0 thread_id=14250

Edgar,
I agree that determining success can be difficult. I would be curious to see if you asked students to reflect on their learning in your class if you would get some qualitative data perhaps what they felt what worked best and what did not. Last semester I taught a study skills class which was great because the class was completely about many of the things I had learned in my time in Cohort 1. It was not related to my geology course at all. I was able to get many of the students to respond honestly about their study habits and most admitted they knew they needed to study differently but just did not take the time to do it. I think your exam wrappers will make students responsible for their studying and test scores.

Adrianne Leinbach (Cohort 1)

14250:43470

Share edittextuser=18408 post_id=43470 initial_post_id=0 thread_id=14250

Pamela,
One helpful thing that our geology group did in the past was to combine all of our test questions into groups then each of us would go through and label what level of Blooms we felt the question assessed. It was eye opening that many of us disagreed on many of the questions. We did the same thing with some of our assignments and all of our lesson level learning objectives. This was great because I now share all of my learning objectives for each lesson with my students along with the level of Blooms that is expected.

Adrianne Leinbach (Cohort 1)

14250:43471

Share edittextuser=18408 post_id=43471 initial_post_id=0 thread_id=14250

Originally Posted by Deron Carter


When you use clickers, do you use them as a T-P-S? For instance, have students respond individually to a question, then show the class response poll, and then have students discuss why they chose the answer they did? That format really forces students to explain their thinking. I teach astronomy, too. Have you found the UNL Class Action resources? There are tons of clicker questions there. Just google it, or happy to share resources.



Hi Deron! Yes, I often have students explain their reasoning with T-P-S, typically if the class is "split." Sometimes I show them the response poll beforehand, and sometimes I don't. I usually wander the room and eavesdrop, asking quiet groups questions, and sometimes drop hints. This is an easy way to figure out how folks are thinking without having to collect anything.

THANK YOU for sharing the UNL Class Action resource! I have used the UNL Interactives in class but had NO IDEA they had ConcepTest questions, too. The ones I use are either from the book (generally poor quality), made up by me, or cribbed from questions on the CAPER Lecture Tutorials. It is great to have another tool in my box!

14250:43521

Share edittextuser=137827 post_id=43521 initial_post_id=0 thread_id=14250

Join the Discussion


Log in to reply

« Activity 5 Discussions