Coke vs. Pepsi Taste Test: Experiments and Inference about Cause
This material is replicated on a number of sites as part of the SERC Pedagogic Service Project
The Coke vs. Pepsi Taste Test Challenge has students design and carry out an experiment to determine whether or not students are able to correctly identify two brands of cola in a blind taste test. In the first stage of the activity students design and conduct the experiment. In the second part of the activity students use Sampling SIM software (freely downloadable from http://www.tc.umn.edu/~delma001/stat_tools/) to simulate and gather information on what would be expected under chance conditions (i.e., if students obtained correct answers only by guessing). The students then compare the observed results to the chance results and make an inference about whether a given student can in fact correctly identify Coke and Pepsi in a blind taste test. Finally, the experiment is critiqued in terms of how well it met the standards for a good experiment.
This activity allows students to gain a better understanding of the experimental process and causality through considering control, random assignment, and possible confounding variables. The activity also allows students to begin to understand the process of hypothesis testing by comparing their observed results of the taste test to the results obtained through Sampling SIM (which model would be obtained by chance). Students make an inference about whether particular students in their class can truly tell the difference between Coke and Pepsi by reasoning about how surprising the observed results are compared to the simulated distribution of correct identifications by guessing. The activity also provides an opportunity for discussing generalizability to a population.
Context for Use
Description and Teaching Materials
This activity takes place in two stages as described below.
Roles: Within each group of four students, assign each student to one of the following roles.
- Tasters--those who think they can tell the difference (blind to test).
- Runners--those who run cups of cola from room to hall (blind to test).
- Recorders--they record results of tasters decisions about whether they are tasting Coke or Pepsi.
- Pourers--remain in the classroom as pourers/observers.
The following materials are needed:
- 10 Dixie cups per group for taste testing
- 8 additional Dixie cups for clearing the palate
- Coke and Pepsi (4 cans of each is enough for 8 groups)
- Recorder slips for each group
- Coke/Pepsi pourer slips, where each group is given a random order of Coke and Pepsi over 10 trials
- Sampling SIM software loaded on the computer or another simulation program or applet (see Available Technologies)</li
Copy of Student Handout (Microsoft Word 43kB Feb25 07)
Stage One of Activity: Designing and Conducting the Experiment
First, students are asked to consider how to design an experiment that will allow them to determine if anyone can correctly identify two different brands of cola in a blind taste test. After a discussion of various methods, a plan is introduced to use in conducting a taste test.
Students are asked to self identify who can correctly identify Coke or Pepsi in a blind taste test. Groups are then formed with one of these students in each group to be the tester. Groups of four work best. Each group member has one of the following roles:
First, the tasters, the recorders, and the runners will leave the room. The pourers are produce random series of Coke or Pepsi using a coin to determine what the tasters would taste. The pourers will be the only members of the group knowledgeable of the condition. The pourers will pour the appropriate drinks into paper cups, and leave them in a row to be tasted at their table. These people may switch groups when the taste testing begins so they will not know the order of colas to be tested.
Next, the runners will bring the first Dixie cups with cola to their group taster. The tasters will taste the drink and make a decision about whether they think it is Coke or Pepsi that they are drinking. The recorder will keep track of the taster's decision. The tasters will cleanse their palettes in between trials by taking a drink of water.
Repeat the above process 4 more times for a total of 5 trials. At the end. The results are reveled and the number of correctly identified colas is tallied for each taster.
Stage Two of Activity: Analyzing the class data
First, students discuss the results, being asked if they think any of the results suggest that a student is doing better than just guessing. They are asked what kind of data would be expected if they were just guessing. This leads to simulating data for the situation of guessing (p = .5, n = 5 trials). Use Sampling SIM (or another simulation program or applet) to simulate the Coke/Pepsi activity, simulating data for 500 trials. Then students can compare the number of correct guesses to this distribution to see if their score is due to chance (in the middle) or surprising (in one of the tails). A final discussion involves critiquing the experiment and talking about what could have made it better (e.g., more tastes).
Teaching Notes and Tips
Have students discuss or write answers to the following questions: