o you think the problems discussed in the “Real vs. Illusory Effects” lecture series (especially in Part 7)
about the replication crisis, file drawer problem, multiple comparisons, and p-hacking are particularly likely in
a certain area/field of research? Why? Or, why not? What about a certain research design (survey, experiment,
etc.)? Why? Or, why not? Apply course material to help support your answer.
2. Have a friend or family member read this article – https://www.vox.com/future-perfect/21504366/sciencereplication-crisis-peer-review-statistics. Then interview them. You can ask any questions you like, but get a sense
of if they sound like a Candide, skeptic, or Skeptic after reading the article. Then explain why you believe they fit
into one of the three categories. Apply course material to help support your answer.
3. Give your friend or family member one piece of advice from the course that you think is the best advice for
approaching new evidence. Specifically, what is something from the course that you would tell them to use when
evaluating evidence in the future and why? Apply course material to help support your answer.
4. What did your friend or family member think about the advice you gave them in #3? Did the advice change their
mind for how they will approach new evidence in the future? If yes, how so and why? If no, why not?
5. Imagine that you and a group of people are presented with some new evidence trying to convince you of
something. (Could be anything – taking a new medication, buying a certain kind of car, which dog breed is the
best, etc.) Based on your interview and discussion with your friend or family member, how will you approach
talking about evaluating new evidence with this group of people? Specifically, what is your strategy for how to
discuss “becoming a better research consumer” with them? Apply course material to help support your
answer.
