Answers to 5.3 Power

In the following table, determine where each of the pieces should go. Note that we have six things to populate but only four cells: each cell must contain at least one of the six things. Think critically here before testing your answers!

H0 is true H1 is true
p < .05 (statistically significant) A B
p > .05 (statistically non-significant) C D

Which cell should each of the following items go?

  1. alpha (answer = A)
  2. power (answer = B)
  3. type I error (answer = A)
  4. Type II error (answer = D)
  5. Correct inference (answer = B & C)

Let’s see what happens when we both increase power AND decrease alpha. Fill out the table on your own. When we assume the null and alternative hypotheses are 50% likely each, and we set our alpha to 1% and our power to 95%, how much more likely is it that the alternative hypothesis is true than the null hypothesis is true? (answer = 95 times more likely!)