Qm
Statistics

Miss rate of a well-powered test

powertype-ii-errorhypothesis-testing

An experiment is designed with 90%90\% power to detect the effect the team cares about.

If that effect is real, what is the probability the test fails to detect it (its type II error rate)?

Your answer

Solving needs a free account

Answers, streaks and solutions unlock when you are signed in. Reading the question and the hint stays free.

Create a free accountSign in

Discussion

Sign in to join the discussion · reading is open to everyone

💡 Discussion rules

  1. No full solutions here. Hints and approaches only.
  2. Complexity, edge cases and intuition are the point.
  3. Interview experiences are welcome. Respect your NDAs.

Loading discussion…

Learn the concepts

The theory behind this question.

Minimum Detectable EffectThe Neyman-Pearson LemmaA/B TestingAbnormal Return Tests and the BMP StatisticAlways-Valid Inference and e-Values

Related questions

Power, the miss rate, and a real edgeFrom miss rate back to powerType II error from a fixed decision thresholdMiss rate when the signal sits closer to the noisePower of an alarm rule from its thresholdThe smallest effect a test can catch
All questions →