Qm

When the difference actually is significant

Strategy A has an estimated edge of 5.05.0 bp with standard error 1.01.0 bp (zA=5.0z_A = 5.0, extremely significant). Strategy B has an estimated edge of 1.01.0 bp with standard error 1.01.0 bp (zB=1.0z_B = 1.0, not significant).

Test whether A's edge significantly exceeds B's, and explain why this case shows that you cannot skip the difference test even when it seems obvious.

Your answer

Solving needs a free account

Answers, streaks and solutions unlock when you are signed in. Reading the question and the hint stays free.

Discussion

Sign in to join the discussion · reading is open to everyone

💡 Discussion rules

  1. No full solutions here. Hints and approaches only.
  2. Complexity, edge cases and intuition are the point.
  3. Interview experiences are welcome. Respect your NDAs.

Loading discussion…

Learn the concepts

The theory behind this question.

Related questions

One significant, one not, so A beats B?A clears the bar, B just misses, are they different?What a p-value actually isReading significance straight off a confidence intervalWhen even the wide interval straddles zero
All questions →