Who is in the test
Triggered enrollment, dilution and randomizing whole groups.
Lesson 19 of 32~19 min of learningIncludes ~12 min for questions and tasks
Contents1 of 33 steps
Maya
Alex Tutor
You
Alex Tutor
Alex Tutor
Question 1
The spring test split all 34,000 weekly active users. 5,100 of them added a repeat bill and could see the suggestion; among them it raised recurring set-ups by +3 pp. Nobody else was affected. What is the effect across all users in the test, in percentage points?
Units: pp
Alex Tutor
Theo
Alex Tutor
You
Alex Tutor
paywall_viewed, not at trial_started.Alex Tutor
Question 2
Which enrollment trigger is right for a rerun of the “Make it recurring?” test?
Maya
Alex Tutor
You
Alex Tutor
Alex Tutor
Question 3
Which Halves changes should be randomized by whole group rather than by user? Select all that apply.
Alex Tutor
Alex Tutor
You
Alex Tutor
Alex Tutor
Question 4
A user-level test would need 6,735 users per variant. The group plan is randomized by group: average size m = 3, ICC = 0.15. How many users per variant does it need? Round up.
Units: users per variant
Alex Tutor
Maya
Alex Tutor
You
Alex Tutor
Question 5
In a test randomized by group, you can analyze users as if each was randomized alone: 8,756 users give the same precision either way.
Theo
Alex Tutor
You
Alex Tutor
Question 6Short answer · AI-checked task
Plan who is in Theo's test in 3–5 sentences: the enrollment trigger, the unit of randomization and why, and what that choice means for the size of the test and its analysis.
Write your answer and get a score with feedback from our AI reviewer.
Log in to get AI feedbackAlex Tutor
That’s the lesson. You answered every task — nicely done.