Experiment Design for Feature Launch

Medium

business-skills Netflix DoorDash Uber

You want to test whether a new recommendation algorithm increases average order value. The product team wants results within two weeks. What is the most important design consideration?

Multiple Choice

Run the test on 100% of users for one day to get fast results Conduct a power analysis to determine the minimum sample size needed to detect a meaningful effect within two weeks Use the smallest possible test group to minimize risk Launch the feature to everyone and compare this month to last month

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations

Experiment Design for Feature Launch

Multiple Choice

Related problems

Deep-dive guides