Skip to content
1 minute readNewAgent-ready

Know when an experiment can stop, and let traffic follow the winner

Experiments can now tell you when it is safe to stop, with a verdict that stays valid however often you check, and can shift traffic toward the arms most likely to win, with every change recorded.

Experiments now say when it is safe to stop and can move traffic to the likely winner.

  • Each experiment's results show whether you can stop now, should keep running, or have no winner yet. Checking every hour does not raise the chance of a false winner, which stays at 5% across all arms.
  • Opt an experiment in to bandit allocation and its weights move once a day toward the arms most likely to win. Every arm keeps a minimum share and control keeps a larger one, so a verdict against control stays possible.
  • Visitors keep the arm they already have; only new visitors see the new split.
  • Every weight change and every change to the opt-in is recorded with the weights before and after. Agents can read the verdict and the history with the get_experiment_stopping tool.