2 minute readNewAgent-ready
Price experiments with up to ten arms
An experiment can now test up to ten prices at once instead of two, and its results compare every arm with your control, raising the bar as you add arms so more arms do not mean more false winners.
Experiments are no longer limited to a control and one challenger.
- Up to ten arms. Keep one arm named
controlfor your current price and give the others any name you like, such asmidorannual_discount. - Your split, exactly. Set each arm's share of traffic as a whole percentage, with the shares adding up to 100, or leave them out for an even split. The same visitor always sees the same arm.
- Every arm against control. Results show each arm's chance of converting better than control, its lift and a verdict of Better, Worse or Keep testing. With more arms the bar goes up (98.75% with four challengers instead of 95%), so testing more prices does not hand you more lucky winners.
- Add and remove arms in the dashboard. Create Experiment now has Add variant and Split evenly, and it tells you before you save when the shares do not add up to 100.
For agents and developers: the create request takes from two to ten variants, the pricing response names whichever arm the visitor got, and the results response adds a comparison field. Two-arm experiments work exactly as before: the same requests are accepted, every visitor keeps their arm, and the results response only gains the new field.
Questions? Write to support@last-price.ai.