Experiment Engine
Pause, end a test and ship the winner
Pause a test, resume it, or end it and choose what shoppers see: a winning version, the original, or neither for now.
Pause and resume
Select Pause test on a test page. Shoppers see your original store for it. In the Tests list, choose Resume test from the row menu. To stop everything at once, use Pause all tests under Settings, Safety; Resume all tests reverses it. Only admins can.
End a test
- On the Results tab, select End test or the button in the verdict, such as Ship Version B or End test, keep original.
- Under What should shoppers see from now on? choose a version, The original, or Neither: pause the test and decide later.
- Optionally add a note about what you learned.
- Confirm with End test and show Version B, End test and keep the original or Pause the test.
- Ending early shows End this test now? and asks you to confirm that the result is not clear.
- A winning page or content version applies to everyone until you make it permanent in your theme. Then Stop serving it.
- A winning discount is created before the test ends; if Shopify refuses it, the test keeps running. Recreate it in Freebies Engine to make it permanent.
- A winning shipping rule applies to everyone. Set the same rule in your Shopify shipping rates, then stop serving it here.
- A winning theme is not served to everyone. The test ends, shoppers see your live theme again, and a card on the Results tab links to Online Store, Themes in Shopify admin, where you choose Publish on the winner.
- Only admins can end tests.