Experiment Engine · 1:10
Plan a test: from playbook to launch
Pick a playbook, then walk the six steps of the test editor: setup, versions, audience, goal, schedule and review.
Chapters
Read the guide
Transcript
0:03 Pick a playbook
Select Create test, and start from a playbook. Each playbook says what to expect, and which goal it compares.
0:11 Setup
On Setup, name the test and write what you expect to happen. For a discount test, you also choose what gets the discount.
0:20 Versions
On Versions, set what each version changes, here a percent off. Traffic is split fifty fifty by default, and it must add up to one hundred percent.
0:31 Audience
Audience decides who joins the test: everyone, or only some shoppers.
0:37 Goal
Pick the main goal before you start: profit per visitor, revenue per visitor, conversion rate or average order value. Watch outs flag a version that does worse on another metric.
0:51 Schedule
On Schedule, choose when it starts and ends, and run whole weeks. The estimate shows how long a small change needs at your traffic.
1:00 Review and launch
On Review, every required check must pass, and then you select Launch test.
More video tutorials
Set up Experiment Engine: embed, tracking and costs
Walk through the Experiment Engine setup page: turn on the app embed, check tracking, add product costs and find your overview.
0:58
Offer tests: compare two offers
Set up an offer test to compare offers from Freebies Engine, or one offer against none, then read the result. Results shown with demo store data.
0:55
Price tests: try a different price
Set up a price test: pick products or collections, choose whether prices can only go lower, set the change, and read the result with demo data.
0:51