Experiment Engine
Test will not launch or results look wrong
Fix launch checks that block a test, and the reasons results say we cannot trust the numbers: embed, pixel, visitors and traffic split.
Launch is blocked
The launch sheet lists what needs attention, each with a fix button.
| Message | What to do |
|---|---|
| The app embed is off. | Turn it on. |
| Tracking pixel is disconnected. | Fix tracking. |
| Your store has a password. Remove it to run a test. | Open the store, or remove the password. |
| You've reached your plan's limit of running tests. | Pause a test or change plan. |
| Profit needs product costs for at least 80% of sales. | Add costs, or choose another goal. |
| You haven't previewed every version. | Preview test. |
| Pause all tests is on. | Resume all tests. |
| Another test affects the same shoppers. | Run one at a time, or launch anyway. |
| A version's template isn't in your live theme. | Add it in the theme editor, or choose another. |
| A tested theme was published, deleted, or has the app embed off. | Choose another unpublished theme, or turn the embed on in the theme editor under App embeds. |
| This test has too many changes to publish. | Remove some changes or split it into two tests. |
Results say we cannot trust the numbers
- The app embed is off, or the tracking pixel is disconnected: fix it with the button in the verdict.
- No visitors have been counted for several hours: check that your storefront loads.
- The traffic split is far from what you set: see Guardrails, watch-outs and traffic split.
Results refresh about every hour, and orders can take up to an hour to appear.