Skip to main content

A/B testing troubleshooting

Activation fails​

Check, in order:

  1. Every variant page is published (not just saved).
  2. The site is hosted on Atomicat's Bunny or AWS infrastructure.
  3. No other running test uses the same entry path on this site.
  4. Traffic weights add up to 100%.

I always see the same variant​

That is expected — assignment is sticky. Each visitor keeps their variant across visits. To see other variants, open the entry URL in a private window or a different browser. Do not judge the split from your own browser; check the visitor numbers in Analytics instead.

No visitors in Analytics​

  • Confirm the test status is running, not draft.
  • Visit the entry URL once and wait a few minutes — data is processed in near real time but not instantly.
  • Make sure you are looking at the right date range and experiment in the Analytics dropdown.

Conversions are zero​

  • URL visit (Atomicat page): open the test entry first, then go to thank-you in the same browser. Context is kept via cookie / same-site links. A cold visit to thank-you alone will not convert.
  • URL visit (External): the outbound link on the test page must contain the URL text you configured; Atomicat counts the click, not the external page view.
  • Click selector: the selector must match an element that exists on the variant pages. Redeploy after changing it.
  • Any button click: click a real button/link on the variant page.
  • Checkout click: the variant pages must have an Atomicat Checkout button (atomicat-checkout-button).

You cannot change the goal of a running test. Archive it and create a new test if the goal was wrong.

SRM warning (traffic health)​

An SRM warning means the real split does not match your weights. Typical causes:

  • The test was redeployed with new weights mid-run — old data uses old weights.
  • A variant page was deleted or unpublished, so its traffic falls through.
  • Edge routing is stale — click Redeploy on the test.

Variant shows old content​

If you edited and republished a variant page after activation, click Redeploy on the test to refresh the variant copies and edge routing. Redeploy does not unlock editing the goal or traffic split while the test is running.

Decision still says Collecting data after I declared a winner​

Refresh the Analytics app (or pick the experiment again). After a winner is declared, Decision should show Winner / Not selected, and the platform test card should show a Winner badge. If you only archived without declaring a winner, statistical badges (including Collecting data) remain.

Frequently asked questions​

Does my ad blocker affect the test?

Routing works regardless of ad blockers, but tracking can be blocked, which lowers reported visitors and conversions. Real visitors' numbers are still directionally correct.

Why did my page stop splitting traffic?

The test was archived, a winner was declared, or routing was redeployed by another action. Check the test status in the platform.

Where do I get more help?

Start with the general Analytics troubleshooting guide, then contact support with the test name and entry URL.