How to end theme test safely

After you stop the theme test, some customers might still see the test theme in their browser due to the browser cache.

Browser cache is a storage space on your device that stores website data to speed up browsing. It helps load frequently visited sites faster but can sometimes show outdated content if not cleared regularly.

However, by Shopify design, it will become preview mode if customers are not visiting the active theme. Visitors will see the preview bar at the bottom of the page and they have to click “Close preview” to go to your live theme, which may affect the shopping experience.

To address this issue, we've integrated a convenient script in the theme editor. In this article, we will guide you on how to use this script.

Configuration Steps

Stop the theme test.
Navigate to the theme editor of the test theme: Sales channels > Online Store > Themes > Test theme > Customize.

Navigate to the theme editor of the test theme: Sales channels > Online Store > Themes > Test theme > Customize.

Enable ABConvert clear cache script in the App embeds tab, and click the save button in the top-right corner.

Enable ABConvert clear cache script in the App embeds tab, and click the save button in the top-right corner.

Then it’s all set. Customers will only encounter the live theme and have a consistent browsing experience on your store.

How to view the specific theme while running theme test

Option 1: Use Shopify’s theme preview feature

You can view any unpublished theme directly from your Shopify admin using Shopify’s built-in Preview option in the theme editor.

Option 2: Use the `preview_theme_id` parameter

You can also load a specific theme directly from the storefront by adding a parameter to the URL.

In your Shopify admin, click Actions > Edit code on the theme you want to view.
Look at the URL in your browser. The theme_id is shown in the address bar (e.g., theme_id=14169323070).
Add ?preview_theme_id=<theme-id> to your store’s base URL.
For example: leo-test-store.myshopify.com?preview_theme_id=14169323070

Option 3: Use the `preview` parameter

Once the test is launched, you will be able to use the view parameter in the url to access each group directly.

For example, I would type these in the URL to test my variants:

www.myshopifystore?preview=0 -> Original theme
www.myshopifystore?preview=1 -> Variant theme 1

Group Index Reference

Group Index	Description
0	Original group
1	Variant 1
2	Variant 2
3	Variant 3
4	Variant 4

Why can't I run theme test with other tests at the same time

Reason: Compatibility issues

Theme tests split user traffic between your current live theme and the test theme to compare their performance. However, other tests are incompatible with the test theme, making it impossible to run them simultaneously with a theme test.

What if other tests are active

You won’t be able to proceed with creating a theme test. When choosing test types, you can see a “ongoing test” badge next to the theme test option.

How to test different Shopify discount in ABConvert

Shopify native discount types explained

Shopify native discounts have two method types. Only Discount code works with ABConvert.

❌ Automatic discounts (not supported)

Automatic discounts cannot be tested in ABConvert.

Reason:

Automatic discounts apply across the entire store
They are active for all themes and all visitors
ABConvert cannot split them by test group

Because of this, there is no way to isolate experience between variants.

✅ Discount codes (supported)

Discount codes can be tested in ABConvert.

Reason:

The discount is applied only when the shopper enters the code
You control how the code is displayed in each theme
Each test group can see a different code

This makes discount codes compatible with Theme Tests.

How to test Shopify discount codes

Step 1: Prepare two theme versions

Duplicate your current Shopify theme.
In Theme A, display discount code A.
- Example: “Use code SAVE10 at checkout”
In Theme B, display discount code B.
- Example: “Use code SAVE15 at checkout"

Step 2: Create a theme test

Click Create new test.
Choose Theme Test.
Assign:
- Theme A to control group
- Theme B to variant group
Configure traffic split and targeting.
Start the test

Visitors will now see different discount codes depending on their group.

Third-party discount apps

This guide only applies to Shopify native discounts.

If you are using a third-party discount app, behavior may vary depending on how the app applies discounts. Some apps inject discounts at checkout or via scripts, which may not be testable.

👉 If you are unsure, contact our support team before setting up the test.

How to test my cart drawer in ABConvert

ABConvert does not edit your cart drawer directly. Instead, you test cart drawers by comparing two Shopify themes, each with a different cart drawer setup.

Theme A uses cart drawer version A
Theme B uses cart drawer version B

ABConvert splits traffic between the two themes and tracks performance.

Steps to test cart drawer with theme test

Duplicate your theme in Online store > Themes
Edit the cart drawer in your duplicated theme (add free-gift blocks, adjust upsells, etc.)
Create a theme test in ABConvert
Split traffic between your current theme and the new cart drawer setup

Can I Edit My Theme During a Theme Test

Yes, you can!

If you’re running a Theme Test, you’re free to edit the theme just like you normally would inside Shopify. Any changes you make (e.g., layout tweaks, styling updates, content edits) will apply directly to the version being tested.

Will it affect my test

No — your test will continue to run as expected. ABConvert’s Theme Test simply directs visitors to different theme versions; it does not create copies or freeze versions. This means:

Changes you make are live immediately on that theme
There’s no need to pause or restart your test
The experience remains seamless for your visitors

Tip: If you make major structural changes—we recommend starting a new test. This helps separate your test data, as the testing environment is no longer consistent with the one you started with.