Skip to main content

[Beta version] How to create a test

Leo avatar
Written by Leo
Updated this week

Step-by-step guide to creating price tests, URL redirect tests, theme tests, template tests, shipping tests, and visual editor tests using the new 4-step wizard.

The new 4-step wizard

All beta version tests follow a unified creation workflow:

Step 1: Base info - Name, hypothesis, success metric, test groups

Step 2: Audience - Traffic allocation, audience targeting, force assign rules

Step 3: Variant configuration - Test-specific settings (prices, URLs, themes, etc.)

Step 4: Review - Preview, QA, and launch
​

This consistent structure makes it easier to create and manage tests across different types.

Step 1-1: Base information setup

Start by defining the foundation of your test:

  1. Create a beta version test: Click the Create Test button in your ABConvert dashboard

  2. Enter test name: Give your test a descriptive name (e.g., "Summer Sale Pricing Test")

  3. Add description (optional): Briefly describe what you're testing for future reference

  4. Select primary metric: Choose how you want to measure success:

    1. Revenue per visitor: Measures total revenue generated per visitor

    2. Average order value: Tracks the average amount customers spend per order

    3. Conversion rate: Measures the percentage of visitors who make a purchase

βœ… Important: The primary metric determines how ABConvert calculates the winning variation. All other metrics are still tracked for your analysis.

Step 1-2: Configure test groups

Next, decide how visitors will be split between variations:

  1. Review the traffic split: By default, visitors are split equally between Control and Variant A (50%/50%)

  2. Add more variants (optional): Click "+ Add group" to test additional price points

  3. Adjust split percentages; Use the Split equally button or manually adjust percentages

  4. Name your variants (optional): Click the edit icon to rename groups (e.g., "20% Discount", "Premium Pricing")

βœ… Best practice: Start with a simple 2-way test (Control vs. Variant A) before testing multiple variations to ensure statistical significance.

Step 2: Audience targeting

Define who will see your test using traffic allocation, audience filters, and targeting rules.

You can control:

  • Which visitors enter the test

  • How traffic is distributed

  • Whether specific users are force-assigned to a variation

Learn more about audience targeting and how to set up filters in πŸ‘‰ [Beta Version] How ABConvert splits traffic

Step 3: Variant configuration

Each test type has its own configuration, please refer to the test type you're creating now:

1. Price test

Select products

Choose which products to include in your price test:

  1. Search products: Use the search bar to find specific products

  2. Apply filters - Filter by:

    • Product type: Category or collection

    • Collection: Specific product collections

    • Tagged with: Products with specific tags

    • Vendor: Products from specific vendors

  3. Sort options: Organize by product title, creation date, inventory, etc.

  4. Select products: Check the boxes next to products you want to test

  5. Review selection: Monitor your selected count (up to 100 products maximum)

βœ… Selection tips:

  • Use Select all on this page for bulk selection

  • Products show current price, stock status, and variant count

  • Only active products can be selected for testing

Price configuration

Set different prices for each test group.

Target market(s)

Add Additional Markets (optional): Click "+ Add market" for multi-currency testing

Variant pricing table

The pricing interface shows:

  • Original Column: Current product prices (⚠️ These cannot be edited)

  • Variant Columns: Your test prices for each group

Set prices

  1. Manual Entry: Click in any variant column cell to enter a new price

  2. Quick Fill: Use the Quick fill button to apply bulk price changes

  3. Copy/Paste: Copy prices from Excel or other sources in table format

βœ… Pricing strategies to test:

  • Discount testing: Compare 10%, 20%, 30% discounts

  • Premium pricing: Test higher prices to maximize revenue

  • Psychological pricing: Test $9.99 vs $10.00 pricing

  • Competitive pricing: Test prices based on competitor analysis

2. Shipping test

Shipping zones and rates

Select one or more shipping zone(s) you want to test.

Configure variant shipping rates

Configure variant setting (control group will be your original setting), you can edit / delete / add shipping rate for each zone.

  1. Delete rate: Delete the rate for variant group

  2. Edit rate: Edit the name, description or price for the rate
    ​

  3. Add rate: Add a new rate for variant group
    ​

3. URL redirect test

Set trigger URL

Enter the source URL that triggers the test:

  • Supports exact match or pattern matching

  • Example: '/' (homepage), '/collections/sale', '/products/'

Set destination URLs

For each group, enter the destination URL. ABConvert automatically checks that destination URLs are valid and accessible.

  • Control group: keeps the original trigger URL

  • Variant (s): enter the redirect destination

URL matching options

  • Exact match: Only trigger on exact URL

  • Contains: Trigger if URL contains pattern

  • Starts with: Trigger if URL starts with pattern

  • Regex: Advanced pattern matching

4. Template test

  1. Select control template and variant template(s): Choose from your existing templates or create a duplicate from the control
    ​

  2. Click Compare variants to compare between groups
    ​

  3. Advanced settings (optional): If you only want to run the template test on specific pages instead of on all pages using this template, you can set up advanced setting as following:
    ​

5. Theme test

  1. Select variant theme(s): Choose from your existing draft themes or create a duplicate from the control theme
    ​

  2. Click Compare variants to compare between groups
    ​

6. Visual editor test

In step 3, click the Edit button with the pencil icon to open the editor.

The top bar

At the top of the editor, you will see several controls. From left to right:

  1. Variant switcher: Switch between the Control and different variant groups

  2. URL bar: Type a URL to navigate to another page within your store

  3. Select element button: Turn this on to activate Select mode

    • When enabled, you can click elements and edit them

    • When disabled, you can browse your store normally

  4. Device switcher: Preview your store on desktop, tablet, or mobile screen sizes

  5. Save button: Click Save to keep your changes

Edit elements in select mode

When Select mode is active:

  • Move your cursor over the page

  • Elements will be outlined as you hover

  • Click an element to select it

After selecting an element, right-click to see editing options:

  • Edit: Depending on the element type, you can:

    • Edit text: Update the text in the input field, then click Save

    • Change link: Enter a new URL for buttons or linked text

    • Change image: Choose an image from your library, upload a new one, or paste an image URL

  • Move up or move down

    • Reorder the element within the same hierarchy level

    • For example, move a product card to the first position in a grid

    • ⚠️ Note: You can only reorder elements within the same parent container

  • Hide element

    • Hide the selected element from the page without deleting it in Shopify

  • Select parent

    • Quickly jump to the parent container if you need to edit a larger section

The right-side panel

When an element is selected, the right panel gives you more controls.

  • Properties:

    • View the element tree structure

    • Note: You can see up to three levels above the selected element

  • Edit options: You will see the same editing options here, this is useful if you prefer using the side panel instead of right-clicking

    • Edit text

    • Change link

    • Change image

  • Custom code

    • Click Add code to insert:

      • CSS

      • JavaScript

    • This applies at the site level, not just one page. Use this for advanced customizations

  • Changes

    • This section shows all edits made in each variant group

    • Click the trash icon to remove a specific change

Step 4: Review test configuration

Review your test configuration before launching:

Test hypothesis

Write a clear hypothesis explaining:

  • What price change you're testing

  • What outcome you expect

  • Why you expect this result

Example: "I believe reducing the price by 15% will increase conversion rate by 25% because our current pricing is above the market average for this product category."

Visitor flow

Review how visitors enter your store, pass through the script, and are assigned to test groups.

Configuration summary

Your test configuration summary, so you can confirm that all settings are set up correctly. Once everything looks good, you are ready to launch your test! πŸš€

Did this answer your question?