This guide shows you how to set cost, shipping, and profit inputs so your profit metrics are accurate.
When to use this
Use this guide when you want to:
Compare profit instead of revenue between test groups
Adjust shipping or product cost assumptions after a test starts
Run tests where Shopify COGs are missing or not applicable
Apply different cost structures across test groups
Links for each type of test
Price test
⚠️ You will need to know which price test method you are using before reading the following sections: How to know my current price testing method?
Duplicate product method
The product cost in price tests is pulled automatically from Shopify COGs, but you can still update it afterwards by the following steps:
Go to your analytics page
Scroll down to Breakdown table
Click Add cost
In the popup modal, enter:
Ad spend (split evenly across test groups)
Shipping cost per order
Product cost for each tested product
Duplicate variant method
Storewide data
If you are checking the analytics in Storewide data (the third dropdown next to All visitors), you can follow these steps:
Click Set cost (next to Get preview url)
Choose one option in Set shipping cost and profit margin popup:
Set same shipping cost and profit for each group
Set different shipping cost and profit for each group
Enter:
Shipping cost per order
Profit margin percentage
Click Apply
Product view data
If you are checking the analytics in Product view data (the third dropdown next to All visitors), you can follow these steps:
Scroll down to Breakdown table
Click Add cost
In the popup modal, enter:
Ad spend (split evenly across test groups)
Shipping cost per order
Product cost for each tested product
Cart transform method
Product cost in the cart transform method IS NOT synced automatically from Shopify COGS, but you can update it manually by following these steps:
Go to your analytics page
Switch the analytics to Product view data (the third dropdown next to All visitors)
Scroll down to Breakdown table
Click Add cost
In the popup modal, enter:
Ad spend (split evenly across test groups)
Shipping cost per order
Product cost for each tested product
PDP content test
Product cost is not pulled from Shopify COGs for PDP content tests. You must add it manually by following the steps below:
Go to your analytics page
Scroll down to Breakdown table
Click Add cost
In the popup modal, enter:
Ad spend (split evenly across test groups)
Shipping cost per order
Product cost for each tested product
Shipping test
Follow these steps to calculate profit metrics when you are running a shipping test:
Go to your analytics page
Click Set cost (next to Summary)
Choose one option in Set shipping cost and profit margin popup:
Set same shipping cost and profit for each group
Set different shipping cost and profit for each group
Enter:
Shipping cost per order
Profit margin percentage
Click Apply
Url redirect test
Follow these steps to calculate profit metrics when you are running a url redirect test:
Go to your analytics page
Click Set cost (next to Summary)
Choose one option in Set shipping cost and profit margin popup:
Set same shipping cost and profit for each group
Set different shipping cost and profit for each group
Enter:
Shipping cost per order
Profit margin percentage
Click Apply
Template test
Follow these steps to calculate profit metrics when you are running a template test:
Go to your analytics page
Go to Average metrics
Enter in the input fields below:
Shipping cost per order
Profit margin percentage
Click Save
Theme test
Follow these steps to calculate profit metrics when you are running a theme test:
Go to your analytics page
Go to Average metrics
Enter in the input fields below:
Shipping cost per order
Profit margin percentage
Click Save
Checkout test
Follow these steps to calculate profit metrics when you are running a delivery customization test/payment customization test/checkout ui test:
Go to your analytics page
Click Set cost (next to Summary)
Choose one option in Set shipping cost and profit margin popup:
Set same shipping cost and profit for each group
Set different shipping cost and profit for each group
Enter:
Shipping cost per order
Profit margin percentage
Click Apply
