Shipping test is a really important test of our A/B testing suite. Many users benefit from the shipping test since shipping rate is the determining factor of whether a customer complete a checkout or not.
After launching our first version of shipping test, we've received feedback from our beloved users that they want to test with more advanced set up.
Hence, we launched a new version of shipping test that can set up shipping rates just like how to do on your Shopify backend.
This article will guide you on how to start a successful advanced shipping test.
Prerequisite
Enable Carrier Service API
Familiar with our shipping test
Finished reading Get started with Shipping Tests
Step 1 - Create test
Navigate to "Create New Test" tab, and select Shipping test. Click "Create Shipping Test" to enter create new shipping test page.
Step 2 - Fill in test information
Fill in test name, description, and set up different test groups.
Currently, we allow users to set up up to 5 test groups. In each test groups, you can assign different rates.
Step 3 - Select Shipping Test Type
Click "Advanced Shipping" in Shipping Test Type.
Once you select 'Advanced Shipping,' you will notice changes in the shipping rate settings displayed below.
You can click "Add rate" button in each group to add your shipping rate.
Step 4 - Add rate(s)
You can add shipping rate just like how you add rate in Shopify backend.
There are different settings you can change:
*Rate name: The shipping method display name
Rate description: The description of shipping method
*Price: The shipping price
Condition: rules to display shipping rate. Either based on order price or order items weight. For more reading about condition pricing: https://help.shopify.com/en/manual/shipping/understanding-shipping/shipping-rates
Transit time: the delivery days that show on the shipping rate
* means the required input field.
Once you filled in any input field, you can see the change in the "CHECKOUT EXAMPLE"
This is what will be shown in the checkout when the rates is displayed.
You can click "Done" if all the required field is filled. And the rate will be added to the test group.
In this way, you can set up many rates in many test groups.
If there are different price of the same shipping method (same rate name), our app will return the cheapest one that meets the condition.
And if there are different shipping methods with the same price, our app will only return one shipping method.
Step 5 - Select Shipping Zone(s)
After you set up your shipping rate(s), you can select which zone(s) you want to test on.
Our shipping test will only run on the zone you selected, and if you only want to display our shipping rate, please remove the origin rate in your selected zone.
Step 6 - Final Review
Before you launch the test, do a final review of everything and ensure that you enable our shipping script.
Currently, we don't support Shipping Banner for the Advanced Shipping Test. If you want to replace some text in your website, feel free to reach out via [email protected] or the support widget.
We are currently collect the use case and launch find and replace tool.
Click "Launch Test", your test will start immediately.
Preview the test
Once you launched the test, you will be directed to the "Dashboard" page, and your test will be showing with the "Active" status.
Click the link in the test name to enter the "Analytics" page.
And click "Summary" button on the top right, you will find the preview link.
Copy the preview link in your incognito browser to make sure you can see each group.
Then we are set, give the test some time and we can review the result later.
Conclusion
This article explains how you can set up the "Advanced Shipping Test". With this feature, you are able to test with more complex shipping rate setup and optimize your profit.
If you have any feedbacks or feature request, feel free to reach out to us via [email protected] or the support widget.
Happy testing 🎉