Previously, all groups in the Advanced Shipping Test were required to use a rate generated by ABConvert’s carrier rate. This meant that even the control group had to apply a test rate, making it difficult to compare against the store’s default settings.

• The control group can now retain the store’s original shipping settings instead of applying a test-generated rate.

• This allows users to accurately compare the effects of adding a new rate vs. keeping existing rates unchanged.

• Before this update, even the control group had to apply an ABConvert test rate.

• Now, the control group can remain unchanged, and only the test groups will apply the experimental rates.

• This provides a true A/B testing experience, making it easier to measure the impact of adding a new rate versus making no changes.

Previously, the Shipping Test only tracked orders that used an ABConvert-generated carrier rate. Orders that selected other shipping methods were not included in the test data.

• We now collect all orders from the online store, regardless of whether they used a test-generated shipping rate or not.

Example of Previous Behavior:

• If a customer checked out using a non-test rate (e.g., free shipping or a manual shipping rate), their order was not included in the test results.

• Now, all orders placed during the test period are tracked. This allows merchants to see the full impact of the test on overall order volume and conversion rates.

• Users get a more complete picture of order trends during a test period.

• Helps identify if adding a new shipping rate affects storewide order behavior beyond just the customers who selected the test-generated rate.

You can now select a winning group in your price test and automatically update the product prices.

The chosen group’s Price and Compare at Price will be applied directly to your existing products, making it easier to implement successful pricing strategies.

If the test is active, we will stop your test first then update the price for you.

We’ve added three new templates for more diverse testing options:

We’ve introduced a comprehensive filtering feature for all tests. Now, you can filter analytics data based on the following criteria:

These filters provide granular control over your test analytics for more precise insights.

You can now select a as the goal for your experiments during test setup. This metric will also be prominently displayed in the analytics dashboard, making it easier to track your experiment’s success.

To help you design more accurate tests, we’ve added a dedicated section to define your test hypothesis. Following the recommended structure will significantly improve the quality and reliability of your test results.

To ensure the accuracy of shipping tests, we’ve added a step requiring users to during the setup. If no rates are available for deletion, users must confirm by selecting “Do not delete any rates.”

The default data source of the price test has been changed to "Product View" to support the common use case.

The visitor-based data has been removed. From this update, newly created tests will be able to see the storewide data.

Storewide data will display all the events happening in the whole store by test group.

When the shipping script is enabled, chances are that the line item key will be different than Upcart config stored in the browser result in the item can not be updated.

We've added a logic to auto-update Upcart line item key in our script to address this issue.