The best A/B testing tool for your Shopify store depends on what you need to test. Shopify Rollouts, built into the admin, covers whole-theme, checkout and discount tests. Intelligems fits stores testing prices, shipping and offers on profit. Shoplift and Elevate are Shopify apps for theme and template tests, with price tests on higher plans. Convert, Wingify (formerly VWO and AB Tasty) and Optimizely suit teams that want more control over statistics and code.
DTC Pages is an Intelligems agency partner. No company paid to be included or reviewed in this guide.
How do the Shopify A/B testing tools compare?#
The tools differ most in what they can test: Intelligems, Elevate, Shoplift and Convert document product price tests, Shopify Rollouts can test a whole catalog's prices, and only Shopify Rollouts, Intelligems and Elevate can test the checkout. The order below is not a ranking. Every tool fact comes from the vendor's own pages, linked in its section, as of November 2026.
| Tool | Best for | Starting price | Shopify App Store rating (reviews) |
|---|---|---|---|
| Shopify Rollouts | Whole-theme, checkout, discount and catalog tests | Built into the admin | Not an app |
| Intelligems | Profit-based price, shipping and offer tests | $69/month | 4.8 (204) |
| Shoplift | Theme and template tests on Plus | $99/month | 4.8 (135) |
| Elevate | Low-cost price, shipping and checkout tests | $49/month | 4.9 (147) |
| Convert | Choosing statistics models and coding variants | $299/month billed annually | No reviews yet |
| Wingify (formerly VWO and AB Tasty) | Testing and behavior analytics, one vendor | Custom quote | No reviews yet |
| Optimizely | Enterprise programs with developers | Custom quote | No experimentation app |
Starting prices are each tool's entry plan. Price, shipping and checkout tests can need a higher plan or an add-on, as each section explains.
What can each tool test?#
Every tool here covers content tests. Prices, shipping and checkout are where they differ.
| Tool | Prices | Shipping | Checkout |
|---|---|---|---|
| Shopify Rollouts | Whole catalog | No | Checkout configuration |
| Intelligems | Yes | Shopify Advanced or Plus | Shopify Plus only |
| Shoplift | Shoplift Advanced and Pro plans | Through its JS API | No |
| Elevate | Standard and Premium plans | Standard and up, with carrier-calculated rates | Standard and up, on Shopify Plus |
| Convert | Yes, reaching checkout only on Shopify Plus | Shopify Plus only | No |
| Wingify (formerly VWO and AB Tasty) | Coming soon | No | No |
| Optimizely | No | No | No |
Is Shopify Rollouts good enough for A/B testing?#
Shopify Rollouts is good enough for testing one whole theme, checkout configuration or discount setup against another, with no app to install. This section is based on Shopify's documentation.
- What it is. A native feature in Markets > Rollouts in the Shopify admin that schedules launches and runs experiments.
- What you can test. One change to your main theme, which either edits or replaces the theme, one change to your checkout and accounts configuration, discounts and catalogs. Setting a catalog to Active publishes its prices and product availability. Discounts were added on October 2, 2026. You can't change Liquid templates in a rollout or use vintage themes.
- How it measures results. Theme experiments report conversion rate, bounce rate, add to cart rate and reached checkout rate, and checkout experiments report checkout conversion rate, with an experiment significance test. Shopify doesn't document the statistical method.
- Page speed and flicker. Each visitor is put in a group before the page loads, so the page doesn't flicker between versions.
- Pricing and plan. Rollouts are available on the Basic plan or higher, and Experiments on Grow or higher. Market-specific targeting needs Advanced or Plus. Shopify lists no separate fee.
- Limits. Two versions per experiment. Experiments can be mutually exclusive: when rollouts conflict, Shopify splits traffic between them.
Who should use Intelligems?#
Intelligems is best for stores that want to test prices, shipping and offers, not only page content, and read the result on profit. DTC Pages runs most of its experiments on Intelligems today.
- What it is. A Shopify A/B testing app for prices, discounts, content and shipping.
- What you can test. Per its pricing page: content, themes and templates, product and subscription prices, shipping rates and free-shipping thresholds, discounts and offers, checkout blocks and post-purchase offers.
- How it measures results. A Bayesian model with Monte Carlo simulations, reporting the probability that a variant beats the control. Metrics include revenue per visitor, average order value and gross profit per visitor.
- Page speed and flicker. The script loads asynchronously and is non-blocking by design. Split URL and template tests can briefly flash the original content, and adding
blocking="render"removes that at the cost of slower first paint. - Pricing. $69/month at the lowest order tier is the entry price for content tests: every plan starts with Smart Content, and the Pricing, Shipping and Checkout modules are added on top, or all come together in the Unlimited plan. Plans scale with order volume, and Intelligems' Smart Pricing module has a 3-month minimum. The 14-day trial covers every module except that module. Rated 4.8 from 204 reviews.
- Shopify plan. Works on every plan. Checkout tests need Shopify Plus, and shipping rate tests need Advanced or Plus because they use Shopify's carrier rate API.
- Limits. It recommends 300+ orders per test group and 7+ days before reading a result.
We wrote a guide for Intelligems' blog on how to A/B test your Shopify checkout, based on 89 checkout tests.
Who should use Shoplift?#
Shoplift is best for Shopify Plus teams that mainly test themes, templates and pages in a visual, Shopify-native workflow. This section is based on Shoplift's documentation.
- What it is. Its listing calls it a CRO platform for Shopify Plus.
- What you can test. Template, theme and split URL tests on every plan, per its pricing page. Price tests need the Advanced or Pro plan, and shipping can be tested through its JavaScript API, which its shipping threshold guide calls very technical: you set up a shipping method per variant and a custom Shopify Function or theme logic that applies the right one. It doesn't support testing Shopify's checkout.
- How it measures results. Bayesian predictive analysis, with a probability to win and an estimated revenue lift.
- Page speed and flicker. It cites a built-in anti-flicker system and about a 2 to 4 point reduction in page speed on Google's page performance tool.
- Pricing. Core from $99/month, based on monthly unique visitors, with a 14-day free trial. Rated 4.8 from 135 reviews.
- Shopify plan. Positioned for Shopify Plus. Its docs don't state a minimum plan.
- Limits. No headless storefronts. Most tests need at least 10,000 visitors per variant and 14 days, it says. Price tests don't support multi-currency setups such as Shopify Markets.
Who should use Elevate?#
Elevate is best for stores that want price, shipping and checkout testing at a lower starting price than most dedicated apps. This section is based on Elevate's documentation and App Store listing.
- What it is. A Shopify A/B testing app for themes, content, prices and shipping.
- What you can test. Basic covers template, theme, split URL and content tests. Standard adds price, shipping, product image and checkout tests. Premium adds multi-currency price testing.
- How it measures results. A Bayesian stats engine with real-time stats and confidence scoring.
- Page speed and flicker. Elevate doesn't hide your page while a variation loads. Its script is render-blocking on purpose to avoid flicker, with a 1 to 2 point impact on page speed scores.
- Pricing. Basic $49/month, Standard $99/month, Premium $499/month, scaling with order volume, with a 14-day free trial. Rated 4.9 from 147 reviews.
- Shopify plan. Checkout experiments need Shopify Plus. Shipping experiments need carrier-calculated rates (Advanced, Plus or an add-on).
- Limits. Up to five variations including the control. Price tests need Standard or Premium.
Who should use Convert?#
Convert is best for teams that want to choose their statistics model and write their own variant code. Convert was our main testing tool for several years.
- What it is. A general A/B testing platform with a Shopify app.
- What you can test. Themes, pages and content, with a visual editor and code editing. Prices with Pricing Rules on product, collection and search pages, on all plans. The tested price carries into checkout only on Shopify Plus. On Plus, Shipping Rules test shipping options by hiding a rate you already set up in Shopify. A/B testing inside the checkout is unavailable due to Shopify's Checkout Extensibility.
- How it measures results. Frequentist, Bayesian and sequential models. Metrics include conversion rate, revenue per visitor and average products per visitor.
- Page speed and flicker. The snippet is about 60 KB gzipped before any experiments. The default synchronous load applies variations before render and stops flicker, but can cost Core Web Vitals. Asynchronous loading accepts some flicker risk.
- Pricing. Growth is $299/month billed annually or $399 billed monthly, with 100,000 monthly tested users and a 15-day free trial.
- Shopify plan. All Shopify plans, but the app only works with Online Store 2.0 themes.
- Limits. Price and shipping tests that reach checkout need Shopify Plus, and Shipping Rules can't create or change rates.
What happened to VWO, and who should use Wingify?#
VWO and AB Tasty are now one company called Wingify, whose platform is best for teams that want testing and behavior analytics from one vendor. VWO announced its combination with AB Tasty on January 20, 2026, backed by Everstone, and the combined company introduced the Wingify brand in September 2026. We still work in VWO when a brand already uses it.
- What it is. An AI-powered platform for digital experience optimization, with a Shopify app listed as Wingify (formerly VWO & AB Tasty).
- What you can test. Pages and content, and theme tests on draft or unpublished themes. Price testing is listed as coming soon. Its code is not placed on checkout, post-purchase and order status pages.
- How it measures results. Bayesian by default, with a frequentist option, and sequential or fixed-horizon approaches. Reports include conversion rate, revenue per visitor and average order value.
- Page speed and flicker. The code loads asynchronously. For visual-editor changes, Wingify hides the changed elements until the variation loads.
- Pricing. No published prices: a custom proposal, with a 30-day free trial. The Shopify integration starts on Wingify's Growth plan.
- Shopify plan. No requirement stated.
- Limits. No checkout testing, and price tests aren't live yet.
When does Optimizely make sense for a Shopify store?#
Optimizely makes sense for enterprise teams with developers who want its sequential statistics and can install a code snippet by hand. This section is based on Optimizely's documentation.
- What it is. Web Experimentation for testing digital experiences on the front end.
- What you can test. Pages and content. You paste the snippet into theme.liquid, and it loads on every page except checkout and thank-you pages. Checkout events can be tracked as metrics through a custom pixel, not tested.
- How it measures results. Its Stats Engine runs sequential testing with false discovery rate control. Fixed-horizon frequentist and Bayesian methods are also offered.
- Page speed and flicker. Optimizely recommends loading the snippet synchronously, which helps prevent flickering. Asynchronous loading is an option, but it greatly increases the chance of flicker.
- Pricing. A custom quote, with no public plans.
- Shopify plan. None stated.
- Limits. No checkout testing on Shopify, and installation is manual.
How do you choose an A/B testing tool?#
Choose by what you need to test first, then check your traffic, the metrics the tool reports, page speed, budget and your Shopify plan.
- What you need to test. Every tool here covers content tests. For prices, shipping and checkout, the What can each tool test? table shows which tools can test each, and on which plans.
- Your traffic. Our rule of thumb is about 100K sessions a month on the pages you test for statistically robust experiments, and most of our tests run 2 to 4 weeks. Our statistical significance calculator shows what your sample can detect.
- The metrics it reports. Conversion rate alone can reward a discount that loses money. Revenue per visitor is the minimum, and profit per visitor matters for price, shipping and offer tests.
- Page speed. Read how the script loads, then measure your pages with and without it.
- Budget. From nothing beyond your Shopify plan to custom enterprise quotes. Most apps scale with orders or visitors.
- Your Shopify plan. Rollouts experiments need Grow, Intelligems and Elevate shipping tests need carrier-calculated rates, Convert's need Plus, and third-party checkout tests need Plus.
Is Shopify Rollouts enough, or do you need a dedicated tool?#
Shopify Rollouts is enough when your test is one whole theme, checkout configuration, discount or catalog against another.
A dedicated tool adds what Rollouts doesn't document today:
- Smaller tests. Rollouts can edit your main theme, not only replace it, but it compares two versions and can't change Liquid templates. Dedicated apps test single templates and page elements, and Elevate allows up to five variations.
- Product-level price and shipping tests. Rollouts changes prices by activating a catalog, which can set fixed prices for individual products. Intelligems, Elevate, Shoplift and Convert document price tests on individual products. Shopify also has Smart Pricing, a native A/B test of individual product prices that is in early access for select stores as of November 2026, on the Grow plan or higher for US stores selling to US customers. Intelligems and Elevate document shipping tests, Shoplift supports them through its JavaScript API with a developer-built checkout setup, and Convert supports them on Shopify Plus.
- Revenue and profit metrics. Intelligems reports revenue and gross profit per visitor, and Convert and Wingify report revenue per visitor. Rollouts' documented experiment metrics are rates.
- A documented statistics method. Every dedicated tool here names its method. Shopify mentions a significance test without describing it.
Why does the tool matter less than what you test?#
The tool matters less than what you test because most experiments don't win on any platform. Across 1,379 A/B tests we ran on more than 40 Shopify stores between 2021 and 2026, 37.9% produced a winner. Most of a program's result comes from the quality of its hypotheses and the volume of good tests it runs, not from the software.
A tool doesn't tell you what to test. That comes from research on your own store, which is what a CRO audit is for, and from a steady pipeline of experiments, which our A/B testing service runs on Shopify. If you want a team to run the whole program, see what we do as a Shopify CRO agency.
How did we choose these tools?#
We chose tools that Shopify brands commonly use for A/B testing, plus Shopify's native option. Every fact comes from the vendor's site, documentation or Shopify App Store listing, checked in November 2026, and we left out anything we couldn't verify there. We compared each tool on what it can test, how it measures results, page speed and flicker, pricing, plan requirements and documented limits. Where a section is based only on the vendor's documentation, it says so.
Related Posts
Frequently Asked Questions#
Is Shopify Rollouts free?#
Shopify doesn't list a separate fee for Rollouts. It's part of the Shopify admin, under Markets > Rollouts. As of November 2026, scheduled rollouts are available on the Basic plan or higher, experiments need the Grow plan or higher, and market-specific targeting needs Advanced or Plus.
Can I A/B test prices on Shopify?#
Yes. As of November 2026, Intelligems tests product and subscription prices on any Shopify plan, Elevate from its Standard plan, and Shoplift on its Advanced and Pro plans. Convert tests prices with Pricing Rules on any plan, carried into checkout only on Shopify Plus. Shopify Rollouts can test a whole catalog's prices. Shopify's Smart Pricing tests individual product prices, in early access for select US stores on Grow or higher. Wingify lists price testing as coming soon.
How much traffic do I need to A/B test?#
Our rule of thumb is about 100K sessions a month on the pages you test for statistically robust experiments, and most of our tests run 2 to 4 weeks. Vendors set their own minimums: Intelligems recommends 300+ orders per test group and 7+ days, and Shoplift says most tests need at least 10,000 visitors per variant and 14 days.
Does A/B testing slow down my store?#
It can, depending on how the tool loads. Shoplift reports about a 2 to 4 point reduction in Google's page speed measurement and Elevate a 1 to 2 point impact. Intelligems loads asynchronously, with an optional setting that removes flicker but slows first paint. Optimizely recommends a synchronous snippet. Shopify Rollouts assigns visitors before the page loads.
Can I A/B test the Shopify checkout?#
Yes, with some tools. Shopify Rollouts tests checkout configurations on the Grow plan or higher. Intelligems and Elevate run checkout tests on Shopify Plus. Shoplift, Convert, Wingify and Optimizely don't support testing inside the checkout, as of November 2026. We wrote a guide on testing the Shopify checkout for Intelligems' blog.
Which A/B testing tool do CRO agencies use?#
It varies by agency and by what each brand already pays for. At DTC Pages we run most of our experiments on Intelligems today. Convert was our main testing tool for several years, and we also work with VWO, now Wingify, and custom-built setups when a brand needs them.
What happened to VWO and AB Tasty?#
VWO announced its combination with AB Tasty on January 20, 2026, backed by Everstone. In September 2026 the combined company introduced the Wingify brand, which brings VWO and AB Tasty together as one company. vwo.com now redirects to wingify.com, and the Shopify app is listed as Wingify (formerly VWO & AB Tasty).
Want help choosing a tool and filling it with tests?#
Book a strategy call and we'll look at your traffic, your Shopify plan and the pages worth testing, and tell you which setup fits.
Want us to run this for your store?
We help Shopify brands increase revenue through data-driven CRO. Book a free strategy call.
Ready to grow your Shopify store?
We help Shopify brands increase revenue through A/B testing, landing pages, and conversion rate optimization. No contracts, just results.
