Before-and-after measures the calendar
Seasonality, promotions, ad spend, and product drops all move the numbers. A sequential comparison cannot isolate what the theme itself changed.
Test a new Shopify theme on real traffic before you commit
Shopify has no native way to A/B test themes: publishing a new theme replaces the old one for everyone at once. Real theme testing splits live traffic between the current theme and the new one, runs both simultaneously, and measures conversion and revenue end to end, through checkout. The winner is a measurement, not an opinion.
Delivered in 3 business days.
What does an untested Shopify theme cost?
A theme change is one of the biggest single bets a store makes. It touches every page, every product, and every customer at once. The standard approach is to publish and watch, comparing this month to last month while hoping nothing else changed.
A better-looking redesign can convert worse
Without the old theme running at the same time, a conversion drop gets attributed to everything except the redesign. Visual preference is not evidence of commercial impact.
Revenue picks the winner
The honest comparison runs both themes simultaneously on separate traffic groups. Whatever difference appears in conversion and revenue belongs to the theme, not the month around it.
How does PDQ test a Shopify theme before launch?
PDQ treats the redesign as one complete variant, runs it against the current theme on live traffic, and measures the result through checkout. The decision comes from revenue, not engagement or internal preference.
01
Test the whole theme, not a widget
A theme is not a button color. PDQ's Cross-Site Testing runs the entire theme as one variant: every template, every page, end to end. Shoppers are split between the current theme and the new one, and each group gets a complete, consistent experience.
02
Run both themes at the same time
Sequential comparisons measure the calendar, not the theme. Splitting live traffic between themes simultaneously removes seasonality, promotions, and traffic mix from the equation. Whatever difference shows up belongs to the theme.
03
Measure through checkout, not to it
A new theme can raise add-to-cart and quietly hurt checkout completion. The test includes each theme's checkout experience and measures conversion and revenue at the end of the funnel, where it counts. A theme that wins on engagement and loses on revenue is a losing theme.
04
Read the results by segment
A theme can win with new visitors and lose with returning customers, or win on desktop and lose on mobile. PDQ reads results per segment, so the decision is not one blended number but a picture of who the new theme actually works for.
Powered by
What does PDQ's testing discipline deliver?
A general result across PDQ's winning experiments, not a theme-test-specific performance claim.
+19% CVR
PDQ's winning A/B tests deliver an average +19% CVR improvement, measured across 36 experiments.
Shopify theme testing questions
Can you A/B test a theme on Shopify?
Not natively. Shopify allows one published theme at a time, so launching a new theme swaps it in for all visitors at once, with no control group. Testing a theme requires splitting live traffic between the current and new theme simultaneously and comparing conversion and revenue between the groups, which is what PDQ's Cross-Site Testing does.
How do I test a new Shopify theme before fully launching it?
Run it as a split test against your current theme. Part of your live traffic sees the new theme, the rest sees the old one, both at the same time. Measure conversion and revenue through checkout for each group, and publish the new theme only if it wins. Previewing the theme yourself or comparing metrics before and after launch can't isolate the theme's effect.
What should you measure in a theme test?
Revenue and conversion at the end of the funnel, not engagement along the way. Add-to-cart rate, time on site, and bounce rate can all improve while checkout completion falls. The deciding metrics are checkout conversion and revenue per visitor, read per segment (new vs returning, mobile vs desktop), since a theme rarely wins or loses uniformly.
How long should a Shopify theme test run?
Until the result is statistically significant, which depends on your traffic and the size of the difference between themes. As a rule, cover at least two full business cycles (including a weekend) so day-of-week patterns don't skew the read, and resist calling a winner early: early leads flip.
Related checkout problems
Checkout Abandonment
Stop losing 7 in 10 shoppers at the finish line
Checkout Issues Report
Not sure where you're leaking? Start with the 12 most common checkout issues, from 600+ store audits.
Shipping Personalization
One-size-fits-all shipping loses money at both ends — tailor it by segment, zone, and cart
