The reporting change matters before the next budget decision
Shopify changed its session measurement starting September 21. The update improves human-versus-bot classification and recognition of valid shopper journeys. Sessions and rates based on sessions may move even when the underlying commercial result does not.
If a dashboard suddenly looks better, first establish whether the same thing is being counted on both sides of the comparison.
Separate a different denominator from additional business
Illustrative calculation: 20 orders divided by 1,000 sessions gives a 2% order-to-session ratio. The same 20 orders divided by 800 sessions gives 2.5%. That arithmetic does not show five extra orders or prove an advertising improvement; it is not a Shopify account result.
For campaign decisions, we recommend reviewing orders, sales and ad spend alongside the session-based report. A higher rate can still be useful information, but it needs a comparable baseline.
Leave an explanation in the report
Our recommendation is to annotate September 21 in the reporting notes and retain an export of the earlier view. Record the date range, time zone, filters and metric definition used in each comparison.
A client or team member should be able to see why a rate changed without reconstructing the platform announcement. Treat a comparison spanning the measurement change as qualified evidence rather than a clean before-and-after test.
For your next work session
What to check next
- Mark September 21 as a measurement change in your reporting notes.
- Record the Human or bot filter and other filters used in each report.
- Compare orders, sales and spend separately from session-based rates.
- Avoid calling a higher conversion rate a campaign win without additional evidence.
- Build future comparisons from consistent post-change report settings.
Sources and scope
This is a measurement update, not evidence that an individual store gained or lost customers. Shopify says order, sales and customer counts are unchanged by it.
The announcement is confirmed by the source below. Practical checks in this article are Stan Consulting's recommendations.
Need help applying this to your business? Ecommerce services.
