Telling signal from noise on a small store

Last reviewed 15 August 2026

Short answer

On a small store most daily movement is randomness. If orders arrive independently, the expected day-to-day swing is roughly one divided by the square root of the daily order count, so 10 orders a day carries about 32% natural variation and 100 orders a day about 10%. Real signals are usually larger.

The arithmetic, in one table

Counting things that arrive at random produces variation with no cause. If your store averages a certain number of orders a day, the typical deviation around that average is about the square root of it, which as a percentage shrinks as volume grows.

That single fact explains most of the frustration merchants have with daily analytics, and it is almost never stated in analytics content, because analytics content is written for stores large enough that it does not bite.

Average orders per dayTypical deviationAs a percentage
5About 2.2 ordersAbout 45%
10About 3.2 ordersAbout 32%
25About 5 ordersAbout 20%
50About 7 ordersAbout 14%
100About 10 ordersAbout 10%
400About 20 ordersAbout 5%

This is a floor, not the real number

The table assumes orders arrive independently at a constant rate, which is the most generous assumption available. Real demand does not behave that way.

Weekday effects are large. Campaigns cluster orders. One customer places three orders in an afternoon. Order values vary, so revenue swings harder than order count does, often much harder if you sell across a wide price range.

So the practical rule is one-directional. If a move is inside the band in the table, it is noise, with confidence. If it is outside, it might be a signal, or it might be one of the effects above. Being outside the band is necessary, not sufficient.

What actually counts as a signal at low volume

Small stores are not short of information, they are short of information in the daily revenue number specifically. These carry signal at any volume.

  • Direction sustained across several days, rather than the size of any one day
  • Same-weekday comparison across three or four weeks, which cancels the largest confound
  • Anything binary: a channel going to zero, a payment method failing, a product page 404ing
  • Composition changes: the mix of products, countries or channels shifting even when the total holds
  • Anything with a known cause: you ran the campaign, so the question is size rather than existence

The threshold we use, and why it is arbitrary

Seam writes an annotation onto your own Shopify analytics charts when a day is notable, and it defines notable as a same-weekday revenue change of 25% or more.

That number is a judgement call. It is not a statistical test, it does not adjust for your order volume, and on a store doing 10 orders a day it will fire on days where nothing happened, because 25% is well inside that store natural variation.

We are publishing that because a threshold you cannot see is a threshold you cannot argue with. Anyone selling anomaly detection on a small store is choosing a constant like this one, and most do not tell you what it is.

Where this is genuinely hard

You cannot solve a small-sample problem by looking harder, buying a better tool, or checking more often. Checking more often makes it worse: more looks at a noisy series means more apparent patterns, all of them spurious.

The only real remedy is longer windows, which is precisely the remedy that feels worst when you are anxious about the business. Nobody who is worried about revenue wants to be told to wait three weeks.

The one genuinely useful move is to change what you measure rather than how often. Rates and composition stabilise faster than totals, and leading indicators like time to second order tell you something months before revenue does. That is the reason the new versus returning split is worth more attention at low volume than the daily number is.

Common questions

How much daily variation is normal for a small Shopify store?
At 10 orders a day, roughly 32% swing is expected from randomness alone. At 25 a day, roughly 20%. Revenue swings harder than order count because order values vary too.
How do I know if a drop in sales is real?
Compare the same weekday across several weeks rather than yesterday against the day before, and look for direction sustained over several days. A single day outside the normal band is a candidate, not a conclusion.
Is anomaly detection useful for a small store?
Only with a threshold matched to your volume, and most tools do not disclose theirs. A fixed percentage threshold will fire constantly on a low-volume store, because ordinary randomness exceeds it most weeks.
What should I measure instead of daily revenue?
Rates and composition, which stabilise faster than totals, plus leading indicators like time to second order. Same-weekday comparison over three or four weeks is the cleanest trend signal available at low volume.

Related

Sources

one email. the thing that changed.

Seam reads your store every day and sends one paragraph about what actually moved. No dashboard to open.

Install on Shopify