Skip to content
Notes on probability, panic & better guesses
← field guide

Signal vs. noise · Judgment

Signal vs. Noise

Most of what you measure day to day is random wobble pretending to be a trend. Here's how to tell the message from the static.

Weigh yourself every morning. Tuesday you're up a pound, Thursday down two, Saturday up again. You did not gain and lose a person's worth of flesh in a week. You weighed slightly different amounts of water, food, and yesterday's burrito. The number moved, but nothing real changed — and your job is to notice that before you reorganize your life around Tuesday.

That gap has a name. The signal is the real, lasting thing underneath; the noise is the random jitter on top. Every measurement in real life is signal plus noise stapled together. The skill isn't getting rid of the noise — you can't. The skill is not mistaking the noise for the message.

Why one bad day tells you almost nothing

Try the machine below. Drag the days as low as they go, leave the real trend at flat, and hit "new data" a few times. The red trend line swings all over — a steep crash one run, a confident climb the next — even though the truth underneath never budged. That alarming slope is pure randomness. It means nothing. It just looks like it means something, which is worse.

Now drag the days up. The more days you feed it, the flatter that red line falls — back toward the truth it never left. This is the whole reason sample size matters: a short stretch of data is mostly luck wearing a trench coat. A long one lets the random ups and downs cancel out, so the real trend can show through. Then dial in an actual decline and watch the opposite problem: it stays buried in the noise until you have enough days to trust it.

The expensive mistake here has a name too: overfitting. Overfitting is treating the last wobble as the new rule — a theory that explains one weird data point perfectly and predicts the future terribly. Your shop has a slow Monday, so you cancel Mondays. A stock dips for a day, so you sell. You've fit your decision to the noise, and noise never repeats on cue.

What to actually do with a wobble

Run it through the moves. Name the belief — "sales are tanking." Check the base rate — how much does this number normally bounce around even when nothing's wrong? Most things have a quiet, invisible range of random variation, and one bad day usually lives comfortably inside it. Then weigh the evidence: is this outside the usual swing, and has it held for more than a heartbeat?

Then update without collapsing. One bad day is not a trend; it's a data point waiting for company. If the dip repeats across a real stretch of days, the average will tell on it — that's a signal, and you move. If it's a lone spike that's gone by Thursday, you watched noise and stayed calm. Either way you waited for the data to outvote the drama.

So before you react to today's number, ask one thing: would this survive if I looked at it ten more times? The machine above is just that question made visible. A real signal keeps showing up as you collect more data. Noise gets quieter and slinks off. You don't have to be certain — you just have to wait long enough to tell which one you're looking at.

Work it yourself

Interactivesignal vs. noisehit ‘new data’
the datathe truththe trend you’d draw
day 1day 10
same reality, fresh noise
We're crashing. that's the noise talking.

What it looks like

-0.9%/day

the slope through the dots

What is really going on

0%/day

flat — you set it

noise, not signalThis slope sits within the noise (t = -1.0) — it could easily be nothing.

Reality is flat. Every slope here is invented by 10 noisy days — hit “new data” and it lurches, up one run, down the next. Add days, and the fake trend collapses toward zero.

Remember this

A trend is something that survives more than one data point.