A research feed finds three articles saying a supplier is shutting down. A simple system sees three confirmations and reports high confidence. A more careful system notices that all three articles copied the same notice.
The arithmetic behind the mistake is straightforward. Bayes' rule is powerful, but multiplying likelihood ratios as though every observation were independent is not justified when the observations share an origin.
A worked example §
Suppose the prior odds that a rumor is true are 1:9. A genuinely independent positive signal has likelihood ratio 4. After one signal the odds become 4:9, which is about 30.8% probability.
If three such signals were independent, the odds would be 64:9, or about 87.7%. But if all three headlines copied the first report, we may still have only one piece of evidence. Treating them as three can inflate the estimate by nearly 57 percentage points in this illustrative calculation.
The exact prior and likelihood ratio would have to be justified for a real question. The structure of the error is general.
Source lineage is part of the statistical model §
A useful research system should record the original URL, publisher, observation time, citations and whether a document is a reprint or independent observation. Only then can it decide how much additional information a new article supplies.
This is why Source Library and external-estate work need relationships rather than a flat count of hits. A thousand mirrors of a manufacturer press release may be helpful for discoverability while contributing almost no new evidence.
For a mathematical starting point see the Stanford Encyclopedia's treatment of Bayes' theorem[1]. For Aurekai, the lesson is practical: an explanation is only as strong as the independent observations behind it.
Confidence should increase when we learn something new, not simply when the same statement appears on more screens.
Sources and further reading
References point to original material linked in the essay, not independently invented citations.
- Stanford Encyclopedia's treatment of Bayes' theoremplato.stanford.edu↩
Related reading
More articles that explore this subject from another angle.
Milgram's obedience experiments illuminate a modern failure: people and systems can correctly perform a task whose purpose is wrong.
Read the earlier argument ↗Another essay leads hereA library of Alexandria selected by demandAs the internet expands, what gets archived, indexed and translated is shaped by attention, money and institutional capacity.
Read the earlier argument ↗Another essay leads hereThe clip is not the whole workClippers, broadcasters and editors are increasingly important distributors. The context and rights surrounding a clip matter as much as its reach.
Read the earlier argument ↗Another essay leads hereA 95% accurate detector can still be wrong most of the timeThe base-rate calculation that belongs in civic surveillance and anomaly-detection discussions.
Read the earlier argument ↗Another essay leads hereThe citation still works. The evidence has changed.Persistent identifiers can preserve reference relationships without guaranteeing that every version, claim or accessible copy remains unchanged.
Read the earlier argument ↗