A small study can miss a real difference simply because it has limited size and statistical power. When a small study finds no statistically significant difference, that is not evidence that no difference exists the BMJ statistics note on absence of evidence. A single small study adds information, but it rarely settles a question on its own.
Key takeaways
- Small studies have limited power to detect differences.
- A non-significant result in a small study is not proof of no effect.
- Absence of evidence is not evidence of absence.
- A single study, small or large, usually cannot prove a general outcome by itself.
- This page explains the uncertainty; it does not judge any specific study.
What readers should know
Statistical power is a study's ability to detect an effect if one exists. Small studies often have low power, which means they can easily miss real differences. When you read a small study with a non-significant result, the honest reading is that the question remains open, not that the treatment failed. This is not a criticism of small studies; it is an explanation of the uncertainty that comes with them.
Evidence boundaries
- A small study is not automatically untrustworthy.
- A small study's non-significant result does not prove the absence of an effect.
- No single study, small or large, can prove a general outcome on its own.
- See microneedling evidence limits for how single-study limits are described on specific topics.
FAQ
Does a small study mean the results are wrong? No. It means the results come with more uncertainty, and a real effect could have been missed.
If a small study finds no difference, is the treatment ineffective? Not necessarily. The study may simply have been too small to detect a difference.
Can any single study prove a treatment works? No single study on its own is proof; evidence usually builds across many studies.