The top-5,000 test is not statistically significant
The top-5,000 citation comparison returns p=0.85; the full sample returns p<0.001 with reported r=-0.065.
Only the top-5,000 subset test is non-significant; the full-sample test is significant.
The numbers behind it.
- Top-5,000 Mann-Whitney p-value
- Subset of the top 5,000 cited domains; not the full-sample test.
- 0.85
- Full-sample Mann-Whitney p-value
- Full 37,894-domain sample. The public JSON rounds this value to zero.
- <0.001
- Full-sample reported effect size r
- Small reported magnitude; not an estimate of causal citation lift.
- -0.065
The evidence.
Source
The llms.txt Effect
| Measure | Result |
|---|---|
| Top-5,000 Mann-Whitney p-value Subset of the top 5,000 cited domains; not the full-sample test. | 0.85 |
| Full-sample Mann-Whitney p-value Full 37,894-domain sample. The public JSON rounds this value to zero. | <0.001 |
| Full-sample reported effect size r Small reported magnitude; not an estimate of causal citation lift. | -0.065 |
Population and method
Built from HTTP scans of 37,894 AI-cited domains, linked to 337,362 citations and 882 citation snapshots in the Trakkr corpus.
Where the evidence stops
This is an observational study. It measures correlation with citation outcomes, not a controlled experiment.
Adoption is uneven by sector, so raw averages can hide category concentration in SaaS and developer tooling.
The top-5,000 test returns p=0.85. The full scanned sample returns p<0.001 with reported r=-0.065. Neither establishes a causal effect. The public aggregates do not include confidence intervals or document the cohort for citation means and medians well enough to recompute the tests.
What to do with this
Report both cohorts and avoid interpreting a non-significant test as proof of no effect.
Cite this fact.
Source study: llms.txt Effect“The top-5,000 citation comparison returns p=0.85; the full sample returns p<0.001 with reported r=-0.065.”
The llms.txt Effect - Trakkr Research · The top-5,000 test is not statistically significant
The llms.txt Effect · Trakkr Research · Updated 4 September 2026