Skip to content

The top-5,000 test is not statistically significant

The top-5,000 citation comparison returns p=0.85; the full sample returns p<0.001 with reported r=-0.065.

Only the top-5,000 subset test is non-significant; the full-sample test is significant.

The numbers behind it.

Top-5,000 Mann-Whitney p-value
Subset of the top 5,000 cited domains; not the full-sample test.
0.85
Full-sample Mann-Whitney p-value
Full 37,894-domain sample. The public JSON rounds this value to zero.
<0.001
Full-sample reported effect size r
Small reported magnitude; not an estimate of causal citation lift.
-0.065

The evidence.

Source
The llms.txt Effect

MeasureResult
Top-5,000 Mann-Whitney p-value

Subset of the top 5,000 cited domains; not the full-sample test.

0.85
Full-sample Mann-Whitney p-value

Full 37,894-domain sample. The public JSON rounds this value to zero.

<0.001
Full-sample reported effect size r

Small reported magnitude; not an estimate of causal citation lift.

-0.065

What this study measured.

An observational snapshot.
Tested 14 March 2026.

Read the full methodology

Population and method

Built from HTTP scans of 37,894 AI-cited domains, linked to 337,362 citations and 882 citation snapshots in the Trakkr corpus.

Where the evidence stops

This is an observational study. It measures correlation with citation outcomes, not a controlled experiment.

Adoption is uneven by sector, so raw averages can hide category concentration in SaaS and developer tooling.

The top-5,000 test returns p=0.85. The full scanned sample returns p<0.001 with reported r=-0.065. Neither establishes a causal effect. The public aggregates do not include confidence intervals or document the cohort for citation means and medians well enough to recompute the tests.

What to do with this

Report both cohorts and avoid interpreting a non-significant test as proof of no effect.

“The top-5,000 citation comparison returns p=0.85; the full sample returns p<0.001 with reported r=-0.065.”

The llms.txt Effect - Trakkr Research · The top-5,000 test is not statistically significant
The llms.txt Effect · Trakkr Research · Updated 4 September 2026

https://trakkr.ai/trakkr-research/llmstxt-effect/facts/the-significance-test-comes-back-null
Page JSON ↗Includes the finding, limits, attribution and canonical URL.