Why are comparison queries the most stable query class?
Mostly, because they constrain the answer space more than open-ended best-of or general prompts. Comparison queries reached 50.4% average agreement, the highest of the tracked query families.
The key numbers.
- Comparison-query agreement
- Comparison prompts produce the highest average agreement.
- 50.4%
- General-query agreement
- General prompts are less stable across models.
- 42.2%
Narrower prompts reduce the number of plausible answer sets and force models closer together, meaning operators can expect more consistent visibility for comparison-based content.
The evidence.
| Measure | Result |
|---|---|
| Comparison-query agreement Comparison prompts produce the highest average agreement. | 50.4% |
| General-query agreement General prompts are less stable across models. | 42.2% |
Population and method
Built from 797,644 valid comparisons across 44,088 reports and 8 models, covering 6,439,133 model responses in the observed window.
Where the evidence stops
Agreement is measured across recommendation outputs, not across hidden reasoning or retrieval context.
Average agreement can hide large differences between query classes and model pairs.
The study measures overlap, not which answer was objectively “right”.
What to do with this
- Track visibility across multiple models instead of using one platform as a proxy for the whole market.
- Prioritize query classes where disagreement is highest because that is where share can move fastest.
- Treat consensus as a benchmark, but treat divergence as the operating reality.
Understanding query stability allows teams to allocate resources effectively, prioritizing content formats that either lock in consensus or exploit high-variance opportunities in the market.
Questions about this answer.
Cite this answer.
Source study: Model Divergence“Mostly, because they constrain the answer space more than open-ended best-of or general prompts. Comparison queries reached 50.4% average agreement, the highest of the tracked query families.”
Mack Grenfell · Why are comparison queries the most stable query class?
Same Question, Different AI, Different Answers · Trakkr Research · Updated 11 March 2026