Improving ChatGPT's Answer Retrieval Rates: Report Insights

The Impact of Citation Rates in AI-Generated Answers

ChatGPT, a powerful tool for generating AI responses, has shed light on an interesting revelation: while it searches through a multitude of webpages, the majority of the sources it discovers never make it to the final answer. According to a recent AirOps analysis, a staggering 85% of the identified sources do not find a place in the ultimate response that users see.

Understanding the Significance

For content creators and website owners aiming to have their information referenced in AI-generated answers, the process is more complex than mere discovery. Merely being retrieved by the AI system does not guarantee visibility to users. The critical factor lies in the selection process that determines which sources get cited.

Crucial Findings to Note

• 82,108 citations made it to the final responses.
• Only 15% of the retrieved pages received citations.
• Surprisingly, 85% of the pages surfaced during the AI's research phase never got featured in the answers.

Furthermore, the rate of citations varied based on the type of query posed:

• 18.3% for product discovery queries
• 16.9% for how-to queries
• 11.3% for validation searches

The Intricacies of Fan-Out Queries

ChatGPT often expands its search parameters through internal queries while formulating a response, which introduces what the report terms a "second citation surface." Key insights from the dataset include:

• 89.6% of prompts initiated two or more subsequent searches.
• Over 15,000 prompts were extended into 43,233 queries through fan-out searches.
• 32.9% of the cited pages were exclusive to fan-out results rather than the original query.
• Remarkably, 95% of fan-out queries had no prior search volume.

Correlation with Google Rankings

The study revealed a strong connection between high Google rankings and citations in AI-generated responses:

• 55.8% of the cited pages secured positions in Google's top 20 search results.
• Pages ranking first were cited 3.5 times more frequently compared to those outside the top 20.

Insights into the Data

AirOps delved into an extensive pool of 548,534 pages retrieved through 15,000 prompts to investigate how ChatGPT identifies citations through query expansion and selection.

For Further Reading

Explore more details in the report by AirOps on "The Influence of Retrieval, Fan-out, and Google SERPs on ChatGPT Citations."

Explore a Wide Range of Online Tools on MATSEOTOOLS

Discover over 200 online tools on MATSEOTOOLS that cater to various needs like SEO, development, text editing, image manipulation, PDF handling, CSV operations, and a range of conversion calculators. Upgrade your digital toolkit today!