Key Takeaways
- AI chatbots source information from far beyond Google’s top search results
- Overlap between Google results and AI answers is less than 50% across all queries
- Chatbots prioritize reliable sources regardless of search ranking position
AI chatbots and Google search engines gather information in fundamentally different ways, with chatbots accessing web pages far beyond traditional search rankings, according to new research.
A study from Ruhr University Bochum and the Max Planck Institute reveals that while both systems aim for accuracy, their approaches diverge significantly. Google’s search relies on ranking and visibility, whereas AI chatbots explore a much broader internet landscape.
Research Methodology and Findings
Researchers compared Google’s search engine with Google AI Overviews, Gemini 2.5, and GPT-4o’s web-based results across various query types. They examined political questions, factual information, and product recommendations to trace each system’s sourcing patterns.
The findings showed AI chatbots frequently pull data from sources ranking outside Google’s first 1,000 results – sometimes even from domains beyond the top one million websites. For shopping-related searches, the overlap between Google’s top results and AI-generated answers was less than 30%. Across all query types, similarity remained below 50%.
Gemini demonstrated a particular tendency to source content from low-ranking or lesser-known websites, while GPT-based systems often cited formal, verified sources like encyclopedias and corporate sites, avoiding social media references.
Different Information Processing Approaches
AI systems use online data to reinforce existing internal knowledge rather than starting from scratch. In contrast, Google’s search engine assumes no prior user understanding and ranks pages by relevance, popularity, and optimization.
The study noted that AI chatbots focus on depth and accuracy over presentation, capable of extracting insights directly from research papers or lengthy reports without simplification. Their primary goal is identifying reliable, informative material regardless of its search ranking position.
Implications for Information Discovery
Researchers didn’t declare either approach superior but emphasized the need for new evaluation methods to understand how generative search systems select sources. As AI evolves, how these systems gather and filter information remains a key area for further study.
The research suggests users may encounter different perspectives and sources depending on whether they use traditional search or AI chatbots for information gathering.
