Advierten expertos que los resúmenes de IA pueden ser inexactos

People reading AI summaries on Google search instead of news stories, media experts warn

Experts warn that AI summaries can be inaccurate and are cutting into consumption of actual news

The Canadian Press · Posted: Aug 13, 2025 2:48 PM EDT | Last Updated: August 13

Some news publishers and experts are concerned that the AI-generated summaries provided at the top of Google search results are cutting into actual news traffic and providing inaccurate information. (Bosavang/Shutterstock)

Some news publishers say the AI-generated summaries that now top many Google search results are resulting in fewer people actually reading the news — and experts are still flagging concerns about the summaries’ accuracy.

When Google rolled out its AI Overview feature last year, its mistakes — including one suggestion to use glue to make pizza toppings stick better — made headlines. One expert warns concerns about the accuracy of the feature’s output won’t necessarily go away as the technology improves.

“It’s one of those very sweeping technological changes that has changed the way we … search, and therefore live our lives, without really much of a big public discussion,” said Jessica Johnson, a senior fellow at McGill University’s Centre for Media, Technology and Democracy.

“As a journalist and as a researcher, I have concerns about the accuracy.”

While users have flagged mistakes in the AI-powered summaries, there is no academic research yet defining the extent of the problem. A report released by the BBC earlier this year examining AI chatbots from Google, Microsoft, OpenAI and Perplexity found “significant inaccuracies” in their summaries of news stories, although it didn’t look at Google AI Overviews specifically.

In small font at the bottom of its AI summaries, Google warns users that “AI responses may include mistakes.”

Google’s AI summaries that show up at the top of its search results are causing concern for some experts who warn that the information may not always be accurate. (Juliana Yamada/The Associated Press)

The company maintains the accuracy of the AI summaries is on par with other search features, like those that provide featured snippets, and said in a statement that it’s continuing to “make improvements to both the helpfulness and quality of responses.”

Leon Mar, director of media relations and issues management at CBC/Radio-Canada, said the public broadcaster “has not seen a significant change in search referral traffic to its news services’ digital properties that can be attributed to AI summaries.”

But he warned that users should be “mindful” of the varying accuracy of these summaries.

AI has ‘fundamental problem’

Chirag Shah, a professor at the University of Washington’s information school specializing in AI and online search, said the error rate is due to how AI systems work.

Generative AI can’t think or understand concepts the way people do. Instead, it makes predictions based on massive amounts of training data. Shah said that “no checking” takes place after the systems retrieve the information from documents and before results are generated.

ChatGPT is increasingly being used as a search engine, despite the documented flaws of generative AI. (Kiichiro Sato/The Associated Press)

“What if those documents are flawed?” he said. “What if some of them have wrong information, outdated information, satire, sarcasm?”

A human being would know that someone who suggests adding glue to a pizza is telling a joke, Shah said. But an artificial intelligence system would not.

It’s a “fundamental problem” that can’t be solved by “more computation and more data and more time,” he said.

AI changing how we search

As Google integrates AI into its popular search function, other AI companies’ generative AI systems, such as OpenAI’s ChatGPT, are increasingly being used as search engines themselves, despite their flaws.

Search engines were originally designed to help users find their way around the internet, Shah said. Now, the goal of those who design online platforms and services is to get the user to stay in the same system.

“If that gets consolidated, that’s essentially the end of the free web,” he said. “I think this is a fundamental and a very significant shift in the way not just search but the web, the internet, operates. And that should concern us all.”

WATCH | AI companies are trying to change how we use the internet:

AI agents could change how you use the internet

1 month ago

OpenAI and other big tech companies are starting to roll out the next wave of artificial intelligence, designed to operate with more autonomy. CBC’s Nora Young breaks down how agentic AI works and why some think it will change how you use the internet.

A study by the Pew Research Center from earlier this year found users were less likely to click on a link when their search resulted in an AI summary. While users clicked on a link 15 per cent of the time in response to a traditional search result, they only clicked on a link eight per cent of the time if an AI summary was included.

That’s cause for alarm for news publishers, both in Canada and abroad.

“Zero clicks is zero revenue for the publisher,” said Paul Deegan, CEO of News Media Canada, which represents Canadian news publishers.

Last month, a group of independent publishers submitted a complaint to the U.K.'s Competition and Markets Authority saying that AI overviews are causing them significant harm.

Alfred Hermida, a professor at the University of British Columbia’s journalism school, said Google used to be a major source of traffic for news outlets by providing users with a list of news articles relevant to their search queries to click on.

But Hermida said, “when you have most people who are casual news consumers, that AI summary may be enough.”

Keldon Bester, executive director of the Canadian Anti-Monopoly Project, said there is a competition issue at play and there could “potentially” be a case under Canadian law.