AI search tools confidently spit out wrong answers at a high clip,My Sisters Friend (2019) a new study found.
Columbia Journalism Review (CJR) conducted a study in which it fed eight AI tools an excerpt of an article and asked the chatbots to identify the "corresponding article’s headline, original publisher, publication date, and URL." Collectively, the study noted that the chatbots "provided incorrect answers to more than 60 percent of queries."
SEE ALSO: How to identify AI-generated textThe mistakes varied. Sometimes, the search tool reportedly speculated or offered incorrect answers to questions it couldn't answer. Sometimes, it invented links or sources. Sometimes, it cited plagiarized versions of the real article.
Wrote CJR: "Most of the tools we tested presented inaccurate answers with alarming confidence, rarely using qualifying phrases such as 'it appears,' 'it’s possible,' 'might,' etc., or acknowledging knowledge gaps with statements like 'I couldn’t locate the exact article.'"
The full study is worth looking at, but it seems reasonable to be skeptical of AI search tools. The problem is that folks don't seem to be doing that. CJR noted that 25 percent of Americans said they use AI to search instead of traditional search engines.
Google, the search giant, is increasingly pushing AI on consumers. This month, it announced it would be expanding AI overviews and began testing AI-only search results.
The study from CJR is just another point of data showing the inaccuracy of AI. The tools have shown, time and again, that they'll confidently give wrong answers. And the tech giants are forcing AI into just about every product. So be careful what you believe out there.
Topics Artificial Intelligence
Google launches Pixel 8 and 8 Pro in new Mint colorRyan Gosling reacts to Margot Robbie and Greta Gerwig's 'Barbie' Oscar snubsCambridge Diary, 2014 by J. D. DanielsA Laborer Called a Writer: On Leonard Cohen by Carina del Valle SchorskeBest sex toy deals (June 2025)Cambridge Diary, 2014 by J. D. DanielsElon Musk confirms: Tesla to build new, cheap model in 2025Wordle today: The answer and hints for January 25The Entangled Life: On Nancy Lemann by Krithika VaragurA Brighter Kind of Madness: On Leonard Cohen by Ottessa MoshfeghBeautiful Losers: On Leonard Cohen by Nell ZinkFree Dirt by Angella d'AvignonExxon CEO Rex Tillerson, climate archvillain, to be named secretary of stateOn Cary Grant, Darryl Pinckney, and Whit Stillman by The Paris ReviewE. E. Cummings and Krazy Kat by Amber MedlandWhy Write? by Elisa GabbertWhy reindeer near the North Pole are shrinkingSaturday Is the Rose of the Week by Clarice LispectorApple just made a major investment in Chinese wind powerGalaxy S24 Ultra vs. iPhone 15 Pro Max blind photo test: I asked 10 iPhone users which they prefer Daisy Ridley reveals exactly why she quit Instagram Sick of police violence, black woman gets millions of views painting herself white Harrowing video shows what the future of work might look like Beyond 'Bandersnatch': How to keep choosing your own adventure Gender may be the biggest cause of hate crime against women, new data shows Clinton, Trump, and your money: A personal Megyn Kelly pockets $69 million as NBC officially shows her the door How Stephen King's tweets saved book reviews for a local paper Travis Scott made the NFL donate $500,000 to get him to the Super Bowl Sophie Turner shuts down tabloid rant against Emma Watson in 1 tweet Anthony 'The Mooch' Scaramucci joins 'Big Brother: Celebrity Edition' 'Super Mario Bros.' theme is a killer song for a gymnastics routine All the best theories about the 'Game of Thrones' Season 8 trailer Netflix just increased prices more than ever Amazon is looking into its own gaming service: report Singing man completely shuts down a dissenter at Dublin pro Lupita Nyong'o unveils her rap alter ego to her Instagram fans 'Bird Box' challenge to blame for car wreck in Utah, police say Swiping is here to turn the YouTube app into ultimate time Apple replaced 11 million iPhone batteries in 2018
1.5091s , 8201.765625 kb
Copyright © 2025 Powered by 【My Sisters Friend (2019)】,New Knowledge Information Network