Study finds about 11% of Google AI Overview claims are unsupported by their cited sources

·1 views

A peer-reviewed study from Washington University in St. Louis, presented at the October 2026 ACM Internet Measurement Conference, tested whether Google AI Overview answers match the pages they cite. Researchers ran 55,393 searches on trending topics between March and April 2026 and checked nearly 98,000 individual claims against their cited sources. About 89% were clearly or broadly supported, 7% could not be found in the cited text, and 4% directly contradicted it. The authors describe the roughly 11% error rate as an upper limit, since their pipeline could not fully capture content from forums and video platforms and fast-changing information may have been updated after capture. Only 41.9% of overviews were fully grounded in their citations.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

After a Year of Daily Use, Which AI Image Generators Actually Stick

A writer who generates images almost daily spent a year testing and re-subscribing to major AI image tools, concluding there is no single winner. Midjourney is still praised for the most consistently beautiful raw output, but it has no free tier and plans run from about $10 to $120 monthly. GPT Image, inside ChatGPT, is highlighted for multi-turn editing and for following instructions closely, which the author calls the biggest workflow difference. Ideogram is preferred for images containing text, while Stable Diffusion and Flux suit self-hosting, which is free in software but requires capable hardware and a learning curve. Adobe's Firefly and Recraft are noted for commercial licensing safety and genuine vector output, respectively.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Keeping Terraform Vault Secrets Out of State and Git

Using the vault_kv_secret_v2 data source to pull database passwords into Terraform stores those values in plain-text state, even when variables are marked sensitive. Newer Terraform and Vault provider releases offer ephemeral resources and write-only arguments, which keep secrets available during a run without persisting them in plan or state. The approach requires Terraform 1.10 or 1.11 or later, a KV version 2 secrets engine in Vault, and a non-interactive authentication method such as AppRole or JWT. Users should configure the Vault provider without hard-coded tokens, reading credentials from the environment or auth blocks. Support for write-only arguments varies by provider and resource, so the guide advises checking each provider's documentation before relying on it.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer builds Kyboro, an AI agent that runs plain-English tasks on a user's own PC

A developer has created Kyboro, a desktop tool that carries out tasks described in everyday language, such as opening a browser, editing files, or running terminal commands, while the user watches. The system is split into an Electron desktop app, a local Python executor that performs the actions, and a cloud orchestrator built with FastAPI and Postgres that plans tasks and selects models. The developer reports several engineering problems along the way, including timeouts that silently killed tasks, retry loops that evaded detection, and a confirmation flow that had to be built so risky actions like deleting files wait for user approval. Early versions are available for Windows, Mac, and as a Chrome extension, and the developer is asking for feedback from real-world use.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

PPTX converter fixed to follow true slide order instead of filename order

A developer found that a pitch deck converted to Markdown placed the appendix before the main pitch because the converter read slide files alphabetically. In PPTX files, slide filenames like slide1.xml do not reflect presentation order, which is instead defined in presentation.xml. The fix parses the slide ID list and resolves each relationship ID to its target file, so slides appear in the order the author intended. The developer compares this to similar ordering issues in spreadsheets and EPUB files, where the index rather than the filename determines sequence. The corrected tool is available as part of the author's document tooling online.

0 comments Read more at DEV Community