SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

LLMs drop key words, invent facts without rules when asked to humanize text

0
·1 views

Researchers tested two AI models, Claude Sonnet and Claude Haiku, on humanizing a text in five languages. When given only the instruction "Humanize this text," all ten outputs removed the word "usually," altering factual meaning. The models also invented unsupported facts and motives, with Haiku wrongly translating three non-English requests into English. However, when provided with specific rules for the task, the models retained key qualifiers, preserved the original language, and delivered only the requested rewrite.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Developer migrates TypeScript library from tsup to tsdown, discovers contract break

A frontend engineer recently migrated the build system for a TypeScript open-source library from tsup to tsdown. The primary goal was to update the tooling without altering the final npm package delivered to users. While the configuration change was straightforward, the initial tsdown build unintentionally changed the names of key output files. This silent change risked breaking the library's public contract for existing consumers.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

MIT's VISTA harness boosts Claude AI to perfect score on ARC-AGI-3 test with visual prompts

On October 1, researchers at MIT CSAIL published a paper introducing VISTA, a visual interface harness. The system replaced ARC-AGI-3's standard numeric grid interface with 512×512 screenshots and a lossless visual memory archive. Using just a four-sentence prompt without model retraining, VISTA lifted Claude Opus 5.0's performance from 40.68 to a perfect 100 Relative Human Action Efficiency score. The AI completed all 25 test games using 57.4% fewer actions than first-time human players. Researchers concluded perception limitations, not reasoning deficits, had previously constrained AI performance on the benchmark.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Node.js security: vm and worker_threads fail to safely isolate AI-generated code

Node.js backends increasingly need to execute AI-generated code, but running untrusted scripts poses serious security risks. The built-in vm module allows code execution in a synthetic context but cannot prevent sandbox escape attacks. Worker threads move execution off the main event loop but still share access to Node's internal APIs like filesystem and network. True isolation requires V8 Isolates, which create separate V8 engine instances with their own heap and memory limits. Libraries like isolated-vm implement this approach to safely run untrusted code within defined resource constraints.

0 comments Read more at DEV Community
LLMs drop key words, invent facts without rules when asked to humanize text · ShortSingh