SShortSingh.
Back to feed

Developer shares 8 free adversarial probes to red-team LLM apps in 35 seconds

0
·1 views

A developer who built an autonomous agent handling security decisions from untrusted input has published a free, eight-probe battery for red-teaming large language model applications before they reach users. The tool runs via a single curl command and returns a 0–100 risk score along with raw prompts and model replies within roughly 35 seconds. During the author's own self-scan, the system scored 27/100 (medium risk), with a cross-language, politely worded probe — not an aggressive jailbreak — triggering a partial system prompt leak. The eight probes cover attack types including direct and encoded jailbreaks, system prompt extraction, indirect injection, tool abuse, PII exfiltration, cross-language bypass, and multi-turn drift. A 15-probe starter kit is available under the MIT license on Gitee, and all scan results are hash-verifiable for independent reproduction.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Codename One Now Lets Dialogs Open as Native Desktop OS Windows

Codename One, an open-source framework for building cross-platform apps from a single Java or Kotlin codebase, has released a fix via PR #5624 that allows dialogs to appear as real modal desktop operating-system windows. The update addresses a bug where Dialog.show() was incorrectly targeting the wrong surface when multiple native windows were open. Developers can enable this behavior app-wide using Dialog.setDefaultNativeWindowMode(true) or on a per-instance basis, while ports without native window support automatically fall back to lightweight dialogs. The fix also corrects several components — including Dialog, ComboBox, and ToastBar — that previously conflated 'top level' with 'form', causing incorrect behavior in multi-window environments. Native-window mode is recommended when a dialog needs to participate in desktop window ordering or task switching, while lightweight mode remains the default for simpler prompts.

0
ProgrammingDEV Community ·

Anthropic CEO Dario Amodei Outlines Five-Point AI Policy Agenda for Frontier Models

Anthropic CEO Dario Amodei has published a policy essay titled 'Policy on the AI Exponential,' arguing that rapid advances in frontier AI are outpacing the capacity of public institutions to regulate them. The essay proposes a five-area framework covering frontier-model testing, employment effects, civil liberties, downstream technology management, and international coordination among democracies. Among its most concrete proposals is an FAA-style regulatory model requiring mandatory third-party safety testing of frontier models, with government authority to block deployments that fail those checks. Anthropic also plans to release separate legislative proposals on frontier-model testing and job displacement policies. The essay is directed at governing the most advanced AI systems rather than restricting everyday business use of established AI tools.

0
ProgrammingDEV Community ·

How a time-zone mismatch caused a test to fail every morning and pass every afternoon

A developer at WatchNext discovered an intermittent test failure in their air-date countdown app while making unrelated changes to a privacy page and footer. The failing test checked whether an episode airing tomorrow was counted as one day away, but it was occasionally returning two days instead. Investigation revealed the bug was pre-existing and not caused by the recent edits, confirmed by running the test suite after reverting all changes. The root cause was a calendar mismatch: the test built 'tomorrow' using JavaScript's toISOString(), which always outputs UTC dates, while the production function deliberately calculated day differences in America/Los_Angeles time. This meant that during the roughly seven-to-eight hours each day when UTC had rolled over to a new date but Los Angeles had not, the two sides of the assertion were measuring from different calendars, causing the test to fail.

0
ProgrammingDEV Community ·

NextAPI Module Registry Lets Developers Install Full-Stack Features Like Packages

A developer has introduced the NextAPI Module Registry, a system designed to let teams install complete full-stack application features as single installable units. Unlike traditional packages that deliver only a frontend component or backend library, NextAPI modules bundle pages, API endpoints, database resources, authentication, navigation, and environment configuration together. The workflow mirrors familiar package manager commands, where running 'nextapi add profile-page' adds an entire feature rather than a library requiring manual integration. After modules are added, a 'nextapi sync' command resolves dependencies and integrates everything into the project. The registry is not intended to replace npm or existing package managers, but to address the gap between having reusable code pieces and having reusable application capabilities.

Developer shares 8 free adversarial probes to red-team LLM apps in 35 seconds · ShortSingh