SShortSingh.
Back to feed

Logit-Level Filtering Proposed as Stronger Defense Against LLM Jailbreaks

0
·1 views

A new open-source tool called resk-logits aims to address security gaps in large language models by intercepting token probability distributions before text is generated, rather than scanning outputs after the fact. Traditional guardrails, regex filters, and audits operate post-sampling, meaning a jailbreak has already occurred at the logit level by the time they detect it. The tool uses Aho-Corasick pattern matching on the GPU to suppress harmful token sequences proactively, with claimed processing speeds under one millisecond for over 10,000 patterns. Developed by Resk Security, the library is available on GitHub and PyPI. The developers argue that while audits and output filters remain useful, true LLM security requires intervening at the point where token decisions are actually made.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

How AI coding agents rack up costs through small, reasonable-seeming decisions

Agentic coding tools can become surprisingly expensive not through obvious mistakes but through many individually justifiable micro-decisions that accumulate over time. A developer analyzing their own billing identified five key cost drivers: keeping too many files in the main agent's context, reading more files than necessary, using powerful frontier models for simple lookup tasks, generating long outputs inline instead of delegating to cheaper sub-agents, and allowing context bloat that silently inflates costs on every subsequent turn. Because each decision feels harmless in the moment, the author argues that personal discipline alone cannot solve the problem. Instead, they built a structural solution comprising a per-tool-call spending hook, a model router, and a parent-child agent delegation system. Notably, the cost-cutting measures also improved output quality by keeping the main agent more focused and accurate.

0
ProgrammingDEV Community ·

Open-Source Blazor JWT Starter Template Released for .NET 10 with Radzen UI

A developer has published a production-ready open-source starter template that demonstrates secure JWT authentication in Blazor applications built on .NET 10. The template combines JWT Bearer authentication for API communication with cookie-based authentication for the Blazor front end, alongside Radzen UI components. It follows a clean layered architecture separating Domain, Application, Infrastructure, and Shared concerns. The project includes a WebAPI acting as a JWT token authority and a Blazor Server app handling user sessions via secure HttpOnly cookies. The template is aimed at developers looking to skip repetitive authentication boilerplate when building enterprise or experimental Blazor applications.

0
ProgrammingDEV Community ·

How Durable Execution with DBOS Delivers Exactly-Once Automation in TypeScript

A developer migrated 34 production automations from a no-code visual platform to TypeScript, citing durable execution with exactly-once semantics as the key motivation. Traditional automation tools typically offer retry-on-failure, which risks re-executing side effects like sending messages or writing records when a process crashes mid-workflow. DBOS addresses this by checkpointing each completed step in Postgres, so if a workflow crashes between steps, it resumes from where it left off rather than restarting entirely. The framework uses TypeScript decorators to distinguish workflow orchestration logic from individual steps, enforcing a rule that steps are never re-executed once recorded as complete. This approach eliminates the need for manual idempotency keys and progress-tracking boilerplate, reducing automation code to pure business logic.

0
ProgrammingDEV Community ·

Developer Rewrites 34 No-Code Automations in TypeScript, Cuts Memory Use by 90%

A developer recently migrated 34 daily business automations — including WhatsApp AI bots, CRM syncs, and PDF report generation — from the visual no-code platform n8n to hand-written TypeScript code. The primary motivation was growing difficulty maintaining complex workflows on a visual canvas, which made changes slow and debugging opaque. The rewrite, built on the DBOS framework with Postgres-backed durable execution, reduced memory usage from approximately 1.4GB to 150MB — a roughly tenfold improvement — while handling around 1,167 workflows per second. The solo migration was completed with the help of AI coding assistant Claude Code, and a Caddy reverse proxy ensured no client-facing disruption during the switchover. The developer noted that AI bot response times did not improve, since latency is dominated by the underlying language model, not the surrounding infrastructure.

Logit-Level Filtering Proposed as Stronger Defense Against LLM Jailbreaks · ShortSingh