vLLM v0.28.0 brings seven breaking changes that hit small-GPU users hardest

·2 views

The vLLM inference framework released version 0.28.0 on 26 August 2026, incorporating 584 commits from 270 contributors. Among its most impactful changes for single-GPU users is the removal of built-in bitsandbytes support, which has been moved to an external plugin, meaning anyone using 4-bit or 8-bit quantization must install an additional package or face a broken setup. The default maximum batched token count was also raised from 8,192 to 16,384, which can cause out-of-memory errors on consumer cards with 16GB or 24GB of VRAM. Six additional breaking changes affect users relying on specific Transformers versions, FP8 KV cache scaling, custom attention dtype overrides, reasoning trace parsing, offload metrics dashboards, and legacy MoE kernels. The release also expands CPU and alternative hardware support, enabling DeepSeek-V2/V3 inference on CPU and adding wheels for Intel XPU and IBM s390x platforms.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Developer Builds Automated Pentest Suite to Stress-Test His Own macOS Security App

Tetsuharu, developer of the macOS network-security app RoamSwitch, created an automated penetration testing suite to check whether new code updates introduced security regressions. Rather than risk destabilizing his primary machine, he used Tart, a lightweight macOS virtualization tool, to run tests inside a disposable macOS Sonoma virtual machine. The suite probed five defense boundaries, including XPC authorization, packet filter rules, port exposure detection, and ARP gateway consistency. Key results confirmed that the privileged root helper correctly rejected unauthorized XPC callers, the Air-Gap firewall rules enforced a fail-closed policy, and globally exposed ports were detected and shielded as expected. The approach offers a repeatable, low-risk method for security regression testing across app releases.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Seeks Community Testers for SharePoint Effective Access Audit SPFx Web Part

A developer has submitted a read-only React-based SPFx web part called Effective Access Audit to the PnP SharePoint Framework repository for community review. The web part displays direct role assignments for a SharePoint site and optional list, showing principal details, role names, and permission scope without modifying any permissions. Local testing is complete, with five Jest tests, TypeScript, ESLint, and webpack builds all passing successfully. The developer lacks access to a live SharePoint Online tenant and is asking community members to validate real-world behavior, including how role assignments, scope labels, and error states appear. Feedback and tenant screenshots are requested via the open pull request on GitHub.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

AWS IAM Explained: How Users, Groups, and Roles Control Cloud Access

AWS Identity and Access Management (IAM) is a service that controls who can access resources within an AWS account, eliminating the need to share root credentials. IAM Users are individual identities created for people or applications, each with their own credentials, while IAM Groups allow administrators to assign permissions collectively rather than one user at a time. IAM Roles function like users but carry no permanent credentials; instead, they issue temporary, auto-expiring access tokens to services such as EC2 or Lambda that need to interact with other AWS resources. This approach is considered more secure than hardcoding access keys, since temporary credentials reduce the risk of long-term exposure if a system is compromised. Together, these three IAM components provide a layered, least-privilege framework for managing access across an AWS environment.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

New Apify Actor Converts BetterStack Status Pages Into Structured JSON Data

A new tool published on the Apify Store allows developers to extract data from BetterStack (Better Uptime) status pages in a standardized JSON format. The actor retrieves key details for each component, including its status, availability, description, and last status date, eliminating the need to write custom parsers per vendor. Users can configure the tool via query string, result limits, and optional enrichment or change-monitoring flags. It can be triggered through the Apify Console, REST API, or exposed as an MCP tool for AI agents. Pricing follows a pay-per-result model, meaning users are only charged for the records they actually retrieve.

0 comments Read more at DEV Community