Qwen3 27B Runs on One RTX 3090; Dual-Card Setup Offers Modest Speed Gains

·1 views

The Qwen3 27.8B dense model, released on August 14, can run on a single RTX 3090 GPU using W4A16 quantization, achieving decode speeds of roughly 125–155 tokens per second. A home-lab benchmark compared single-card and dual-card (tensor parallel) configurations using two RTX 3090s running vLLM. Adding a second card yielded approximately 20% faster decoding and 14% faster cold prefill on average, with larger prompts seeing up to 23% improvement in time-to-first-token. Cached prompts appeared 2–3x faster on both setups, but this was attributed to vLLM's prefix caching rather than the extra GPU. At current API pricing and measured electricity costs, generating one million output tokens costs the equivalent of roughly $0.12–$0.20 in power on the test machine.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Cisco Talos Uncovers Malware That Uses Four AI Models to Decide Its Next Attack

Cisco Talos disclosed CLOSEDQUORUM in September 2026, identifying it as the first publicly documented Windows malware that delegates tactical decision-making to artificial intelligence rather than a human operator. The Go-based implant polls four large language models — DeepSeek, Qwen, Mistral, and Google Gemini — which independently vote on the next action from a fixed menu including credential theft, code injection, persistence, and lateral movement. Whichever action receives the most votes is executed, with a preset tiebreaker hierarchy resolving any deadlock. Stolen data is encrypted and exfiltrated via a Discord webhook to a channel controlled by the attacker, though a human must still build, configure, and deploy the malware. Security researchers consider this a significant architectural shift because the most human-dependent phase of an intrusion — real-time tactical decision-making — has now been handed to AI, removing constraints tied to operator attention and working hours.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

New Developer Joins DEV Community to Explore Web, AI, and SEO Topics

A new member has introduced themselves to the DEV Community, an online platform for software developers. The individual expressed interest in learning and exchanging ideas within the community. Their areas of focus include web development, automation, artificial intelligence, and SEO. They also highlighted a goal of connecting with like-minded professionals in these fields.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Silent broker failure left 214 paid orders unshipped and undetected all weekend

A finance reconciliation at an unnamed company revealed 214 paid orders from the previous weekend had never been dispatched, with four customers already calling to complain. All system dashboards showed green because a years-old code change had silently swallowed the error — wrapping the messaging call in a try-catch that logged failures only as warnings. The root cause was a 12-minute broker outage during Saturday maintenance, which caused event publishing to fail after order rows and payments had already been committed to the database. The fix involved implementing the outbox pattern, writing events to a dedicated table within the same database transaction as the order, with a relay service handling retries and consumers deduplicating on event ID. An alert on the age of the oldest unsent outbox row has since caught three similar issues before they could silently accumulate into customer-facing problems.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How a Single Loop Triggered 400 Database Queries and Slowed Pages to 9 Seconds

A common but hard-to-spot backend bug known as the N+1 query problem can cause a single loop to generate hundreds of individual database round trips. In the case described, iterating over 400 orders — each triggering its own hidden query — stretched a list page load time to nine seconds. The problem is difficult to catch because the offending code looks like a simple field access during review, testing, and standard metrics monitoring. The fix involves pulling all required data before the loop runs, rather than fetching it one record at a time. Developers are advised to count queries — not just measure milliseconds — and test against real data volumes to surface this class of bug early.

0 comments Read more at DEV Community