SShortSingh.
Back to feed

Conductor Lets Python Devs Run Async Task Queues on PostgreSQL Without Redis

0
·1 views

A developer has released Conductor, an open-source Python library that uses PostgreSQL as a backend for async task queues, eliminating the need for separate message brokers like Redis or RabbitMQ. The tool is designed for teams already running PostgreSQL who want to handle background tasks such as sending emails or processing images without added infrastructure overhead. Conductor supports exactly-once task execution using PostgreSQL's transaction isolation and ON CONFLICT clauses to prevent duplicate processing. It includes production-ready features such as exponential backoff with jitter for retries, a dead letter queue for failed tasks, and Prometheus metrics for observability. The library claims throughput of over 400 tasks per second per worker and is fully compatible with Python's asyncio, including FastAPI integration.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Why Finishing One Task Beats Starting Ten, According to a Dev Writer

Developer and writer Serguey Asael Shinder argues that starting multiple tasks simultaneously does not constitute real progress. He notes that unfinished work creates a false sense of busyness without delivering actual results. His core advice is to complete one small thing fully before moving on to the next. Shinder suggests that true productivity is quiet and unassuming, likened to a clean, empty background. The piece is a brief reflective reminder for developers to prioritize closing existing loops over opening new ones.

0
ProgrammingDEV Community ·

EverShop 2.2.1 launches with page builder, blog module, metafields, and React 19

Open-source e-commerce platform EverShop has released version 2.2.1, its most significant update since version 2.0, incorporating four months of development work. The release introduces a drag-and-drop visual page builder at /admin/page-builder, a built-in blog module with posts, categories, and tags, and typed metafields attachable to products, orders, customers, and more. Other additions include a multi-language storefront with runtime-based localization requiring no rebuild, rebuilt shipping and fulfillment tools, cloud storage support, product recommendations, and an upgrade to React 19. The update also patches several security vulnerabilities, making prompt upgrading advisable for existing users. Store owners upgrading from earlier versions should back up their databases first, as 31 automatic database migrations across 10 modules will run on first start.

0
ProgrammingDEV Community ·

A 41% Failure Rate Stopped Engineers From Shipping a Temporal Knowledge Graph

A software team nearly deployed a temporal knowledge graph (TKG) system designed to give AI agents time-aware memory by storing facts with validity windows instead of relying on flat vector recall. During evaluation, the system failed 41% of the time on a key test: correctly reporting the state of a node at a specific past time T. The root cause was a flawed retrieval query that sorted facts by the most recent start time rather than filtering by the actual reference timestamp, causing the agent to return a later, incorrect fact. Standard static retrieval metrics had shown no problems, masking the issue until a time-specific evaluation test was written. The incident highlights how temporal queries disguised as simple status lookups can silently bypass conventional testing, making targeted evals critical before deployment.

0
ProgrammingDEV Community ·

Why Load Testing Your Website Before Launch Can Prevent Costly Outages

Load testing simulates concurrent users hitting a website to measure server performance under expected traffic conditions, helping teams identify breaking points before real users do. Unlike stress testing, which pushes systems to failure, or soak testing, which checks for degradation over time, load testing focuses on whether a site can handle its anticipated peak traffic. Tools like loader.io offer a free, browser-based way to run load tests without any installation, making the practice accessible to small teams. Experts recommend running load tests before every major deployment rather than waiting for a live outage to expose weaknesses. Skipping load testing is particularly risky for startups and growing SaaS businesses, where a crash during a product launch or a critical customer interaction can have lasting consequences.