Why a Numaflow watermark wouldn’t move

·1 views

I started looking into issue #3645 in Numaflow, a Kubernetes-native stream processing platform, because of a workaround that seemed odd. The pipeline was still processing messages. The vertices were healthy, and there were no errors in the logs. But pipeline_processing_lag kept growing, first for hours and then for days. The accumulator vertex’s watermark wasn’t The reporter, th0ger, was using Numaflow 1.8.3 with Python SDK 0.14.0.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

5 Speech-to-Text API Rate-Limit Checks — Node.js 429 Retry Queue Observability

A property manager needs a correctly routed maintenance ticket, not a retry loop that eventually returns some text. The least complex workable design is one durable queue, one shared admission gate, and one validator between transcription and triage. Honor Retry-After when a speech-to-text API returns 429, add bounded jitter when that signal is absent, and measure structured-output correctness separately from transport success. Short answer: treat 429 as a scheduling signal. Do not let every worker sleep and retry independently.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Build vs buy: buy the commodity, build your edge

Buy anything your competitor can also buy. Build only the thing they choose you for. That is the entire rule. Build or buy arguments run long because applying it honestly means admitting that your favourite internal project is a worse version of something you could rent this afternoon. We build custom software for a living, so weigh the next part accordingly: most of what a company runs should not be custom, and a good share of what gets built in-house is a CRM that could have been rented for the price of a fortnight of engineering time.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

A Practical Method for Choosing the Right AI Work Boundary

Teams often talk about adopting AI as if the hard part were selecting a model. In practice, the harder decision is choosing the boundary around the work. A tool can draft, sort, compare, summarize, or recommend, but a useful implementation also defines what remains visible to a person. That boundary determines whether an experiment becomes a dependable workflow or a source of quiet rework. Start by describing the decision that the workflow supports.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Inspect Archive Contents Before Extracting with ZipMania

An archive can contain many files, but you may only want to check a photo or read a text file. ZipMania is a free, open-source archive manager for Windows 10 and 11 with previews for supported images and text files inside archives. Open an archive by double-clicking it or using the Windows Explorer context menu. Browse the folders and locate the files you need. Supported archive formats include ZIP, RAR, 7Z, EGG, ALZ, and ISO.

0 comments Read more at DEV Community