SShortSingh.
Back to feed

Developer builds Prometheus exporter for Dagster using GraphQL polling instead of Pushgateway

0
·2 views

A developer has released dagster-prometheus-exporter, an open-source Go binary that collects Dagster pipeline metrics by polling Dagster's GraphQL API at regular intervals. The tool was created to address a key limitation of Dagster's officially recommended approach, where metrics are pushed to a Prometheus Pushgateway from within a running job — meaning crashed, OOM-killed, or queued runs never report any data. The exporter maintains in-memory state and decouples metric collection from serving, so the /metrics endpoint continues returning last-known data even if a GraphQL call fails. It tracks metrics including active run counts and durations, completed run statistics, queue backlogs, schedule and sensor statuses, and code location load errors. The project is available on GitHub and supports deployment via Docker or a Helm chart for existing Dagster installations.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Developer audits rival Spring Boot code generator, finds six areas where it outperforms his own

A developer who built SpringBoot Generator, a browser-based Spring Boot code generator, publicly compared his tool's output against a competing tool called Bootify by generating identical domain models in both and reviewing the results file by file. He found six areas where Bootify produced superior output, including automatic audit columns, referential integrity handling on record deletion, and a more complete Angular frontend shell with proper layout components. Bootify also used separate HTML and SCSS template files rather than inlining templates, and included i18n attributes on form components — both considered more idiomatic approaches. The developer acknowledged the comparison had input differences, such as database type and build tool, that made some aspects like validation depth incompatible for direct comparison. He framed the exercise as a transparency effort, noting all findings are independently verifiable since both tools offer a free tier.

0
ProgrammingDEV Community ·

Guide Shows How to Use Claude AI to Build and Track Technical Documentation

A tutorial published on DEV Community outlines a structured method for using Anthropic's Claude AI to create and maintain technical documentation in fast-moving codebases. The approach introduces a 'skeleton-first' strategy, where developers establish a documentation framework — including file paths, section headers, and purpose statements — before filling in actual content. Claude can be prompted via its web interface, API, or Claude Code tool to generate a docs directory based on the Diátaxis framework, which organises content into tutorials, how-to guides, references, and conceptual explanations. The guide also describes building a Code-to-Doc Tracking Matrix to map source files to documentation pages, enabling automated gap audits and pull-request workflow integration. The method aims to make missing documentation visibly apparent rather than an overlooked gap in the development process.

0
ProgrammingDEV Community ·

Developer Builds AI Tool Directory Focused on Curated Stacks Over Exhaustive Listings

A developer created BotAI, an AI tool directory designed to recommend curated tool stacks rather than returning thousands of unfiltered results like competing platforms. Instead of listing tens of thousands of tools, the site offers pre-built stacks — such as a weekend SaaS setup using Bolt, Supabase, Stripe, and Vercel — along with side-by-side tool comparisons and use-case guides. The project launched with 50 human-reviewed tools, prioritising quality and honest descriptions over volume. The creator also optimised the site to be cited by AI search engines, using structured data, FAQ schema, and an llms.txt file, responding to reports that traditional directories are losing traffic as users turn to ChatGPT for recommendations. A Python-based discovery pipeline scrapes sources like Hacker News and Product Hunt, with heuristic filters to separate actual tools from news articles about them.

0
ProgrammingDEV Community ·

Beginner Developer Starts Coding Journey with HTML, CSS, and JavaScript

A newcomer to programming has begun learning the fundamentals of web development, starting with HTML, CSS, and JavaScript. Alongside core coding skills, they are also exploring Git and GitHub to understand how developers manage and build projects. The learner acknowledges that making mistakes is an expected and valuable part of the process. They plan to document and share their progress as they continue to grow their skills.