SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

Transferum: New TypeScript Library Brings Capability-Based Data-Flow Graphs

0
·1 views

A developer has released Transferum, an open-source TypeScript library for building explicit, graph-based data-flow models between software components. Unlike conventional reactive libraries such as RxJS, Transferum organizes pipelines around 'capabilities' — explicit flags that declare what each node can do, such as push, pull, filter, or buffer data. These capability flags serve dual roles: enforcing compile-time type safety and driving dynamic connection logic at runtime through a central linkTransfers() engine. The library is structured around four core abstractions — Transfers, Bridges, Operators, and Builders — and enforces strict invariants including the suppression of undefined values and class-agnostic node linking. Built-in support for both synchronous and asynchronous transfers is included, with configurable options for concurrency limits and buffer sizing.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

JavaScript Event Loop and Concurrency Model Explained for Beginners

JavaScript is a single-threaded language, meaning it can execute only one piece of code at a time, yet it can still manage multiple asynchronous operations concurrently. This is made possible by the Event Loop, which monitors the Call Stack and moves callbacks from task queues into it for execution when the stack is empty. Asynchronous operations such as timers, API calls, and file reads are handled outside the JavaScript engine by browser Web APIs or Node.js APIs, with their callbacks queued upon completion. The Microtask Queue, which holds Promise callbacks, is always processed before the Macrotask Queue, which holds callbacks from functions like setTimeout. Together, these mechanisms form JavaScript's Concurrency Model, allowing multiple operations to progress simultaneously without true parallel execution.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Sumeh v3.0 offers unified data quality API across 14 engines with built-in row splitting

Sumeh is an open-source Python library designed to run data validation rules against datasets using a single, consistent API across 14 engines, including Pandas, PySpark, BigQuery, Snowflake, and DuckDB. Unlike platforms such as Great Expectations or Soda, Sumeh positions itself as a lightweight library focused solely on validation without requiring cloud services or proprietary configuration formats. A key feature is its ability to split validated data into clean and quarantine rows in a single scan, avoiding the double-pass overhead seen in competing tools. On distributed engines like PySpark, the row-level bifurcation is built entirely from lazy Column expressions, meaning data is never pulled to the driver — addressing a known memory risk in tools like Deequ. Version 3.0, released this month, builds on the v2.0 architectural rewrite and introduces new functionality while maintaining full backward compatibility for existing v2.x users.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Developer Tests Google's Open Knowledge Format on Real API Codebase, Results Surprise

A senior software engineer and tech lead converted the documentation directory of a project called order-api into a conformant Open Knowledge Format (OKF) v0.1 bundle to test whether the format genuinely improves AI agent performance. The experiment involved 25 documents spanning ADRs, evals, skills, runbooks, and reference files, each updated with YAML frontmatter and cross-linked related sections per OKF specification. Two separate AI agent sessions using Claude Code were then run against identical tasks — one using the original repo structure and one using the OKF bundle — to compare behavior. The conversion required only two structural changes per document: standardized metadata headers and a related-links section at the bottom. The engineer noted the outcome differed from expectations, though the full findings are detailed in the accompanying article.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Developer releases 23,000-record open Gujarati instruction dataset to improve AI language support

A developer has publicly released GGJI v1, a Gujarati-language instruction-tuning dataset containing 23,181 instruction-response pairs, citing a significant gap in AI support for the language despite it having over 60 million speakers. The dataset spans 18 task categories including reasoning, translation, creative writing, summarization, and culturally grounded content about Gujarat. It is designed to help researchers and developers fine-tune and benchmark language models capable of understanding and responding naturally in Gujarati. The dataset is freely available on Hugging Face under the Apache 2.0 license, permitting research, commercial, and personal use. The creator acknowledges it is a first version with known gaps, such as limited representation of dialects like Kathiawadi and Surti, and has invited community contributions for future improvements.

0 comments Read more at DEV Community
Transferum: New TypeScript Library Brings Capability-Based Data-Flow Graphs · ShortSingh