SShortSingh.
Back to feed

Investing Knowledge Graph Series: Why Entity Resolution Breaks When Merging Multi-Source Data

0
·3 views

A developer building an investing knowledge graph shares insights from two real-world conversations that shaped the final part of their series. One discussion involved a financial news aggregation system merging data from English and Chinese sources, such as matching 'Tesla, Inc.' with '特斯拉', highlighting challenges in cross-language entity blocking. The other involved a KYC sanctions screening system, where the stakes of a false negative — an entity wrongly cleared — are far more serious than in a typical knowledge graph. While the core entity resolution architecture transfers across both use cases, the author cautions that model thresholds and training data must be domain-specific, especially for compliance tools. Cross-language name matching and alias generation during ingestion are identified as key technical hurdles that standard string normalization alone cannot solve.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Separating OTP and Order Notification Ownership Improves Seller Login Security

A governance framework for marketplace platforms recommends assigning login OTP templates exclusively to authentication teams, while keeping order notification templates under marketplace team ownership. The approach prevents accidental data crossover — such as seller-supplied product titles leaking into login codes — by enforcing strict template ownership rules in code. Rather than ranking SMS over email universally, the framework advises basing channel selection on which contact detail is already verified for a given seller account. Deliverability metrics like email opens or SMS transport states are flagged as unreliable success signals; only a confirmed verified-code event constitutes a meaningful outcome. The article also cautions that neither SMS nor email OTPs are phishing-resistant, recommending cryptographic authenticators when stronger security is required.

0
ProgrammingDEV Community ·

How AI Orchestration Solves Scaling Challenges for Enterprise .NET Applications

Enterprise .NET applications that connect directly to large language models without a structured orchestration layer often face unpredictable costs, high latency, and hallucinated outputs as user traffic grows. A U.S. retail platform experienced these issues firsthand when a GPT-4-powered price-alert feature hit 10,000 concurrent users, blew past its token budget, and began returning inaccurate prices. The team resolved the problems by introducing an orchestration layer using Redis caching, Cosmos DB for state persistence, Azure Service Bus for long-running workflows, and token usage policies, cutting cold-start latency from 1.2 seconds to 500 milliseconds. Best practices identified from production deployments include prompt caching with Redis, batched inference for bulk workloads, OpenTelemetry instrumentation for observability, and strict tenant isolation to prevent data leakage in multi-tenant systems. Experts warn against common pitfalls such as hard-coded API keys, treating AI services like standard REST APIs, and neglecting per-call monitoring of token usage and latency.

0
ProgrammingDEV Community ·

GitTrends AI v5.0 Launches with Real-Time Star Velocity Tracking and MCP Integration

A developer has released GitTrends AI v5.0, an open-source GitHub repository tracker designed to address discovery gaps for AI coding agent developers. Unlike GitHub's native trending feed, the tool ranks repositories by real-time star velocity, highlighting fast-growing projects regardless of total star count. The platform includes a native Model Context Protocol (MCP) server, allowing coding agents like Claude Code and Cursor to query live GitHub data directly from the terminal or IDE. The registry is organized into curated categories such as MCP Servers, Agent Skills, and a Star Velocity Radar, and is kept current via scheduled GitHub Actions with automated fallback mechanisms. Data is also available in machine-readable JSON and RSS 2.0 formats for integration with tools like Slack, Discord, and Feedly.

0
ProgrammingDEV Community ·

Index Mismatch in Orca Terminal Tool Allowed Retry Limits to Reset Infinitely

A bug in Orca, a desktop tool for managing terminals and AI agent workflows, caused its retry limiter to lose control due to a mismatch between two internal indexes tracking terminal state. When the display cleanup function consulted a different index than the one used for remounting, it could erase a terminal's recovery history even while that terminal remained eligible for further remounts. This allowed the same tab to receive conflicting answers from two separate lookups, effectively resetting the retry budget on each cycle. A reported Windows crash linked to the issue described eight tabs remounting 8,878 times in under two minutes, though researchers worked from the public codebase rather than the original crash data. The proposed fix resolves the inconsistency by ensuring both the remount check and the cleanup predicate rely on the same terminal-row lookup, without altering the retry cap itself.