SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

AWS Data Fabric Tutorial Shows How to Connect, Govern, and Query Customer Data

0
·7 views

The article explains that organizations store data across databases, applications, data lakes, and streaming platforms, making unified discovery and governance difficult. It describes a data fabric as an architecture rather than a single product, assembled from AWS services such as S3, Glue, Lake Formation, Athena, Redshift, DataZone, and Bedrock. A conceptual design illustrates how diverse sources flow through ingestion into S3 and then into a catalog and governance layer before reaching query tools. To demonstrate the approach, the tutorial walks through a small customer orders dataset: uploading a CSV to S3, cataloging it with a Glue crawler, and querying it in Athena. The guide stresses securing buckets, setting proper IAM permissions, and verifying inferred column types before production use.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Voice and chat AI agents gave conflicting answers on fees and availability at one dental group

A four-clinic dental group in Ohio used one vendor and one knowledge base for both its AI phone agent and its web chat agent, yet the two channels answered the same questions differently. An audit of 60 conversations per channel found contradictions on rescheduling fees, insurance acceptance, appointment length, and same-day availability. The most costly case involved the chat agent citing a $25 late-rescheduling fee while the phone agent said there was no charge, which led customers to doubt the stated pricing. The inconsistencies were attributed to system prompts written separately with different priorities, voice-specific brevity that dropped policy qualifiers, and separate feedback channels that never compared transcripts. The suggested fix is a canonical answer table for money- and commitment-related questions, with channel-specific wording that must keep all qualifiers.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

MockMini releases v0.1.0, a small auditable macOS proxy core of about 2,600 lines

MockMini, a compact proxy core written in C and Swift, has reached its first tagged release, v0.1.0, under an Apache-2.0 license. It supports Shadowsocks, VMess, Trojan and VLESS over TCP, TLS or WebSocket, running on its own bounded userspace TCP/IP endpoint. Unlike larger kernels such as mihomo, Clash or sing-box, it avoids vendored proxy kernels, third-party TCP/IP stacks and the Go runtime, so one developer can review the whole codebase. Its packet engine is fuzzed, with about 99% line coverage, and continuous integration runs sanitizers and checks against a pinned Xray release. The project still lacks features such as gRPC, Reality and SACK, and its throughput trails mature kernels, while its maintainers invite reviews and contributions.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Spirula Studio's Vulkan build trains a 100,000-splat Garden scene for Three.js

A test of Spirula Studio's Windows Vulkan build used the official Mip-NeRF 360 Garden sample with supplied camera poses. The 2,000-iteration training run produced a 100,000-splat scene in about 13.6 seconds of total process time. The 24.80 MB PLY file was converted to a 1.95 MB SPZ file and rendered in a local WebGL scene using Spark 2.4.0 and Three.js 0.186.1. The author notes the test did not cover other GPU vendors, new phone captures, or production use in the Digital Garden.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Why total queue depth misleads when one Service Bus queue serves many customers

A SaaS platform uses a single shared Service Bus queue to link its cloud product with customers' on-premises systems. The author favors having an outbound-polling agent pull from the broker over inbound HTTP triggers, since the queue absorbs customer outages as backlog instead of failures. Fairness between tenants is handled with per-tenant session IDs, with dedicated queues reserved for high-volume exceptions. The article argues that alerting on aggregate active message count hides a single stuck tenant, as in a case where one customer's credentials failed and their data sat unsynced for days. Instead, it recommends tracking the age of each tenant's oldest unprocessed message, which distinguishes a busy tenant from a broken one.

0 comments Read more at DEV Community