11 Keyless REST APIs That Let AI Agents Fetch and Verify Web Data

·1 views

A developer building tool layers for AI agents has compiled a list of eleven REST APIs that return real web data without requiring an API key or payment. Each API was independently verified with a live curl request on July 1, 2026, with actual response outputs documented. The list is distinct from free LLM inference APIs, focusing instead on the 'read-and-ground' layer that allows agents to fetch and verify information before responding. Tools covered include Jina AI for converting web pages to Markdown, Microlink for structured page metadata, and the Internet Archive's CDX index for historical page snapshots. The collection is intended to help developers ground AI agent responses in real-world data using only plain HTTP GET requests.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

How a Misconfigured AWS Egress Firewall Caused Databricks BOOTSTRAP_TIMEOUT Errors

A Databricks cluster deployed on AWS inside a customer-managed VPC repeatedly failed to start, producing a BOOTSTRAP_TIMEOUT error after roughly 25 minutes despite all EC2 nodes passing health checks. The cluster was routed through a multi-hop egress path involving a Transit Gateway, an inspection firewall, and a NAT gateway before reaching the internet. The root cause was that the cluster nodes, which had no public IPs under secure cluster connectivity, could not establish outbound communication to the Databricks control plane's relay service. Unlike AWS-native services such as S3 or STS, the Databricks control plane and its secure cluster connectivity relay have no AWS VPC endpoint, meaning egress must be explicitly permitted through the firewall or routed via AWS PrivateLink. The investigation highlighted that a healthy EC2 instance combined with a cluster stuck in INSTANCE_INITIALIZING is a reliable signal of a broken outbound network path rather than an IAM or capacity issue.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Databricks on AWS: How Instance Pools and Cluster Policies Control Compute Costs

A three-part technical series on building a Databricks AI platform on AWS addresses a critical but often overlooked problem: ungoverned compute access. Without controls, any user can launch large, expensive clusters and forget to shut them down, resulting in unexpected five-figure cloud bills. Databricks tackles this through three governance layers — instance pools, cluster policies, and entitlement gates — each progressively narrowing what hardware a user can spin up. Instance pools pre-warm virtual machines to speed up cluster starts and improve cost predictability, while cluster policies enforce rules on instance types, worker counts, and auto-termination. Together with role-based entitlements that restrict who can create clusters at all, the system ensures users access only the compute resources their role permits.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer builds self-validating UCP conformance checker that must prove it can fail

A developer has released an open-source conformance checker for the Universal Commerce Protocol (UCP), a standard enabling AI agents to discover products and process checkouts with merchants. The tool enforces a strict rule: no check is released until it has been proven to catch its own injected defect, preventing false-positive results that could give users misleading confidence. Each check references official UCP schema validators and specific normative spec clauses, making results traceable rather than reliant on the author's interpretation. Testing against real implementations revealed apparent structural mismatches between the official Node.js reference sample and the 2026 profile schema, which the developer has flagged upstream for clarification. The tool is available via pip, a GitHub Actions integration, and a no-install web interface at spck.dev/check.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Databricks RBAC Explained: Why Groups Are the Only Layer You Actually Build

A technical guide for Databricks on AWS outlines how role-based access control (RBAC) works across account-level groups and workspaces. The author argues that most access control layers — including workspace assignments, entitlements, object ACLs, and Unity Catalog grants — are Databricks built-ins, not custom designs. The only element engineers truly create are function-role groups, such as ai_admin, ai_engineer, and ai_analyst, which act as intermediaries between users and permissions. These account-level groups can be assigned to multiple workspaces at either USER or ADMIN level using Terraform's databricks_mws_permission_assignment resource. Keeping the group set minimal and avoiding pre-built roles for hypothetical personas is recommended to reduce churn and maintain a manageable infrastructure-as-code footprint.

0 comments Read more at DEV Community