Databricks BOOTSTRAP_TIMEOUT Fixed via AWS PrivateLink Without Adding New Subnets

·1 views

A team running Databricks on AWS traced persistent BOOTSTRAP_TIMEOUT errors to a centralized egress firewall silently dropping traffic from cluster nodes trying to reach the Databricks control plane and SCC relay. Rather than simply adding a firewall rule, the team chose to route control-plane traffic entirely off the public internet using AWS PrivateLink. The fix required two interface VPC endpoints — one for the workspace REST API and one for the SCC relay — both of which are necessary to allow clusters to start successfully. Because the existing VPC was a fully utilized /24 with no room for new subnets, the team placed the endpoint ENIs directly into existing cluster subnets, consuming only a few private IPs per availability zone. This approach eliminated the bootstrap failure without requiring new subnets, new CIDR blocks, or any routing changes.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Chinese Tech Influencer Admits Losing 1.3M Yuan in Stock Market Over One Year

A Chinese social media influencer known for his programming background publicly confirmed he lost approximately 1.3 million yuan (around $180,000) trading stocks over the past year. The admission went viral on Weibo after the topic trended, sparking widespread debate about whether technical expertise translates into investment skill. The influencer chose to address the controversy directly rather than stay silent, acknowledging the losses and offering an explanation to followers. Analysts note that retail investors, regardless of technical background, face structural disadvantages against institutional players who have superior data access, research teams, and enforced risk controls. The episode has highlighted a growing trend among tech content creators of turning personal investment experiences — including losses — into audience-engaging content.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer shares 5 REST API mistakes that drove away early users

A developer building their first public API for a task tracker lost users not due to poor product design but because of poor API practices. Key mistakes included returning HTTP 200 for all responses even on errors, lacking API versioning which broke a client integration when a field was renamed, and having no rate limiting that allowed a buggy script to crash the database for all users. Inconsistent error response formats across different code layers forced API consumers to write multiple custom parsers. The developer outlines fixes including proper HTTP status codes, versioned routes with deprecation headers, token-bucket rate limiting, a unified error schema, and paginated responses to handle large datasets.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

PostgreSQL, MongoDB, or Cassandra: How Multi-Node Architecture Changes Everything

Single-node performance differences between databases become largely irrelevant once a second node is added, as network latency — measured in milliseconds — dwarfs storage-engine optimizations measured in microseconds. Network partitions introduce a new failure class unique to distributed systems, forcing each database to make architectural trade-offs that reveal its core design philosophy. PostgreSQL was originally built as a single-node database, meaning all its distributed capabilities — replication, connection pooling, and sharding — were added later as external tooling. Running PostgreSQL at scale requires additional components like Patroni for high availability, PgBouncer for connection pooling, and Citus for horizontal scaling. A key configuration decision in PostgreSQL clusters is whether to use synchronous or asynchronous replication, with the default asynchronous mode offering faster commits but risking data loss if the primary node crashes before replication completes.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Codebase Readability, Not Repo Structure, Is the Real Bottleneck for AI Agents

A developer argues that the more important question for AI-assisted coding is not whether a project uses a monorepo or multirepo, but whether the codebase is readable enough for agents to infer responsibility, locate files quickly, and verify changes reliably. The author notes that while monorepos offer genuine advantages — such as concentrated context and cross-boundary reasoning — simply collocating code in one directory does not deliver those benefits without structured tooling, dependency graphs, and enforced boundaries. In solo or small-team settings, the human coordination bottleneck that typically limits agent parallelism is largely absent, allowing a single developer to dispatch multiple agents simultaneously across features. The author illustrates this with a scenario of four agents working in parallel on API contracts, frontend fixes, database migrations, and test failures — all reconciled by one person without a review queue. The central takeaway is that directory layout, naming conventions, and feature clarity must be machine-readable as a prerequisite, regardless of repo shape.

0 comments Read more at DEV Community