Why Large Terraform State Files Slow Teams Down and How to Fix Them

·1 views

As Terraform projects grow, state files managing hundreds or thousands of resources cause plan times to balloon, with some users reporting 20–25 minutes for states containing around 2,900 resources. Every terraform plan refreshes all resources via API calls regardless of whether their configuration changed, creating a sequential bottleneck that worsens with each new resource added. Large shared states also trigger cloud API rate limits from providers like AWS, Azure, and GCP, sometimes causing plans to fail entirely due to throttling. Beyond performance, a single large state file creates a wide blast radius where unrelated resources can be accidentally modified or destroyed in the same apply. Splitting infrastructure into smaller, purpose-specific state files is identified as the structural solution, while proposals for partial-refresh features in Terraform and OpenTofu remain unimplemented.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

How to Split a Terraform Monolith into Smaller, Focused State Files

Large Terraform states can slow down plans, widen blast radius, and cause conflicts when multiple teams work simultaneously. The recommended approach is to group resources by lifecycle and ownership into logical boundaries such as networking, compute, application, and monitoring layers. Engineers can migrate resources between states without destroying them using the terraform state mv command, moving one logical group at a time and verifying plans after each step. Once split, cross-state dependencies must be rewired by replacing direct resource references with input variables and module outputs. Tools like remote state data sources or dependency management platforms can then be used to pass output values across the separate state files.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

TRON Vanity Address Generator Lets Users Create Custom Crypto Wallet Addresses

A new tool at tronsec.io/app allows users to generate custom TRON wallet addresses that begin or end with a chosen pattern, such as a name or project ticker. Vanity addresses are standard blockchain wallets created by brute-forcing cryptographic key pairs until one matches the desired sequence, with no added security vulnerability. Proponents argue they offer practical benefits on the TRON network, including reduced phishing risk, easier visual verification, and brand recognition for projects and payment processors. The computational cost of generating such addresses rises sharply with each additional character, since TRON's Base58 encoding multiplies the search space by roughly 58 per character. Security experts advise users to ensure private keys are generated locally on their own device and never transmitted to an external server.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Context Engineering Emerges as AI's Next Key Discipline Beyond Prompt Engineering

At the AI Engineer World's Fair in San Francisco, context engineering — the practice of managing an AI model's working memory — drew massive developer interest, with hundreds lining up for a dedicated workshop. The discipline addresses a core limitation identified by HumanLayer's Dex Horthy, who observed that AI agents degrade in performance after consuming roughly 100,000 tokens, about 10% of their available context window. Unlike humans, who deepen understanding through extended conversation, AI models lose focus as their context windows fill, making careful memory management a practical necessity for developers. MLH co-founder Ben Halpern described context engineering as the latest optimization frontier, helping developers improve latency, reduce costs, and treat models less like black boxes. However, Codex developer experience lead Dominik Kundel cautioned that overly strict context management can limit an agent's range, advocating instead for giving agents broad, unfiltered access to sources like Slack and Notion so they can navigate complexity independently.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Cloudflare Workers Enable Flicker-Free A/B Testing at the Network Edge

Traditional client-side A/B testing causes visible content flicker and harms Core Web Vitals by executing JavaScript after a page loads in the browser. Cloudflare Workers address this by intercepting requests at the edge and delivering the correct HTML variant before it ever reaches the user's browser. Using cookie-based session assignment and a tool called HTMLRewriter, developers can modify headlines, calls-to-action, and meta tags in real time without touching the origin server. Companies adopting this approach, such as Ninetailed, report 2–3x cost savings over conventional serverless platforms alongside lower latency. Developers have also noted a secondary benefit: SEO-related HTML changes like meta tag updates can be applied at the edge without triggering a full code deployment.

0 comments Read more at DEV Community