Site-wide outage traced to an unbundled import and a bash pipe that masked test failures
On November 5, 2026, a push to main caused every request to the since.dev site to return a 500 error from 9:35 to 9:43 MST. The site's middleware imported helper files that the hosting provider did not bundle, so the file failed to load in production even though unit tests passed, because the test runner resolves imports automatically. The fix moved the helpers inside the file, and a build check and dated comment were added to prevent the import from being reintroduced. A separate incident involved a shell pipeline whose exit code came from grep rather than the test runner, so a failing test still allowed a commit to proceed. The author notes that tests can pass in an environment that differs from production and that pipeline exit codes can hide failures.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in