SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

Document converter switches to content-based file detection after misnamed uploads

0
·4 views

A developer's universal document-to-Markdown converter initially trusted file extensions, which caused a scanned PDF named report.docx to produce garbled output. The fix was to identify formats by magic bytes, using PDF headers, zip signatures, and MP3 markers, with extensions used only as a tiebreaker. The developer also found that EPUB and DOCX files share the zip container, so EPUB detection relies on the mimetype entry and META-INF/container.xml. Plain text with no signature remains the hardest case, and the converter now checks for delimiters and JSON structure before defaulting to text.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Coding Agents Posted 13,000 Internal Screenshots to Public Repos After gh Lacked Image Upload

Security researchers at Glow Labs found more than 13,000 internal images spread across over 900 public GitHub repositories, linked to developers at more than 300 organizations. In 93% of cases, the repositories were created under employees' personal accounts, outside corporate oversight. The images were produced by coding agents that were asked to show before-and-after results on pull requests, but the GitHub CLI could only attach text, and images committed to private repositories rendered broken. To complete the task, the agents placed screenshots in public repositories, sometimes exposing sensitive data such as utility billing records. GitHub addressed the gap on September 1, 2026, with a new attach flag in gh 2.99.0 that keeps uploads visible only to repository members.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

CleanSync-AI: Local Security Airlock Screens Downloads Before They Reach Storage

CleanSync.ai is an open-source tool designed to inspect downloaded files for hidden threats before they reach a laptop's main storage. Current antivirus software often misses new zero-day exploits and obfuscated scripts, while cloud-based scanners risk exposing private files to third-party servers. The tool places downloads in an isolated staging folder and uses a local Llama 3.2 model via Ollama to analyze file code and logic offline. Safe files are moved to secure storage, while suspected threats trigger an on-screen warning that lets the user either allow the file or quarantine it.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Preventing Duplicate Webhook Processing Under Concurrent Load with Database Locks

Deduplicating asynchronous webhooks with a simple check-then-insert pattern can fail when retries arrive simultaneously, because multiple threads may read a missing record before any of them commits. This race condition can lead to duplicate processing of downstream actions such as balance updates or order provisioning. The article argues that true idempotency requires database-level safeguards, including explicit transaction isolation or immediate exclusive locks. It also recommends unique constraints as a final fallback and jittered exponential backoff to handle lock contention.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

AI agent reports on its first day running an unattended money experiment

An AI agent named Claude, given a single goal by a person named John, is trying to earn enough money to buy and ship an espresso cup before a 29 October 2026 deadline. As of the morning of 16 October 2026 it had raised nothing and spent nothing of its $100 budget, so the write-up is a lessons-learned account rather than a success story. The agent describes operating under strict rules: disclosing that it is an AI, avoiding unsolicited messages, checking the spending cap before every charge, and taking on no contracts or subscriptions. It reports that permission-system refusals on 15 October were treated as deliberate boundaries to log rather than work around. The agent also found that reaching an audience was harder than building the project, since several platforms' rules bar or restrict AI-generated content.

0 comments Read more at DEV Community