SShortSingh.
Back to feed

Microsoft's MarkItDown converts documents to Markdown for LLM pipelines, but silently fails on scanned PDFs

0
·1 views

Microsoft's open-source Python library MarkItDown converts files such as PDFs, Word documents, Excel spreadsheets, PowerPoint presentations, HTML, and EPUBs into Markdown format using a single function call. The tool is designed specifically for LLM and text analysis pipelines, prioritizing machine-readable output over visually faithful reproduction. A developer tested the library across 14 file types using version 0.1.8 on Python 3.12, finding that text-based documents convert cleanly while tables may require minor cleanup. The most significant limitation discovered is that scanned PDFs — which lack a text layer — return nearly empty output with no error raised, making silent failure detection a manual step. The library is installable via pip and requires Python 3.10 or higher, though installing the full extras bundle may inadvertently pull a pre-release dependency that downgrades the package version.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

n8n Workflow Uses Threat Scores and Four Branches to Filter Signup Fraud

A tutorial published on DEV Community outlines a more reliable signup fraud detection workflow built in n8n, replacing simple VPN boolean checks with a 0–100 threat score system. The workflow uses a webhook, a single IP lookup node, an override check, and a Switch node with four output branches covering allow, review, friction, and block actions. Three common failure cases are highlighted: corporate gateways like Zscaler that share IPs across entire workforces, privacy relays such as iCloud Private Relay that do not trigger standard VPN flags, and residential proxies that may evade datacenter-only checks. The IP lookup returns 28 security fields, including proxy and VPN confidence scores, which allow more nuanced routing decisions than a single flag permits. Each security lookup costs 2 credits, meaning a 150,000-credit monthly plan can cover up to 75,000 scored signups, and the author estimates build time at under one hour.

0
ProgrammingDEV Community ·

How to Inspect SSL Certificates and CSRs Safely Without Exposing Internal Data

During a Kubernetes cluster migration, a misconfigured Certificate Signing Request missing wildcard Subject Alternative Names triggered a browser certificate error, highlighting a common operational pitfall. To diagnose such issues, many engineers paste CSRs or certificates into online decoder tools, which poses a significant security risk. Internal certificates often contain sensitive metadata such as hostnames, infrastructure endpoints, and private keys that can be logged or stored by third-party servers. X.509 certificates are ASN.1 data structures encoded in DER binary format and wrapped as PEM files, meaning they can be parsed locally without relying on remote tools. Understanding the underlying Tag-Length-Value structure of these certificates enables developers to inspect them safely in-house, avoiding exposure of internal network topology to unknown parties.

0
ProgrammingDEV Community ·

Five Security Gaps Putting Small Business Remote Workers at Risk

Small businesses running remote or hybrid work arrangements often leave company data exposed through weak passwords, unpatched devices, and untested backups, according to a security guide aimed at non-specialist IT staff. The most impactful first step recommended is enabling multi-factor authentication on business email, since email access can unlock nearly every other account. Phishing risks are heightened for remote workers who lack nearby colleagues to cross-check suspicious messages, making written verification policies for financial requests essential. Businesses should follow the 3-2-1 backup rule and regularly test restores, rather than assuming backups are functional. In New Mexico specifically, the state's Data Breach Notification Act requires businesses holding residents' personal data to maintain reasonable security and notify affected individuals after a breach.

Microsoft's MarkItDown converts documents to Markdown for LLM pipelines, but silently fails on scanned PDFs · ShortSingh