Scraping AI SDK Uses LLMs to Extract Web Data Without CSS Selectors

·5 views

A Python SDK called Scraping AI offers a way to extract structured data from webpages without relying on CSS selectors, which often break when sites update their frontend code. Instead of targeting specific DOM elements, users define a JSON Schema describing the data they want, and the tool handles the rest. The extraction pipeline renders pages using headless Chromium if needed, converts content to Markdown, and uses large language models like GPT-4o or Gemini to match content to the schema. The final output is validated JSON, making it compatible with AI frameworks such as LangChain and LlamaIndex. The SDK is installable via pip and offers 200 free tokens without requiring a credit card.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Strong CSS architecture starts with defining what CSS should never do

A DEV Community article argues that the foundation of robust CSS architecture lies not in defining capabilities, but in declaring explicit exclusions upfront. The author illustrates how design token systems quietly accumulate misuse — such as storing application state inside CSS custom properties — because nothing in the system is built to refuse such decisions. Without predefined boundaries, stylesheets gradually absorb logic and state that belong elsewhere, making systems harder to maintain over time. The piece contends that exclusions are not gaps in architecture but its most durable component, acting as guarantees rather than limitations. A system that never defines what it will not do, the author warns, will eventually be pressured into doing everything.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer releases open-source npm package for Bangladesh geographic data

A developer has published an open-source npm package called @olism/bd-geo, providing structured geographical data for Bangladesh in JavaScript and TypeScript. The package covers the country's full administrative hierarchy, including divisions, districts, upazilas, areas, and villages. It is designed to eliminate the need for individual developers to source, clean, and maintain their own Bangladesh location datasets. Potential use cases include address forms, e-commerce delivery systems, real-estate platforms, and location-based applications. The project is available on npm and GitHub, and the author is actively seeking community feedback and contributions to improve the dataset and documentation.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

GDPR, HIPAA, SOC 2: What Regulated Industries Must Know About Password Managers

Organizations in regulated industries such as healthcare, finance, and tech must ensure their password managers comply with frameworks like GDPR, HIPAA, and SOC 2, as non-compliance can carry severe legal and financial penalties. GDPR, which covers any entity processing EU residents' personal data, mandates features such as zero-knowledge architecture, data portability, breach notification within 72 hours, and signed data processing agreements with vendors. HIPAA applies to healthcare organizations and their business associates, requiring that any password manager storing credentials linked to protected health information meet strict encryption and access control standards. SOC 2 provides a third-party audit framework validating that a service provider's security controls meet defined trust principles, offering organizations independent assurance of a vendor's security posture. When evaluating a password manager, key compliance indicators include AES-256 encryption, role-based access controls, audit logging, data residency options, and documented incident response procedures.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Good CSS Architecture Requires Defining What CSS Should Never Do

Strong CSS architecture depends not just on what a system can do, but on explicitly deciding what it must never do. Without declared exclusions, systems tend to accumulate unintended responsibilities over time, such as storing application state inside design tokens. A custom property tracking modal state looks syntactically identical to a spacing token, yet represents a fundamentally different concern that CSS has no business managing. Since browsers cannot distinguish between the two, the refusal must come from deliberate architectural decisions made in advance. Systems that define clear boundaries and exclusions are more maintainable and resilient than those that only react after problems emerge.

0 comments Read more at DEV Community