SShortSingh.
Back to feed

Larascraper unifies Laravel web scraping across HTTP and headless browser in one API

0
·4 views

Larascraper is a new Laravel package by Eduardo Lazaro that consolidates HTTP-based and JavaScript-rendered web scraping into a single unified toolchain. Previously, developers had to juggle Guzzle for static HTML pages and Puppeteer scripts for JavaScript-heavy sites, requiring separate mental models and glue code. The package introduces a Scraper class and a Crawler class, allowing developers to fetch pages, interact with browser elements such as clicking, typing, and scrolling, and extract structured DOM data using a fluent query-builder interface. It supports both a Puppeteer-backed headless browser driver and a lightweight HTTP driver, with the driver switchable per request using a simple method call. Optional waits and configurable timeouts give developers control over how the scraper handles empty or slow-loading results without throwing errors.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Skills Guide, Plugins Enable: Why AI Agent Tools Need Real Executable Motors

A developer and researcher argues that AI agent ecosystems are misusing terms like skill, plugin, and tool as if they were interchangeable, when they serve distinct roles. A skill should teach an agent how to use a capability, while a plugin must actually make that capability available through executable components. The author identifies a problem called "context debt," where agents accumulate excessive Markdown instructions that consume model attention before any real work begins. Using a memory plugin as a case study, the piece shows how even well-architected plugins can fail when activation instructions double as dispatch orders rather than simply enabling capabilities. The proposed solution distinguishes clearly between skills as focused guidance, plugins as distribution units, and tools as bounded operations with inputs, outputs, and verifiable evidence.

0
ProgrammingDEV Community ·

Guide: Deploy Self-Hosted n8n Automation Tool on a Budget European VPS

A technical guide published on DEV Community outlines how to self-host the n8n workflow automation tool on a low-cost European VPS priced at €3.99 per month. The tutorial uses Docker Compose as the primary deployment method, making the setup accessible to developers familiar with containerization. Self-hosting n8n allows users to maintain full control over their automation workflows and data without relying on cloud-based subscription plans. The guide targets developers and hobbyists looking for a cost-effective alternative to managed n8n hosting services.

0
ProgrammingDEV Community ·

Alienware m17x (2008) Revived as Linux DJ Workstation Using Mixxx and PipeWire

A developer has repurposed a 2008 Alienware m17x laptop — equipped with a Core 2 Duo processor, 4GB RAM, and an SSD — as a dedicated Linux-based DJ workstation running Mixxx. The project aimed to sustainably reuse aging hardware while building a stable audio environment. A key challenge arose when the USB audio interface was found to support only an unusual 46875 Hz sample rate, incompatible with standard rates of 44100 Hz or 48000 Hz, causing direct ALSA hardware access to fail. The fix involved enabling ALSA plug extensions via PipeWire to allow automatic sample-rate conversion, triggered by setting the environment variable PA_ALSA_PLUGHW=1 before launching Mixxx. The developer also adjusted the KDE application launcher to apply this variable persistently, resulting in stable USB audio output.