SShortSingh.
Back to feed

Developer reveals free method to scrape Shopify store catalogs via public endpoint

0
·1 views

Every Shopify storefront exposes its full product catalog through a built-in public URL endpoint that requires no API key, login, or captcha to access. The endpoint returns product details including prices, variants, tags, and images, and supports pagination of up to 250 items per page. A developer has published an open-source Python tool called Shopify Scout that automates this process, handling pagination, price analysis, and sale-signal detection for stores with thousands of products. The tool is MIT-licensed and freely available on GitHub, with potential uses including competitor price monitoring and product research. The developer notes that some stores disable the endpoint and advises users to only access stores they have permission to research and to respect each store's terms of service.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

mobx-react-form rebrands as mobx-formkit with v1.0.0 release on npm

The popular MobX form state management library mobx-react-form has been renamed to mobx-formkit, launching as version 1.0.0 on npm while retaining the same codebase and API from its final 7.1.0 release. The rebrand reflects the library's framework-agnostic nature, as it supports not just React but also Vue 3, Angular, Lit, Solid, and plain JavaScript. The old package name has been marked deprecated on the npm registry, with installations automatically redirecting users to mobx-formkit without breaking changes. The only notable breaking surface is for UMD bundle users, who must update file paths and global references from MobxReactForm to MobxFormkit. The renamed package also carries forward two new validation drivers introduced in 7.1.0 — Valibot and VineJS — alongside six existing drivers, all sharing a uniform validation lifecycle.

0
ProgrammingDEV Community ·

Developer Builds SwiftUI Puppy Training App with ElevenLabs AI Voice Coach

A developer has created Pawford Academy, a native iOS app built with SwiftUI designed to help dog owners track and log their puppy's training progress. The app integrates ElevenLabs' text-to-speech API to deliver AI-powered voice encouragement after each training session and mood selection. Users can set up a dog profile, choose from 16 breeds, log sessions for 10 classic commands, and monitor daily mood across six options. A paw print progress tracker marks milestones, and dogs that complete all sessions receive a personalized graduation certificate. The project was submitted to the DEV Community Weekend Challenge: Dog Days Edition, with source code publicly available on GitHub.

0
ProgrammingDEV Community ·

AgentForge Adds Three-Layer Error Recovery to Multi-Agent AI Pipelines

The AgentForge team published a technical post on August 16, 2026, outlining how failures cascade in multi-agent AI systems when one agent's timeout disrupts all dependent downstream agents. To address this, AgentForge implements three recovery layers: automatic retries with exponential backoff, circuit breakers that switch to cached fallback data after repeated failures, and dynamic re-planning by the orchestrator to skip, substitute, or halt failed steps. During a real incident last month, a market data API outage triggered the system's circuit breaker within one minute, automatically rerouting the pipeline to a delayed data feed and still delivering a complete report with a disclaimer. The API recovered at 15:00 and the circuit breaker closed automatically, requiring no manual intervention throughout. AgentForge positions this fault-tolerance architecture as a default feature rather than an optional add-on for production-ready multi-agent deployments.

0
ProgrammingDEV Community ·

Developer builds one-command health checker after silent crash loop hit 26 automation jobs

A developer discovered that nearly half of his 26 macOS launchd automation jobs had silently failed, with one stuck in a crash loop for six days in June 2026 without any alerts. The failure came to light only after a job loss eliminated his salary, revealing that side-income automation worth roughly ¥600,000 per month had been quietly degrading. macOS launchd does not alert users when a job crashes; it simply waits for the next scheduled run, making silent failures easy to miss at scale. To address this, the developer built automation-health.sh, a single script that checks nine categories of system health — including job status, log freshness, HTTP reachability, and file permissions — and exits with code 1 if any item fails. The script is designed to integrate with Claude's StopHook and cron so that health verification happens automatically, removing the need for manual checks.