All Shopify Stores Expose Public Product Catalog Endpoint by Default

·1 views

Every Shopify store hosts a publicly accessible JSON endpoint at /products.json that returns full product catalog data including titles, prices, SKUs, variants, and inventory status without requiring authentication or bypassing any anti-bot measures. A developer discovered this built-in Shopify feature and built a simple Python scraper using just ten lines of code to paginate through and collect an entire store's catalog. The endpoint supports up to 250 products per page and can be tested live on stores like Kith.com via a basic curl command. Not all stores leave the endpoint fully open — some large retailers disable it or apply rate limiting — and inventory data exposure is at the store owner's discretion. The developer notes potential use cases including competitor price monitoring, dropshipping research, and catalog analytics, and has published the tool as a free Apify actor.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Developer Uses AI Agent to Stress-Test Handoff Prompts Before Passing Them to Worker AIs

A developer building an app with Claude Code discovered a critical flaw in their multi-agent workflow, where one AI session writes instructions and separate AI sessions implement them in parallel. Before passing instructions to worker agents, they began routing prompts through a dedicated 'demolition' subagent tasked with finding weaknesses. The adversarial agent caught two significant issues: a test marked as a completion condition that passed even when the underlying feature failed, and a referenced config flag that was never actually connected to any code. Both flaws had been written with full confidence by the developer, who had not re-read the relevant code before drafting the instructions. The experience highlights that handoff prompts function as specifications, and a quick adversarial review against the actual codebase can prevent costly implementation errors downstream.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Why the Number 60 Is the Only Parameter You Need for Search Fusion

Reciprocal Rank Fusion (RRF) is an algorithm that combines multiple ranked search result lists — such as those from BM25 keyword search and vector-based semantic search — into a single unified ranking. It relies on just one parameter, k, which has been set at 60 since the method's original research paper and has proven effective across datasets without further tuning. The formula scores each document by summing 1/(k + rank) across all input lists, meaning documents ranked highly by multiple retrievers naturally rise to the top. A key advantage is that RRF operates on rank positions rather than raw scores, eliminating the need to reconcile incompatible scoring scales from different retrieval systems. Principal data engineer Vinicius Fagundes highlights RRF as an example of robust, low-maintenance engineering, noting that teams often waste time tuning fusion weights that a decades-old constant already handles well.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How MiniMaxH3.app Built Distinct Workflows for Text, Frame, and Multi-Reference Video

Developers building MiniMaxH3.app, an independent third-party studio around the open-weight MiniMax H3 video model, found that text-to-video, first/last frame, and omni-reference generation each require separate input handling rather than a shared form. The team designed three distinct workflow modes — t2v, flf, and omni — that translate user intent into backend request types only at the moment of generation, with graceful fallbacks when expected media is missing. For the first/last frame workflow, frame order is treated as semantically meaningful, since swapping start and end images changes the motion being requested. Prompt inputs are capped at 7,000 characters, with fixed duration and aspect ratio options to keep output predictable and cost transparent. The studio also reserves credits before generation begins without charging users for jobs that fail, addressing a common pain point in AI video tooling.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Unmanaged Context Windows Are Quietly Degrading Production AI Agent Pipelines

Multi-step AI agent pipelines often perform well in testing but degrade gradually in production due to unchecked context window growth, according to software engineering observations from consulting work. With each pipeline step, tool outputs and reasoning traces accumulate in the conversation history, consuming an increasing share of the model's available context. By the final steps of a seven- or ten-step pipeline, the model may have little token budget left for the actual task at hand, leading to shorter, vaguer outputs without any visible errors or crashes. Single-query testing masks this problem because each test run starts with a fresh, zero-token context, unlike real production sessions where users run sequential tasks. Recommended fixes include allocating fixed token budgets per step, passing only structured outputs between stages rather than full reasoning traces, and summarizing context before handoffs to prevent irrelevant history from diluting model attention.

0 comments Read more at DEV Community