SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

Developer launches Tokopedia scraper at $0.005 per result, undercutting rivals by 5x

0
·1 views

A developer known as Prime Sieve has built and published a lightweight Tokopedia search scraper on the Apify platform, priced at a flat $0.005 per result. The tool bypasses the need for a headless browser by directly querying Tokopedia's public GraphQL endpoint, making it significantly cheaper and simpler to run than existing alternatives. Existing scrapers for Indonesia's largest e-commerce marketplace use opaque, tiered per-1,000-result pricing, which the developer argues is unnecessarily complex for smaller data users. The scraper is live now under the handle premium_exist/tokopedia-search-scraper, though it currently has no users. The developer notes the project is a small, deliberate bet that transparent flat-rate pricing and simple, reliable code will appeal to those who need marketplace data without enterprise-level costs.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Developer shares AI-assisted coding workflow that reduced bugs and improved output quality

A software developer has shared a structured AI coding workflow after struggling for five to six months with poor results using agentic IDEs like Cursor. The developer attributed earlier inefficiencies to passively accepting AI-generated plans without proper direction or review. The improved workflow centres on five prompt-based commands — including grilling, spec writing, ticket breakdown, implementation, and handoff — credited to a method popularised by Matt Pocock. A key practice involves keeping AI context windows lean by starting fresh sessions for each ticket, which the developer says keeps model responses sharper and more accurate. After several months of applying this approach, the developer reports significantly fewer bugs and a noticeably higher quality of implemented features.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Swarm: Open-Source Rust Framework Unifies Multi-Agent Orchestration and LLM Gateway

A developer has released Swarm, an open-source AI framework written in Rust that combines multi-agent orchestration and an LLM model gateway into a single unified system. The project addresses a common infrastructure problem where agent orchestration and LLM request routing are handled by two separate, unrelated frameworks. In its orchestration mode, Swarm uses a Planner Agent to generate execution plans, an Executor Agent to manage task workflows, and domain-specialist agents that interact with tools via the Model Context Protocol. Its gateway mode exposes an OpenAI-compatible API endpoint that supports multi-provider routing across services like Groq, Google Gemini, OpenAI, and local backends such as Ollama and vLLM. Both modes run on a shared Tokio async runtime, with type-safe inter-agent messaging and a built-in LLM-as-a-Judge evaluation loop for output verification.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Elixir Tutorial Builds OTP-Style Supervisor From Scratch Using Core Primitives

A hands-on tutorial series on building distributed systems in Elixir has reached its fifth installment, focusing on constructing a basic process supervisor without using OTP or GenServer. The guide demonstrates how exit trapping via Process.flag(:trap_exit, true) converts crash signals into mailbox messages, enabling a parent process to detect and respond to worker failures. Using only spawn_link, send, and receive, the tutorial builds a manual supervisor that manages two worker processes and restarts only the one that crashes, leaving healthy siblings unaffected. This minimal one-for-one restart strategy mirrors the policy provided by OTP's built-in Supervisor module. The stated goal is to help developers understand the underlying mechanisms that OTP abstracts, rather than to replace the framework itself.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Engineering team slashes AI context file from 548KB to 34KB using built-in load controls

A development team reduced their CLAUDE.md configuration file from 548KB to 34KB after discovering it was loading over 150,000 tokens into context before any task began. The team found that splitting the file using imports provided no relief, as imported files still load fully at session start. The key fix involved moving procedural runbooks into skills — which only load when invoked — and shifting code conventions into path-scoped rules files that activate only when relevant files are opened. A commit gate was built to catch regressions, though one issue still reached production before being identified. The migration preserved all original instructions while dramatically cutting the per-session startup cost.

0 comments Read more at DEV Community