Developer Builds Automated Real Estate Data Pipeline Across 14 Houston Counties

·7 views

A technical write-up describes how a developer integrated CrawlOS with Supabase to automate property data collection across 14 Houston-area counties. The system uses pg_cron for nightly job scheduling and scrapes Harris County Appraisal District records to produce roughly 125 qualified leads per run. The article covers the database schema design, crawler deployment patterns, and lead scoring logic. It also discusses challenges encountered when moving the prototype to production on self-hosted infrastructure.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

AdversaryGate patches six releases in four days after fixing fail-open merge-gate bugs

The author of AdversaryGate, a merge gate for coding-agent patches, shipped versions 3.0.0 through 3.0.6 after repeatedly finding ways the gate could wrongly approve changes. The bugs shared a pattern: an input the gate did not measure was silently skipped, letting the rest of the patch decide the verdict. Fixes included detecting tests that read code instead of running it, catching comment-only and no-op edits, refusing binary-marked diffs, and mutating every changed line and branch. Some changes, like handling the newline-at-EOF marker and raising timeouts and memory limits, addressed honest patches wrongly marked INCONCLUSIVE instead. Two releases, 3.0.2 and 3.0.3, were published with an API token, so versions before 3.0.4 were removed and releases now require signed tags and PyPI attestations.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Bienestar digital con IA: predecir el exceso de uso antes de que ocurra

The article argues that common screen-time apps like Screen Time, Digital Wellbeing, Freedom and Opal rely on static limits, reactive alerts and easily disabled blocks. It proposes a system built on an XGBoost forecaster that predicts next-day app usage and estimates when a user will hit a limit, along with a binge-risk score explained via SHAP. A transparent controller would gradually reduce usage toward a goal without cutting more than 10% per week, and an LLM coach would intervene at critical moments. The author reports a usage forecast R² of about 0.77 and a binge-risk AUC of about 0.79, which he deliberately left below higher benchmarks rather than manipulating the data.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Competitor prices vary by surface and fees, so one price per product misleads

A product's price is not a single figure, since the same item can cost different amounts on a retailer site, a marketplace, a grocery delivery service, and a delivery app. Each surface is set by different parties, including the seller's own margins, marketplace seller rules, and platform markups or fees. Storing one price field per product either overwrites useful data or averages it into a figure no customer actually paid. The author recommends recording each observation with its surface, location, fee components, and shopper context. Fee stacks can shrink or enlarge the gap between items: in one example, a 21.7% item-price gap narrowed to 9.1% once delivery and service fees were added.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Two Claude-related guides expired on Etsy and dropped from the catalogue

A small digital-products studio found two of its Claude-focused guides had expired on Etsy and disappeared from its catalogue. An alert on October 13 flagged the voice-coding guide, listing #138, after it expired the previous morning, and a similar alert on October 11 flagged the Supabase guide, listing #136. The alerts gave no reason for the expirations and included no sales or price figures, and the reviews of both listings were already waiting in the panel. The studio separately received a critical backup failure alert for its remote copy, though it is linked to the renewals only by timing. The account stresses that an expired Etsy listing leaves the catalogue the same morning, so renewal alerts need to arrive before the expiry date.

0 comments Read more at DEV Community