Data Miner Suite
← All case studies

Real Estate · A regional prop-tech app

Real-estate listing feed for a regional prop-tech app

Hourly listing feed across 4 brokerage portals — fully geocoded, deduplicated and pushed to a hosted JSON endpoint.

Refresh cadence

60 min

Sources unified

4 portals → 1 feed

Pipeline uptime

99.7%

The challenge

The app needed a 60-minute-fresh feed of residential listings across 4 brokerage portals. The portals used a mix of server-rendered HTML, infinite-scroll JS and a clunky internal API — none consistent enough to consume directly.

What we built

We built a 4-scraper pipeline running on a 60-minute cron, each handling its source's quirks (login flow, scroll injection, API stitching). Outputs flow into a hosted JSON endpoint with consistent shape — single source of truth for the mobile app.

The outcome

Listings now refresh in 60-minute cycles with 99.7% uptime. The mobile team retired their three previous integrations and ship feature work twice as fast against the unified feed.