Back to all work

Marketplace intelligence, GCC · Market intelligence

Zellij Scrape Grid

60k listings normalised nightly

Client
Marketplace intelligence, GCC
Sector
Market intelligence
Year
2026
Timeline
4 weeks
Developer's screen reflecting lines of code
Photo: Programmers Reflection on Screen Showing Code — qubodup, CC BY 2.0 · source

The brief

Pricing analysts needed a clean, daily view of sixty thousand competitor listings across five marketplaces — spreadsheets copied by hand were already wrong by lunchtime.

What we built

  • A Playwright grid that rotates through the five marketplaces with polite rate limits
  • Normalisation into one product model: currency, VAT, shipping and variant matching
  • Anomaly alerts when a competitor moves price more than a set threshold
  • Nightly loads into the warehouse with full run history and replayable failures

Stack

  • Playwright
  • Python
  • Scheduled jobs

Results

listings nightly
60k
job success rate
99.4%
full sweep
11 min

Start a similar project

Tell us the problem behind this kind of build and we'll come back with a scope, a range and a date.

Start your project