← Projects
Archived2022
Online Deals and Business Info Scraper
Automated web scraper that tracked expiring deals across major South African retailers
Built a web scraping pipeline that monitored major South African e-commerce sources for heavily marked-down deals approaching expiry. The system pulled pricing data on a schedule, filtered for deals meeting specific discount thresholds, and could automatically place orders on qualifying items.
It handled anti-scraping measures, rate limiting, and data normalisation across sites with different page structures.
What I learned
Web scraping at scale, dealing with anti-bot protections, building reliable scheduled pipelines, and knowing when a side project has served its purpose.
Tech
PythonWeb ScrapingAutomationScheduling