← Projects
Archived2023
Auto Website Creator
Web scraper that created new beautiful websites for niche SMEs
Built a web scraping pipeline that obtained information on all niche businesses in a specific area and then used all of the existing data online about the business to create an on brand website automatically.
Even if they had a website already, the program would use that as a base and identify shortfalls of the site and create more responsive and engaging websites.
It handled anti-scraping measures, rate limiting, and data normalisation across sites with different page structures.
What I learned
Web scraping at scale, dealing with anti-bot protections, building reliable scheduled pipelines, and knowing when a side project has served its purpose.
Tech
PythonWeb ScrapingWebsite DesignAI Agents