
Building Biggest Web Scraping Project Yet
Currently building an application to make web scraping way easier — aiming to simplify the entire workflow for developers.
It’s one of my biggest projects so far, and honestly… a bit nervous about how it will turn out. But excited to keep building! 🚀

I was doing same in my last job, can you share more or can we connect in dm

-
My application is going to be a desktop app.
-
It comes with its own built-in browser.
-
Users just need to enter the website or page link they want to scrape.
-
The app has a split-screen view:
Left side → shows the live website.Right side → shows the filtered HTML along with tabs where users can interact with AI to give scraping commands.
-
The HTML view is super-cleaned, showing only the useful elements.
-
The app provides interactive tools to let users select elements directly from the live site. Once an element is selected, the application automatically detects and scrapes all similar elements.
-
More tools will be included to make scraping even easier.
🚧 The project is still in progress, but I’ll share updates soon.