I am thinking of creating a job board system that scrapes data from company official career pages
Hi all,
I am thinking of creating a job board system which
- scrapes the job data from the company's official pages
- do not encourage third-party talent acquisition firms to spam with duplicate posts
How do I make money?
- Selling home page slots to the companies that promotes high visibility
Do you guys think this will work?
Talking product sense with Ridhi
9 min AI interview5 questions
i’m working on something similar. wanna catch up?
@lezgooomuthafucka - yes, please DM
nhi chalega, all other platforms doing the exact same thing
@samosa yeah... linkedin, indeed, google are already scraping I think
Good initiative 🫡
Google has one similar to this. I tried this few years ago for a client. Only problem you will face is site limiting which you can bypass using Residential Proxies. If you are using Python there is a library called "cloudscraper". It works really well to unblock a lot of websites without having to use proxy.
You should think of implementing a queue based approach (Redis + RabbitMQ) to handle all the traffic and have retry mechanism.
While in my last yrs I also thought of making something similar but it included many more things
Interested would like to collaborate.
I have been thinking of something similar. Like a website or an chrome extension to get internships/ jobs alert by scraping data from company's portals. I am new to learning web development but have been brain storming the ideas. It is it good or bad? Or can anyone give me some ideas which are different than regular ones