We're looking for a team that can build a scraping program for a website. Its based on the following ideas:
- It has to run 24/7
-It should monitor the whole site range
- The program should be able to monitor the websites simultaneously (i want to scale this into bigger)
- As soon as there are any website changes (new product, sizes restocked,..) the program should send a notification to a discord channel
- It should be able to support proxies
- It should be able to filter website changes with keywords (the program should only send a notification when there's a reliable product restocking. The notification should display: Link, Image of Product, Add to Cart Links, Sizes in Stock)
- written in python with the scrapy module.
- It should be as fast as possible
- I must be able to configure the program to certain sites as well as certain keywords.
- The program will check against keywords in the product titles as well description/title.
- The product should be licensed to me and you should be able to give me further support.
- I will most likely be looking to scale this program into bigger as soon as there are more websites i want to scrape
Please reach out to me, if you're interested in my project.