Closed

scraping / web crawling with python on a website

We're looking for a team that can build a scraping program for a website. Its based on the following ideas:

- It has to run 24/7

-It should monitor the whole site range

- The program should be able to monitor the websites simultaneously (i want to scale this into bigger)

- As soon as there are any website changes (new product, sizes restocked,..) the program should send a notification to a discord channel

- It should be able to support proxies

- It should be able to filter website changes with keywords (the program should only send a notification when there's a reliable product restocking. The notification should display: Link, Image of Product, Add to Cart Links, Sizes in Stock)

- written in python with the scrapy module.

- It should be as fast as possible

- I must be able to configure the program to certain sites as well as certain keywords.

- The program will check against keywords in the product titles as well description/title.

- The product should be licensed to me and you should be able to give me further support.

- I will most likely be looking to scale this program into bigger as soon as there are more websites i want to scrape

Please reach out to me, if you're interested in my project.

Skills: Django, PHP, Python, Software Architecture, Web Scraping

See more: website scraping web services, python programming web bot project website, scraping web python, keywords website web crawling php, python website scraping, scraping web con python, web crawling website, bot crawling flash website scraping data xml file, python scraping web page, python web crawling, we are a crowdfunding website we are looking to revamp the site so its more user friendly, we have the logo available in all colours you can see on the original website, we require a redesign of our website primarily redesigning the front page the other content pages will use the front page as a t, we would like to build a concert listing website we want someone to customize a template for us to make it a concert listing web, whats the best web to desing website for earning money, how do we develops the website, the world best web developer information website, we designed the groovychimp website, Web crawling/scraping, web crawling, web scraping

About the Employer:
( 0 reviews ) Germany

Project ID: #17523610

42 freelancers are bidding on average $531 for this job

SoftDevelopINC

Hello , I would like to join your project because Django framework is my best skill . I have 5 years experience with Django, I familiar with REST APIs (5 years), good at SQL knowledge and design databases system (5 More

$1000 USD in 10 days
(299 Reviews)
8.6
mingxiao2008

Hello , Dear How are you? I am very interested in your project and am ready for starting your project for now. I have experienced in developing Django, PHP, Python, Software Architecture, Web Scraping. I will work More

$555 USD in 10 days
(113 Reviews)
8.2
SigmaVisual

Hi, I have extensive experience of working on similar scraping projects for products price, stocks details. I can help to develop a script in python according to your requirements. Please let me know for what websites More

$250 USD in 7 days
(286 Reviews)
8.2
creativewebideas

Hi, We have extensive development experience in Django Python, below are the details of our recent experience. Development of different portals which includes ACL - Role base user login API integration( like More

$555 USD in 10 days
(186 Reviews)
8.0
Vlzinch

Hi, sneakercooks! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can complete your project. Please contact me to discuss project details, Be More

$740 USD in 10 days
(73 Reviews)
7.9
AzzkaNoor

Bonjour! It is my humble offer to present my services to you for this project. I have passed 15 certifications here (& with 5-star rating) and your project's domain resides in my area of expertise. I have few questio More

$555 USD in 10 days
(43 Reviews)
7.6
asin1987

Dear employer, I will write an app that will monitor your website 24*7 for new stock, will work for proxies and captchas and will do everything you need. Which website is it that you want to scrap? I will do your More

$750 USD in 10 days
(180 Reviews)
7.5
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$388 USD in 5 days
(109 Reviews)
7.4
mmadi

Dear sneakercooks, I have gone through your project "scraping / web crawling with python on a website". Relevant Skills and Experience Having skill set in Django, PHP, Python, Software Architecture, Web Scraping w More

$525 USD in 12 days
(45 Reviews)
7.0
bestit4u

Hi I am very,very interested in your project My name is Shan Bin and I'm a Chinese developer. I have 6 years of web scraper development experience such this projects. And I have good skills with this program languag More

$333 USD in 10 days
(126 Reviews)
7.3
phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database More

$722 USD in 10 days
(89 Reviews)
7.4
etuannv

Hi there, I have 4+ years experience at Web scraping. I think I can do your project. I would approach your project by using Python with Selenium to automate web browser and get the data. If you'd like to view my prev More

$494 USD in 10 days
(92 Reviews)
6.7
devops724

hi there I have 10 years experience in Python and PHP web development. I did lots of projects in web world, develop in most web technologies. 8 years developing Django sites and services. I did lots of projects in More

$555 USD in 10 days
(75 Reviews)
6.5
schoudhary1553

Hello, I can help with you in your project scraping / web crawling with python on a website I have more than 5 years of experience in Django, PHP, Python, Software Architecture, Web Scraping. We have worked on se More

$1000 USD in 10 days
(85 Reviews)
6.7
lightingdavid

Hello. I have rich experiences in Web scrapping. I have good skills in Python, C#, PHP, etc and i'm very interest to your project. Contact me please. Thanks.

$250 USD in 10 days
(172 Reviews)
6.5
tangramua

Hi, my name is Oleksii. I can help you to create a scraping program. I have 19 years' experience in Web Development and Programming. I would like propose partnership with our company Tangram for your project. My te More

$750 USD in 10 days
(32 Reviews)
6.1
Batista111

Hi, I had 5-year experience with Python, Laravel, Angular js, Node.Js, and Java so its easy and simple task for me. Please send me project complete requirement to start working on it. Please take a look at our so More

$833 USD in 10 days
(109 Reviews)
6.6
mikeitexpert

I have extensive experience in web scrapping using two well-known techniques: headless browsing, and scrapy/ web requests. I can easily tailor each solution to best identify changes in the target website and downlo More

$383 USD in 12 days
(69 Reviews)
5.4
rishiajmera

Hello, Greetings! I have gone through your requirement and I understand it. With a proven track record of successful achievements, I am pleased to present my application for your consideration as a Freelancer. More

$555 USD in 10 days
(57 Reviews)
5.5
invincible1428

Hello, Greetings of the day.!! Your project attracted my attention at first glance, because I've really rich experience in Machine Learning & Python Programming. I have worked on several similar projects before! I'm More

$388 USD in 5 days
(38 Reviews)
5.5