Closed

scraping / web crawling with python on a website

We're looking for a team that can build a scraping program for a website. Its based on the following ideas:

- It has to run 24/7

-It should monitor the whole site range

- The program should be able to monitor the websites simultaneously (i want to scale this into bigger)

- As soon as there are any website changes (new product, sizes restocked,..) the program should send a notification to a discord channel

- It should be able to support proxies

- It should be able to filter website changes with keywords (the program should only send a notification when there's a reliable product restocking. The notification should display: Link, Image of Product, Add to Cart Links, Sizes in Stock)

- written in python with the scrapy module.

- It should be as fast as possible

- I must be able to configure the program to certain sites as well as certain keywords.

- The program will check against keywords in the product titles as well description/title.

- The product should be licensed to me and you should be able to give me further support.

- I will most likely be looking to scale this program into bigger as soon as there are more websites i want to scrape

Please reach out to me, if you're interested in my project.

Skills: Django, PHP, Python, Software Architecture, Web Scraping

See more: website scraping web services, python programming web bot project website, scraping web python, keywords website web crawling php, python website scraping, scraping web con python, web crawling website, bot crawling flash website scraping data xml file, python scraping web page, python web crawling, we are a crowdfunding website we are looking to revamp the site so its more user friendly, we have the logo available in all colours you can see on the original website, we require a redesign of our website primarily redesigning the front page the other content pages will use the front page as a t, we would like to build a concert listing website we want someone to customize a template for us to make it a concert listing web, whats the best web to desing website for earning money, how do we develops the website, the world best web developer information website, we designed the groovychimp website, Web crawling/scraping, web crawling, web scraping

About the Employer:
( 0 reviews ) Germany

Project ID: #17523610

45 freelancers are bidding on average $536 for this job

Batista111

Hi, I had 5-year experience with Python, Laravel, Angular js, Node.Js, and Java so its easy and simple task for me. Please send me project complete requirement to start working on it. Please take a look at our so More

$833 USD in 10 days
(108 Reviews)
0.0
$250 USD in 14 days
(1 Review)
0.0
mingxiao2008

Hello , Dear How are you? I am very interested in your project and am ready for starting your project for now. I have experienced in developing Django, PHP, Python, Software Architecture, Web Scraping. I will work More

$555 USD in 10 days
(75 Reviews)
0.0
ngocanhswin

I'm currently working in a data mining project which utilize several cutting-edge technologies such as Scrapy for web scraping, Elasticsearch for indexing, AWS S3 for storage and Kurbernetes for packaging and deploymen More

$555 USD in 10 days
(15 Reviews)
0.0
binarycodersvw

Hi.I am a Visual Basic .NET programmer with 14 years [login to view URL] name is Andrei. I've done 3 big one year long projects,each had about 10.000 text lines of source code. please read a short version of my CV and see sc More

$555 USD in 10 days
(16 Reviews)
0.0
devops724

hi there I have 10 years experience in Python and PHP web development. I did lots of projects in web world, develop in most web technologies. 8 years developing Django sites and services. I did lots of projects in More

$555 USD in 10 days
(2 Reviews)
0.0
AzzkaNoor

Bonjour! It is my humble offer to present my services to you for this project. I have passed 15 certifications here (& with 5-star rating) and your project's domain resides in my area of expertise. I have few questio More

$555 USD in 10 days
(21 Reviews)
0.0
SoftDevelopINC

Hello , I would like to join your project because Django framework is my best skill . I have 5 years experience with Django, I familiar with REST APIs (5 years), good at SQL knowledge and design databases system (5 More

$1000 USD in 10 days
(298 Reviews)
0.0
creativewebideas

Hi, We have extensive development experience in Django Python, below are the details of our recent experience. Development of different portals which includes ACL - Role base user login API integration( like More

$555 USD in 10 days
(180 Reviews)
0.0
$833 USD in 10 days
(0 Reviews)
0.0
$277 USD in 5 days
(1 Review)
0.0
kahan1994

Hi, I am kahan. I am python developer and have much experienced in scrapping. I can make it as per your need. Waiting for further discussion. Thank you

$500 USD in 10 days
(2 Reviews)
0.0
SolaceInfotech

Hello, It looks like you are looking for an experienced PHP developer expertise who can dedicatedly work on your ongoing project for Web Scraping of a website. Currently, we are working on one of the same project, w More

$722 USD in 21 days
(4 Reviews)
0.0
drishinfotech

Hello, Thank you for the posting. Having scraped various portals across multiple domains, I would like to collaborate with you on this task and deliver it as per your timeline and budget. The basis of my confi More

$500 USD in 10 days
(8 Reviews)
0.0
DudangoStudios

I will provide a fast, modularized scrapy python program that runs 24/7 and send notifications to a discord channel. I have already created a scrapy web scraping module as well as hosted 24/7 python web applications More

$333 USD in 3 days
(0 Reviews)
0.0
schoudhary1553

Hello, I can help with you in your project scraping / web crawling with python on a website I have more than 5 years of experience in Django, PHP, Python, Software Architecture, Web Scraping. We have worked on se More

$1000 USD in 10 days
(56 Reviews)
0.0
phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database More

$722 USD in 10 days
(84 Reviews)
0.0
SigmaVisual

Hi, I have extensive experience of working on similar scraping projects for products price, stocks details. I can help to develop a script in python according to your requirements. Please let me know for what websites More

$250 USD in 7 days
(283 Reviews)
0.0
qasimjaved1

Hi, I have been gone through such issues many times, i am new to upwork but have 4 years of industry experience. I have hands on experience in selenium, python and linux OS, give me a chance. Interview me, i will d More

$555 USD in 10 days
(0 Reviews)
0.0
DarkKnight2206

I am a python developer. I have great experience in web scraping and I am an expert in it. I have all necessary skills by which I can scrape any website. I have even scraped sites like google, whatsapp web, instagram, More

$375 USD in 2 days
(22 Reviews)
0.0