Closed

Scrape Websites

I need ongoing help scraping websites daily using Python, Beautiful Soup, Selenium, and Requests.

Data must be dumped to a CSV file.

JOB DESCRIPTION

I need help scraping 50 websites on a regular basis. The scrapes must run daily and load data into a CSV file.

QUALIFICATIONS

> A FREELANCER MUST BE AVAILABLE AND WORKING AT LEAST M - F 10 A.M. MDT - 4 P.M. MDT. THAT'S A 6 HOUR PERIOD, 5 DAYS PER WEEK. THE REMAINING HOURS CAN BE FLEXIBLE.

> A FREELANCER MUST HAVE EXCELLENT ENGLISH LANGUAGE PROFICIENCY AND SPEAK ARTICULATELY.

> A FREELANCER MUST HAVE AT LEAST 2000 HOURS DIRECT EXPERIENCE SCRAPING WEBSITES USING PYTHON.

SAMPLE PROJECT

Step 1: Go to [login to view URL] and get the URLs for each type of facility by clicking on the facility type, then clicking "Consumer Resources" and then clicking "Facility directory (search by city or county)". You should get URLS like

[login to view URL]

[login to view URL]

etc.

*Note: We require each page to be downloaded and saved in an output folder as HTML and to capture a screenshot of each page using Selenium and save to the same output folder.

Step 2: Search for all entities of each type and extract data to populate the following CSV files:

facility_type, name, address, city, state, zip, county, phone, fax, administrator_or_contact_name,

Skills: BeautifulSoup, Python, Selenium Webdriver, Web Development, Web Scraping

See more: is web scraping legal, web scraping javascript, web scraping python beautifulsoup, how to scrap a website, web scraping software, web scraping tutorial, scrape data from website python, web scraper chrome, i need seo help, i need a help how to writing a letter for application form, i need a help how to write a letter to your friend in abroad tell her about the recent development in your country, https translate google com gh m hl en&sl en&tl fr&ie utf 8&prev m&q hello friend please i need your help, am an hip hop artist in nigeria i need a help or a record lebel, i need urgent help to complete a onepage website pretty simple it has a prototype currently 20 completed, i need urgent help to complete a one-page website (pretty simple) it has a prototype currently 20% completed, i need twitter help from a professional, i need some help, i need russian help on a translation, i need photoshop help, i need orifessionsl help writing a poem

About the Employer:
( 24 reviews ) Denver, United States

Project ID: #16936888

25 freelancers are bidding on average $11/hour for this job

phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database More

$10 USD / hour
(61 Reviews)
7.1
zhangyingtai

Hi I am a qualified python developer with 8 years of professional experience of web scraping. I checked the requirements. I can confirm I am suitable for this project. I can work from 10 am MDT to 4 pm MDT. Also I h More

$16 USD / hour
(62 Reviews)
6.6
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$20 USD / hour
(44 Reviews)
6.2
schoudhary1553

Hello, I can help with you in your project Scrape Websites. I have more than 5 years of experience in BeautifulSoup, Python, Selenium Webdriver, Web Development, Web Scraping. We have worked on several similar proje More

$12 USD / hour
(18 Reviews)
5.8
bytessolution

A proposal has not yet been provided

$10 USD / hour
(102 Reviews)
5.9
vincentong07

Hi! I'm script developer that can retrieve data & do tasks with automation. Speed & 100% accuracy guaranteed! May i use another module or even different programming language? Somehow when it involves capturing, the More

$8 USD / hour
(67 Reviews)
5.5
maximwang8661

nice to meet you. I am a good scraping expert. I want to discuss about your project with you. I have a lot of experience in scraping. if you want to know about me, please see my review. if you award me, I will try More

$12 USD / hour
(6 Reviews)
5.1
ymograi

Sir/Madam, I am an experienced Python developer with 2 years of experience in web scraping using selenium, requests and beautiful soup. I can do this project for you. Please go through my profile. I look forward to More

$14 USD / hour
(29 Reviews)
4.7
goalscoreplayer

I have full Experiences in cryptocurrency trading. If you give me the task, you will get the best solution. I have some trading strategies. Thanks, regards.

$12 USD / hour
(9 Reviews)
4.6
abhilashtv

Hi, ➲ 7+ years of full-time experience in Python / Django with 50,000+ Upwork hours billed and 50+ successful Python projects ➲ Upwork Top 10 Certification for Python and Django ➲ Guaranteed Results Policy: Pay only More

$12 USD / hour
(11 Reviews)
4.8
$11 USD / hour
(15 Reviews)
4.5
topithub

I have read your job description and I can say that I am really good fit for this job. I have some questions, I want to discuss

$12 USD / hour
(7 Reviews)
4.2
istiyaqueahmed

I'm a good fit for scrape any web data. I have a Desktop software(webharvy) to collect data automatically. Here is my software activity: [login to view URL] . I need only 2 minutes More

$8 USD / hour
(17 Reviews)
4.1
huongth

Hi. I am an expert in VBA, VBScript, Visual Basic, C#, F#, C, C++, ASM, Delphi, Java, iMacros, Flash, ASP, ASP.NET, Access, MySQL, MSSQL, QuickBooks, Oracle. I can create auto scripts to scrape websites, auto click, fo More

$10 USD / hour
(14 Reviews)
3.7
digitalaptech

Hello Please have a look at our recent work in Scrapping Creating a website for showing scrapped data from different website into one place. Project Overview ------------------------- We have created a website More

$13 USD / hour
(1 Review)
3.4
SidhuDN

Hello Sir I read your job carefully and see the attached website. I can do this job professionally. I can follow instructions really well. I have lot of experience in Data Entry, Web Scraping, Internet Research. If More

$8 USD / hour
(6 Reviews)
3.4
ankurgupta512

Hello , I am a python developer and i can scrape your website using selenium webdriver. waiting to discuss on your project. thanks ankur

$8 USD / hour
(4 Reviews)
2.8
origami07

Greetings, I have experience web scraping with all the tools mentioned. Please see my profile. Regards

$15 USD / hour
(6 Reviews)
3.1
shraddha1302

Dear Sir/Madam, I have good experience in scraping, and i will provide you fast and quality results. I can work as per your timing also. Please award to me.

$8 USD / hour
(2 Reviews)
2.2
hiteshsaini007

I have Strong knowledge in BeautifulSoup, Python, Selenium Webdriver, Web Development, Web Scraping,Asp.net, PHP, Word-Press,Magento, C#.net,Wpf, MVC,Angularjs,Razor, SQL server , MongoDB , MySql , Web Service , WCF S More

$8 USD / hour
(2 Reviews)
2.3