Closed

Web Scraping + File Integration with API -- 2

Project: Data scraping/extracting and importing into API

Background:

We are a dropshipping business that sells products on the Internet - on our own ecommerce website as well as Amazon.

We need to ensure that the inventory levels for products are current.

We source products from multiple suppliers that provide inventory data in different ways and in different frequencies.

We need to gather all that data and then import it into our inventory software system. That system integrates with our e-commerce website and Amazon to ensure the latest inventory levels are correct.

The separate data sources that need to be scraped/extracted include:

2 websites. Scrape search pages and product pages. Up to 3K products. Site formatting can be inconsistent and some pages require logic for variants. Data should be scraped on a short interval basis - every 30 minutes - and then pushed to database.

Emailed CSV file. 1 file. Hundreds of products. Need app/macro to open email, download sheet and then scrape data. Email is G Mail so experience with G Mail scripts is helpful.

2 Google sheets. 50 to 100 products each. Need app/macro/solution to open sheets, extract data and then send to database. Experience with Google API is helpful. Needs to be done once per day.

1 txt file on FTP site. Hundreds of products. Need app/macro to open sheets, pull data and send to API. On an ongoing basis. FTP site updated every 15 minutes. Should be pulled every 30 minutes.

All of this data will then need to be consolidated in a database or spreadsheet (Google Sheet0. It will be preferably for a spreadsheet as some of the data needs to be formatted/modified before being imported into Ecomdash.

Once that data is updated, it needs to then be linked to Ecomdash through their API.

Scope

-Create app(s)/scripts that can perform the data scraping/extraction.

-Ensure data is properly imported into tabs into Google Sheets.

-Ensure formatted/consolidated data is then properly imported into Ecomdash via API. (Note: client will handle formatting/modifying data in Google Sheets).

-Provide support in hosting app on appropriate site (i.e. Heroku)

Experience needed:

- Web scraping

- App/Scripting for extracting data from Google Sheets, emailed CSV files in G Mail and txt files on FTP sites.

- API integrations with Google Sheets

- App hosting

Skills: PHP, Python, Web Scraping, Google APIs, Google Sheets

See more: web scraping download file, web scraping project, web scraping project payment amount, web sms providers website integration api, estimation web scraping project, sample project web scraping asp net, web scraping project desktop freelancing, web scraping pdf file, excel vba file web scraping getting result site, web scraping project report, google api example project web application, scope web scraping project, java web scraping api, java google api web scraping, google api web scraping, php project code web scraping, file upload web api 2, web scraping in python part 2

About the Employer:
( 0 reviews ) Denver, United States

Project ID: #24708554

24 freelancers are bidding on average $19/hour for this job

zekovicm

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the More

$25 USD / hour
(151 Reviews)
7.7
tangramua

Dear Sir,   Our team has a huge experience in PHP, Python, Web Scraping, Google Sheets, Google APIs, as a result, we can successfully complete this project. Having the required skills, we will be glad to help you.   We More

$18 USD / hour
(70 Reviews)
7.1
sphinxsolution

Hello, I hope you are doing great We are Sphinx solution, a Software Solutions & Services Company of 80+ in-house developers & designers specializing in Application Development, Web Technologies, Software Testing & Q More

$15 USD / hour
(14 Reviews)
7.1
phpXpertbd

Dear Employer, I'm expert in web scraping, web automation and data mining tasks. I'm ready to start right away. I can scrape data from the sites above and create a unified database Please initiate chat with me and let More

$18 USD / hour
(95 Reviews)
7.4
mxicoders

Hello, I hope you are good well. ​​​We can discuss further on it so that we can able to provide you a solution with a proposal containing the ballpark estimated price and time duration. We possess 14+ years of exper More

$20 USD / hour
(46 Reviews)
7.1
raminde

Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered resul More

$22 USD / hour
(10 Reviews)
5.7
ankitbagre2000

Hello, I'm Ankit I'm interesting your project very well I'm good in Website Design, HTHML, CSS , JAVASCRIT, JQUERY, AJAX, PHP and mysql expert. I’m quite well experienced in these jobs. Let's go ahead with me I wan More

$17 USD / hour
(52 Reviews)
5.9
kirilnberezebko

Hi . I am a senior web and data scraping script developer with 6+ years of experience. I have worked on several similar projects scraping email address and phone number and specific datas from websites and can deliver More

$20 USD / hour
(15 Reviews)
5.1
kuldeepak05

>>>>>>>>>>EXPERT PYTHON SCRAPER <<<<<<<<<<<<<< ============================================= Hello, I am a Professional Full-time developer providing web scraping services using Python and specialized scraping framew More

$15 USD / hour
(18 Reviews)
4.7
gehlot

Hello Sir, I read full project description thanks for describing . I have good knowledge in scraping . I can create script to extract data from google sheet api API intigration and we will also provide app hosting More

$15 USD / hour
(48 Reviews)
4.7
miton247

Hi sir, I am a web designer & developer and I feel interested in your project development. I read your description. I truly understand your project needs. I can develop your project easily. I have good experience with More

$15 USD / hour
(8 Reviews)
4.7
souphamy

Hi sir. I am amazon,eBay senior developer. I have full experience for amazon and eBay management using software i developed. My skill can satisfy your requirement perfectly. If you hire me I will work the best quality More

$20 USD / hour
(4 Reviews)
4.5
ArtemMurov

Hi sir. I am amazon,eBay senior developer. I have full experience for amazon and eBay management using software i developed. My skill can satisfy your requirement perfectly. If you hire me I will work the best quality More

$20 USD / hour
(3 Reviews)
4.0
StanislavRezer

Hi, Manger1 Here is a Web Scraping expert. I have experience web scrapping and auto send mail app. So I think it's best for this project. I can work 24/7. if you require, I can work 60hours per week. if you hire me, y More

$20 USD / hour
(6 Reviews)
3.7
manu83tudo

-previous experience in such topics; -eager to discuss a lot in this chat stream; -degree stats / maths;

$15 USD / hour
(9 Reviews)
2.8
ITL2020

Dear Recruiter, Greetings. I have gone through the project requirements posted by you under the title: ‘Web Scraping + File Integration with API -- 2’ and I am really interested in applying for the same. I am a Full More

$15 USD / hour
(2 Reviews)
2.2
mahdibahri

I can do it FOR FREE I would like to do the same for my Shopify store [login to view URL] I just need the motivation this is a great opportunity and I have more than the required skills with Shopify API too if yo More

$20 USD / hour
(2 Reviews)
1.6
JJromes

Hello. I have strong experiences in scraping project. I can do it using both C# or Python. I have built the project using Scrapy-Sharp library in C# and Selenium library in python. Which type of project do you want? Ca More

$20 USD / hour
(1 Review)
0.4
Arifshah999

I m expert in this kind of job

$20 USD / hour
(0 Reviews)
0.0
rajukumar809129

Hi, I am a certified UiPath developer with more than 2 years of experience and have worked on many complex automation projects. I can work on automating PDF invoices, Excel sheets, CSV files, email messages, desktop ap More

$15 USD / hour
(0 Reviews)
0.0