Web Scrapping for over 24k records

In Progress Posted 11 months ago Paid on delivery
In Progress Paid on delivery

I need to do web scraping on a website of the Government of Chile (INAPI). This website allows you to enter an ID and obtain the data of a request. The program must receive a set of files in excel, extract the ID of each request, and update 5 columns of the excel files, according to the information found. It must also generate a sqlite database with all the information obtained in the web scraping for future queries through SQL.

This website does not have validation for Web Scrapers (such as reCAPTCHA or puzzle solution), but it does have a search limit (possibly based on the number of requests from a particular IP).

I also have some TypeScript code that already reads the excel file, does web scraping, and updates the excel file (which I can give you as a reference if needed).

It's important, given the deadline, that you can work with multi-concurrency (in my TypeScript code, I work with Puppeteer-cluster)."

The excel files contain an approximate total of 25k records that need to be searched, and the website limit is approximately 500 records.

Web Scraping Excel

Project ID: #36381237

About the project

13 proposals Remote project Active 11 mos ago

13 freelancers are bidding on average $44 for this job

livegoodlife

Hello there, I am experienced in web scraping and to build script or a windows desktop application by using python. I am also experienced in large data scraping from the given website, by pass IP, Captcha, and anti bo More

$30 USD in 7 days
(344 Reviews)
8.0
romasatrian

Thanks for your job post. I tried to pass recapcha with api . so I am really interested in this project. Kind regards

$200 USD in 7 days
(0 Reviews)
0.0
Asraf71

I have more than 5 years of experience I can do it very easy. Already I completed so project like this. just close your eyes and trust me. I am sure. you will be happy.

$10 USD in 2 days
(0 Reviews)
0.0
Kintilbaruah06

Dear sir, I am writing to propose my services as a data entry specialist for your company. As someone who has a keen eye for detail and a passion for accuracy, I believe that I am the best person for the job. With [i More

$20 USD in 7 days
(0 Reviews)
0.0
nidhibhati975

My services include: Custom web scraping solutions tailored to your specific needs Data extraction from a wide range of websites and sources High-quality, accurate data that is delivered in a format of your choice Qui More

$30 USD in 7 days
(0 Reviews)
0.0
ArdiniSatar

Dear Sir, I have experience in website data entry another task easily and have ability to give back to you fine results. I am a student of MBA (Human Resources). I always prefer part-time jobs. Hope so you will hire me More

$20 USD in 7 days
(0 Reviews)
0.0
V0x0056

Based on your project description, I propose the following approach: *Use TypeScript code to develop a custom web scraping script that can handle multi-concurrency with Puppeteer. *Integrate the custom script with you More

$40 USD in 2 days
(0 Reviews)
0.0
iamthepkm

I am excited to express my interest in the web scraping project you have posted. Although I am new to the Freelancer platform, I have considerable experience in the field of web scraping and have successfully completed More

$20 USD in 7 days
(0 Reviews)
0.0
rhrohan9898

Dear sir/madam, I am offering my services on short notice. I read job description and I can do your project. I can even work on urgent basis and complete your project soon.. Please consider me and give me a chance to More

$20 USD in 2 days
(0 Reviews)
0.0