I have Script running on a windows server, the script is scraping Google scholar academic account and save the result to a database,
What is your job, is to check why my script is not working correctly anymore, and fix it to achieve what it dose.
It does exactly the following
1- Visit Google scholar
2- Search for a domain name
3- list all academic under this domain
4- scarp some data
5- Save to MySQL database
6- Go to the next page in case we have more than one page under X domain
7- Visit the next domain
The number of domain is around 29K, and it will take around 1 week to scrape 1.8 Million academics data
33 freelancers are bidding on average $131 for this job
Dear Sir ☆☆☆ My skill Python, web scraping, ☆☆☆ I think my experience can help you enough. It's always ready, so you can discuss more via chat. If you believe in me please send me a message. Thank you. Liao Z
I have ten years experience in Python. I have a lot of experience from google scholar, as I am myself in academia. I 've done a lot webscraping of data. Namely, I am very familiar with Beautiful Soup.