Find Jobs
Hire Freelancers

Simple python scraper needed in our architecture

$15-25 USD / hour

Closed
Posted about 3 years ago

$15-25 USD / hour

Hello! We have a simple python collector that scrapes data from a public web site. It primarily uses one URL (with changing object IDs and date parameters). In some cases, it requires drilling down to a second level page. The collection will probably only make 300 - 500 requests a week. The technical requirements will generally be: 1 -- you will read from Rabbit MQ 2 -- you will write to Kafka (raw non-transformed data). 3 -- you will provide a docker file and config using env vars. Our Collections team can provide the standard set of config vars so we can inject it into our standard run setup. 4 -- you will manage your retry and error logic -- we will give you a logging format. Our team is fully booked and cannot get to this small collection but will need to support it. More details after we see a few responses.
Project ID: 29509607

About the project

19 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
19 freelancers are bidding on average $18 USD/hour for this job
User Avatar
Hello kdevon107,   We have 20 years of strong experience in PHP, Python, Web Scraping, Software Architecture, as a result, we can successfully complete this project.   Please, review our profile here: https://www.freelancer.com/u/tangramua Here detailed information about our company, our portfolio, and the client's recent reviews.   Also, we wanted to personally discuss questions about your project, which helps us to give you the right estimation.   Best regards, Tangram Canada Inc.  
$20 USD in 5 days
4.6 (247 reviews)
8.8
8.8
User Avatar
Hello, I am a Professional Software developer providing web scraping services using Python and specialized scraping frameworks : - Scrapy. - Selenium. - BeautifulSoup. - PhantomJS. - and many others... I am available to discuss right now. Assure to deliver high-quality work with fast turnaround. Looking forward to hearing from you. Regards.
$15 USD in 40 days
4.9 (142 reviews)
7.5
7.5
User Avatar
Hi, I am Python script developer with 10 years of experience. I can scrape required website by python script/bot with your instructions very short time. Can we discuss please? Thanks.
$15 USD in 40 days
4.9 (185 reviews)
7.6
7.6
User Avatar
Hi, Greetings! ✅ I have checked and gone through the project details and I am very skilled in it. ✅Completed Time: In project deadline We have worked on 640 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion.. Thank you Sandeep Digital screencast
$20 USD in 40 days
4.9 (248 reviews)
7.8
7.8
User Avatar
Hello I have read your job description carefully. I am a web scraping expert with 7 years of experience in Python. Also, I have rich experience in these fields. So I am interested in and I am confident in your project. I always provide perfect results to my clients as you can see in my profile and reviews. If you give me a chance, I will provide you the perfect result. I hope you send me a quick message. Regards Daniel Ramos Garcia
$20 USD in 40 days
5.0 (30 reviews)
6.4
6.4
User Avatar
So you want a dockerized version of a scrapper? A pretty boring job. The third party may get frustrated and ban bots access. What do you make with these data? Let's research some REST APIs.
$15 USD in 20 days
5.0 (10 reviews)
5.2
5.2
User Avatar
Hi,kdevon107 I hope you are doing well!! I read your request . i can do all thing you want. I have worked in various fields of programming and web scraping with python and I can do your project using the beautifulSoup ,scrapy(spiders) ,requests and Selenium library in the shortest time and at the lowest price and save that on an excel file. I can also create a new Excel file each time the code is executed so that you have the previous information , if you want !! I can change anything you want And I will share it with you step by step also I have done many projects on popular sites such as amazon, ebay and.... Before starting work, you can see a sample of my work , please send me a message on the chat page to send you a sample work. I'm interested to find out more details, if you find our work interesting we can connect more. My aim is to provide satisfied and quality work
$15 USD in 40 days
5.0 (19 reviews)
5.2
5.2
User Avatar
Hi, How are you today? Thank you for posting this project, and I'm very happy to bid your project. I've read carefully your project details. I have rich experiences related with your project. Your satisfaction with the project is my top priority! If you give me a chance to work with you, then I will do my best to reach your requirements. I'm waiting for your kind response. Please send msg over chat. Let's go. I will do my best for you. Best Regards. --**
$15 USD in 40 days
5.0 (25 reviews)
4.0
4.0
User Avatar
Greetings of the day!! Hope that you are doing well. Glad to have information for the project from you. Since, I am a new freelancer I would like to work in your project. I have gone through your requirements and understood that you want an experienced Python and Web Scrapper developer. I have experience of Python and Web Scraper for 5+ years and did many projects successfully. Will be requiring more details from you for knowing more about the project. Areas of expertise: PHP Python Web Scraping Let me know how we move ahead? Waiting for a favorable feedback from you. Warm Regards, Nandita Patel.
$20 USD in 40 days
5.0 (1 review)
3.7
3.7
User Avatar
Hi, I have 6++ years experience in C# and python Programming. I understood your requirements and i can help you perfectly. When do you need this finished by? I can help you quickly! please see my portfolio. I look forward to working on this project with you. Thanks and regards!
$20 USD in 40 days
5.0 (5 reviews)
3.5
3.5
User Avatar
I have experience in Java/python/kafka/Webscraping. Let me know if I can work for you. I am full stack developer.
$20 USD in 40 days
5.0 (6 reviews)
3.5
3.5
User Avatar
Hope you are doing well.. I am Neha from India and I've experienced SCRAPED data from 13 websites. So I'm very comfortable with helping you with this project. I am ready to start full-time work immediately and assure you to provide high-quality results in a given time frame. I have strong 5 years of experience in Python, Django, Odoo, Docker along with front-end, back-end technologies including - Python / Django / Django REST Framework / Flask - JavaScript / React / Material-Ui - HTML5 / CSS3 / Bootstrap - PostgreSQL / SQLite - Heroku / AWS S3 - GitHub / Git Moreover, - Python-based APIs, Django REST-Framework, Django REST Swagger (OpenAPI) & Custom Authentication. - Test-Driven Development: PyTest, Mixer, Mock, Django Request Factory, Django REST-Framework APIClient & Coverage. My previous work in Scrapping:- -> SCRAPE NEWS FROM 13 WEBSITES AND ADD TO OUR WEBSITE Scraping of posted news from 13 other websites and perform semantic analysis , if news looks positive then only post to the client new portal (Technologies Used:- Python, Selenium, ReactJs Postgresql) Aslo have Experience scraping eCommerce sites & Experience with IP rotation. Please text me for deep discussion. Regards, Neha.
$20 USD in 40 days
4.8 (1 review)
2.0
2.0
User Avatar
Hi I'm a Python software developer with 7+ years of experience. My expertise is covering full ETL pipeline, exactly web scraping, crawling and data processing, data loading to any databases. Strong background in creating web applications and API, bots programming and any kind of web automation solutions. Feel free to contact me if you have any available work ;) Range of tasks: • Web scraping, crawling, parsing and data extraction & preparation (ETL) • Bypass any captchas, prevent IP blocking and bots detection Technical skills: • Tools for scraping: Scrapy, Selenium WebDriver, css+xpath, BeautifulSoap, etc Thanks
$20 USD in 40 days
2.2 (4 reviews)
3.5
3.5

About the client

Flag of UNITED STATES
Los Angeles, United States
0.0
0
Payment method verified
Member since Mar 9, 2021

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759) & Freelancer Online India Private Limited (CIN U93000HR2011FTC043854)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.