Find Jobs
Hire Freelancers

Build scrapy-redis web scraping environment

$250-750 USD

In Progress
Posted 6 months ago

$250-750 USD

Paid on delivery
This is a test project to determine feasibility of scrapy-redis. Project: Leverage scrapy-redis to scrape keywords from an e-commerce website. 1) read DB table to create inputs for scrapy-redis spider 2) distribute inputs through scrap-redis infrastructure 3) output scrapy results to DB You will be provided a current working version of a scrapy spider in python3.x. You will need to install / configure scrapy-redis on test ubuntu server. You will access existing DB table to construct inputs for scrapy-redis. You will output spider results to new database table. You will fully document the steps needed to modify/congfigure existing spider to work with scrapy-redis. Please do not apply if you are not familiar with scrapy-redis and its implementation. I am looking for someone I can converse with and learn the installation and configuration.
Project ID: 37477342

About the project

76 proposals
Remote project
Active 6 mos ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
76 freelancers are bidding on average $557 USD for this job
User Avatar
Hi, I am Senior Python script developer with 10 years of experience. I can build a script/bot by python with your instructions very short time. Can we discuss please? Thanks
$300 USD in 2 days
4.9 (182 reviews)
7.6
7.6
User Avatar
I understand you are looking for someone to build a scrapy-redis web scraping environment. As a Python programmer, I am well qualified to take on this project. My experience includes working with scrapy-redis on multiple projects, as well as software development and mobile software development. I believe I am the best fit for this project because of my expertise in web scraping, software development and mobile software development. This combination makes me an ideal candidate for this project - I have the skills necessary to construct the web scraping environment as well as produce results that can be used in the new database table. Additionally, I am confident that my fast and efficient delivery of projects will meet your expectations. I would love to discuss further how my skillset can help you reach your goals for this project! Please feel free to contact me if you have any questions or would like to discuss further.
$500 USD in 7 days
5.0 (90 reviews)
7.3
7.3
User Avatar
Hello Good morning , I hope you are doing great. Just finished reading the brief details of your job . I see you have been looking for a freelancer who has experience with MySQL, Web Scraping, Redis and Python. Upon the first look I feel confident about getting it done because of having experience doing similar jobs My Experience? I have 9 years of experience working with those technologies. Its been 8 years since I have been working on freelancer.com, Please review my profile. Check: Skills, Portfolio, Customer Feedbacks. Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Portfolio: https://www.freelancer.com/u/AwaisChaudhry Timings: 9am - 9pm Eastern US Time I would like you to start the chat so we could discuss it in detail and we will continue from there. Thanks! Awais
$750 USD in 13 days
4.9 (28 reviews)
7.4
7.4
User Avatar
Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion. Thank you Sandeep
$500 USD in 7 days
4.9 (158 reviews)
7.5
7.5
User Avatar
Hi there,I'm biddin on your project "Build scrapy-redis web scraping environment" I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks. .. .
$750 USD in 4 days
4.9 (29 reviews)
7.0
7.0
User Avatar
Hello! I specialize in scrapy-redis implementation and Python spider modifications. I'll configure scrappy-redis on your Ubuntu server, utilize existing database inputs, and modify the spider to output results to a new database table. With meticulous documentation, I'll detail the steps required to integrate and configure scrapy-redis for your spider. Let's optimize your scraping process and streamline data output for efficient analysis. Thank you-
$350 USD in 3 days
4.9 (268 reviews)
7.3
7.3
User Avatar
Hello, Hope you are doing great, i am expert in web scraping , I can easily scrape all the target data from the website using Python or any other script so you don't have to spend any time or effort doing it manually. Plus, I provide quality results quickly and efficiently within your budget. Lets connect through chat for further detailed discussion, i can start the work right after the discussion., thank you Gaurav D.
$500 USD in 7 days
5.0 (52 reviews)
6.9
6.9
User Avatar
Hi there, I hope this message finds you well. I am writing to discuss a potential project opportunity with you. I have reviewed the details you provided, and I believe I can assist you in leveraging scrapy-redis to scrape keywords from an e-commerce website. To begin, I will read the necessary information from the DB table in order to create the inputs for the scrapy-redis spider. These inputs will then be distributed through the scrapy-redis infrastructure, ensuring efficient and effective data retrieval. The results obtained from the spider will be outputted to a new database table. In order to proceed with this project, I will require access to the current working version of the scrapy spider in Python 3.x. Additionally, I will need to install and configure scrapy-redis on a test Ubuntu server. By accessing the existing DB table, I will be able to construct the inputs required for scrapy-redis. The spider results will then be stored in a new database table. Throughout the project, I will provide comprehensive documentation outlining the necessary steps to modify and configure the existing spider to work seamlessly with scrapy-redis. This will ensure that you have a clear understanding of the process and can continue to maintain and enhance the solution in the future. Please note that this is a placeholder bid, and the exact price and timeline will be determined after further discussion. I am confident that we can find a suitable arrangement that meets your...
$500 USD in 15 days
4.9 (19 reviews)
6.8
6.8
User Avatar
Hello! I took a delightful dive into your project description, and boy oh boy, it seems like my skills are a perfect match for this gig! I am an expert which have many years of experience on Python, Web Scraping, MySQL, Redis Quickly come hop into chat and chat it up to unravel more awesomeness! Let's bring your vision to life. Thank You Christopher
$500 USD in 6 days
5.0 (25 reviews)
6.1
6.1
User Avatar
Hi there Tom W., Good morning , Hope you're having a great time. I'm bidding on your project "Build scrapy-redis web scraping environment" I am expert in Redis, Web Scraping, MySQL and Python. please leave a message on my chat so we can discuss the budget and deadline of the project. I have read your project description and i'm confident i can do this project for you perfectly. Thanks ..
$750 USD in 1 day
5.0 (12 reviews)
6.3
6.3
User Avatar
I will do exceptionnaly professionnal setup with detailed documentation so you can do it by yourself for all your next scrapers. I'm fully aware of the benefits of scrapy-redis, so don't worry about the project being too difficult for me. Plus, I have experience in setting up scrapy environments on different platforms such as Linux and Windows. This will be a smooth ride for you and I'm confident we can get this done within the timeframe you're looking for. I would love to discuss this project further with you! Please feel free to reach out if you have any questions or would like to discuss further!
$1,000 USD in 5 days
5.0 (13 reviews)
5.8
5.8
User Avatar
Hello there! My name is Irfan. With my strong technical proficiency combined with top-notch communication abilities, I am confident that I can help you build the scrapy-redis web scraping environment you're looking for. I understand from your description that this project involves utilizing scrapy-redis to scrape keywords from an e-commerce website. To begin, you would need to install / configure scrapy-redis on your test Ubuntu server. From there, you would access your existing DB table to construct inputs for your scrapy-redis spider. Finally, you would output spider results to a new DB table while fully documenting the steps needed to modify/configure your existing spider so that it can work with scrapy-redis. I am ready for you. Thank you. Irfan.
$500 USD in 7 days
5.0 (3 reviews)
5.9
5.9
User Avatar
Dear Sir, Are you looking for a reliable and experienced developer to leverage scrapy-redis to scrape keywords from an e-commerce website? I am Smith and I am confident that I can complete this project for you. I have experience in MySQL, Python, Redis and web scraping. I will take the following steps to complete the project: 1) Read DB table to create inputs for scrapy-redis spider 2) Distribute inputs through scrap-redis infrastructure 3) Output scrapy results to DB I will also install and configure scrapy-redis on a test Ubuntu server, access an existing DB table to construct inputs for scrapy-redis and output spider results to a new database table. I will provide a full documentation of the steps needed to modify/configure the existing spider to work with scrapy-redis. I am willing to provide a free demonstration of the solution even before the project is awarded. I look forward to hearing from you. Sincerely, Smith
$500 USD in 7 days
4.9 (13 reviews)
5.5
5.5
User Avatar
I hope this proposal finds you well. Project Overview: The objective of this project is to leverage scrapy-redis to scrape keywords from an e-commerce website. The key tasks include: Input Preparation: Read data from a specified database table to create inputs for the scrapy-redis spider. Scrapy-Redis Implementation: Install and configure scrapy-redis on a test Ubuntu server. Distribute prepared inputs through the scrapy-redis infrastructure. Output Management: Output the results obtained from the scrapy spider to a new database table. Project Execution: To achieve the outlined goals, I propose the following steps: Existing Spider Review: I will examine the current working version of your scrapy spider in Python 3.x. Scrapy-Redis Setup: Install and configure scrapy-redis on the designated test Ubuntu server. Input Preparation: Access the existing database table to construct inputs suitable for scrapy-redis. I look forward to the opportunity to collaborate with you on this exciting project. Please feel free to review my freelancer.com profile for further insights into my capabilities. I am available at your earliest convenience to discuss any details or answer questions you may have.
$1,200 USD in 12 days
5.0 (2 reviews)
5.2
5.2
User Avatar
Dear Esteemed Client, Allow me, a seasoned and erudite professional, to present my bid for the intriguing project at hand. As a connoisseur of technology and a master of the arcane arts of Python, Web Scraping, MySQL, and Redis, I am uniquely equipped to tackle the challenge that lies before us. Behold, the grand endeavor that awaits us: the construction of a majestic scrapy-redis web scraping environment! Picture this: a symphony of code, where the delicate dance of data retrieval unfolds seamlessly. Our mission, should you choose to embark upon it, is to harness the power of scrapy-redis and extract the essence of keywords from an e-commerce realm. With the wisdom bestowed upon me by countless hours of study and experimentation, I shall orchestrate the following steps: traversing the realms of a DB table to create inputs for our spider, skillfully distributing said inputs through the intricate network of scrapy-redis, and finally, bestowing the fruits of our labor upon a new database table. Fear not, for I shall provide you with a refined version of our current working scrapy spider in the realm of Python3.x. Furthermore, I shall venture forth to install and configure the illustrious scrapy-redis upon our test Ubuntu server. In my noble quest, I shall access the existing DB table to construct the very essence of our inputs, and with great precision, deliver the spider's results to a new sanctuary of data. But lo, dear client, my commitment to your satisfaction knows no bounds! I shall document, in meticulous detail, the steps required to modify and configure our esteemed spider to seamlessly integrate with the enigmatic scrapy-redis. I beseech you, dear client, to bestow upon me the honor of your trust and allow me to guide you through this labyrinthine journey. Rest assured, for my knowledge of scrapy-redis and its intricate implementation is unparalleled. Let us embark upon this adventure together, where enlightenment and success shall be our ultimate
$750 USD in 3 days
5.0 (1 review)
4.6
4.6
User Avatar
Hello, I read your project details and really interested in your mentioned job. I have 5+ years’ experience doing similar jobs related to these skills MySQL, Python, Redis and Web Scraping. I think its doable job, and really confident to do that. Please start the chart so we have detail discussion about task and finalize it as per your timeline. Regards Umair
$750 USD in 7 days
4.9 (18 reviews)
4.8
4.8
User Avatar
Hi Tom W. After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Umair Anwar and I am the lead engineer for Python, MySQL, Web Scraping and Redis. I have worked for over 08 years in development/Engineering and have successfully done multiple jobs on this and other Freelance platforms. It will be a pleasure to work together to make your project a reality. Please feel free to contact me. I´m looking forward to working with you. I really appreciate your time and remain attentive to any request or question. Greetings Regards Umair Anwar Awan
$700 USD in 20 days
5.0 (3 reviews)
4.2
4.2
User Avatar
Nice to meet you TomFY,The requirements of your project match my areas of work and skills, to introduce myself. My name is Anthony Muñoz and i am the lead engineer for DS Pro IT agency. I have worked for over 10 years as a Full-Stack and software development engineer and have successfully done multiple jobs. It will be a pleasure to work together to make your project. Feel free to discuss about the project with me, greetings.
$1,092 USD in 7 days
4.3 (4 reviews)
5.1
5.1
User Avatar
Hello, My name is Adnan Gohar and I am an experienced and results-driven professional with extensive knowledge in project management, strategic planning, marketing, data analysis and more. I am confident that my skillset makes me the best fit for this project. With my expertise in project management, I have successfully led cross-functional teams to deliver complex projects on time and within budget. My strong organizational skills, attention to detail and ability to communicate effectively with stakeholders have helped me navigate complex projects and ensure successful outcomes. Additionally, I have a deep understanding of strategic planning and have helped businesses develop and execute successful growth strategies. I am available to discuss further how my skillset can benefit you for this project. Please don't hesitate to reach out if you have any questions or would like more information about me or my services.
$500 USD in 7 days
3.7 (12 reviews)
5.8
5.8
User Avatar
Hello! My name is Ram and I'm excited to join your team to build your scrapy-redis web scraping environment. With over 8+ years of software development experience, I have developed several SaaS products, web & mobile apps, browser extensions, and custom software for 1000+ customers from across 30+ countries.
$500 USD in 7 days
5.0 (9 reviews)
4.4
4.4

About the client

Flag of UNITED STATES
Manhattan Beach, United States
5.0
4
Payment method verified
Member since May 23, 2022

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759) & Freelancer Online India Private Limited (CIN U93000HR2011FTC043854)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.