Find Jobs
Hire Freelancers

Website Scraping

€250-750 EUR

Closed
Posted 3 months ago

€250-750 EUR

Paid on delivery
We need an entire domain to be scraped. The domain has around 1 million links. The domain is well protected by CloudFlare. You can do this manually or automatically. I need every single site belonging to the domain to be saved fully in html alongside its resources (JavaScript, images). You should also download any CSVs, Excel files, Word files, or PDFs in the domain. This should be seriously completed, within a few days. We are looking for competitive people. You will need to provide a sample of 100 pages before assigning the project to you.
Project ID: 37838355

About the project

73 proposals
Remote project
Active 1 mo ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
73 freelancers are bidding on average €581 EUR for this job
User Avatar
Hi sir, . If you want then we can have a 1-1 discussion on FL chat. kindly let us know I helped 37 clients from United Kingdom then i think you will be next one. Your satisfaction is more important than money then you only need to pay when your project is completed. There are no risk for you. Best regards, Michael
€555 EUR in 9 days
5.0 (1295 reviews)
9.5
9.5
User Avatar
With over 18+ years in Web and APP development, my team at CnELIndia has honed their skills in CSS, HTML, JavaScript, PHP, and Web Scraping - skills that are vital for a project of this scale. We understand the importance of your task and can assure you that it will be carried out with utmost professionalism. We have been known for delivering projects on time without compromising on quality. If you so desire, we are open to providing a sample of 100 pages to showcase our competence before you assign us the entire project. Moreover, our extensive experience in scraping well-protected domains like yours (including those with CloudFlare) ensures we can tackle any obstacles head-on. As previous clients have testified, our services are characterized by effective communication and exceeding expectations. Choose us and experience this high level of service first-hand.
€500 EUR in 7 days
4.9 (606 reviews)
9.0
9.0
User Avatar
Hello, Hope you are doing great, i am expert in web scraping , I can easily scrape all the target data from the website using Python or any other script so you don't have to spend any time or effort doing it manually. Plus, I provide quality results quickly and efficiently within your budget. Lets connect through chat for further detailed discussion, i can start the work right after the discussion., thank you Gaurav D.
€500 EUR in 7 days
4.9 (358 reviews)
8.3
8.3
User Avatar
Hey there! I am George, a skilled web crawler expert with years of experience in data scraping and extraction. I have read your job posting for Website Scraping and I am excited to offer my services. I have successfully completed a similar project using a custom web scraping tool for a client. Here's why I am the best person for the job: 1. With my expertise, I can easily bypass CloudFlare protection and scrape the entire domain in no time. 2. I will provide a high-quality HTML output of each site, along with its resources such as JavaScript, images, CSVs, Excel files, Word files, and PDFs. 3. I understand the urgency of completing this project and assure you that it will be done within a few days with utmost accuracy. 4. I am highly competitive and strive to deliver the best results, always keeping my clients' satisfaction as the top priority. Some questions for you: 1. What are the specific domains that need to be scraped? 2. Can you provide me with a sample URL to get started? 3. Do you have any specific formatting requirements for the output files? 4. Are there any particular websites or sections that you want me to prioritize while scraping? Looking forward to hearing from you and providing a free sample of 100 pages as requested. Thank you for your consideration.
€749 EUR in 3 days
5.0 (107 reviews)
7.9
7.9
User Avatar
Hello, Greetings! I am willing to handle the existing task and want a longer Work Relationship with you. as we are Design And Development experts and we extend a full range of services, including configuration and setup, design, customization, integration, upgrade, migration, maintenance, and support. Our end-to-end services ensure a complete solution for any e-commerce business. Regards Kishore
€500 EUR in 7 days
4.9 (260 reviews)
8.2
8.2
User Avatar
Hello there, I am experienced in web scraping and to build script or a windows desktop application by using python. I am also experienced in large data scraping from the given website, by pass IP, Captcha, and anti bot or cloud flair protection. Please message me to discuss more regarding this project. Best Regards
€500 EUR in 5 days
4.9 (271 reviews)
7.9
7.9
User Avatar
Hi, I am Senior Python script developer with 10 years of experience. I can scrape your required domain by python script/bot with your instructions very short time. Can we discuss please? Thanks
€500 EUR in 5 days
4.9 (176 reviews)
7.5
7.5
User Avatar
Hello Greetings, After going through your project description, I feel confident and excited to work on this project for you. But I have some crucial things and queries to clear out. Can you please leave a message on chat so we can discuss this and I can share my recent work similar to your requirements? Thanks for your time! I look forward to hearing from you soon. Best Regards
€700 EUR in 8 days
4.9 (132 reviews)
7.6
7.6
User Avatar
As the CEO & Founder of Digital Screencast, I've successfully completed projects similar to yours for multiple high-profile clients over the past 7 years. My expertise in web scraping and automation, along with my skills in HTML, CSS, JavaScript, and PHP make me uniquely qualified for your project. Regarding scraping a well-protected domain of your size; my experience with CloudFlare and tackling complex challenges means I'm prepared to take on this task at any level of difficulty. And while the project calls for speed, I assure you it won't come at the expense of accuracy. To put your mind at ease, I'd be happy to provide a sample of 100 pages as per your request before starting. One thing you can count on is that I prioritize employer satisfaction above all else. That's why I offer unlimited revisions until you are completely satisfied with our work together. So let's get started on this project; I look forward to not only meeting but exceeding your expectations!
€500 EUR in 7 days
4.9 (172 reviews)
7.5
7.5
User Avatar
Website Scraping Hope you are doing well, Looking for creative and knowledgeable Web & Mobile App developers? Search no further, because we are ready for the job with 10 years of full-stack web development experience for global businesses. We work directly with clients to develop scopes and manage project milestones. We focused on customer satisfaction, we manage all aspects of web development, from concept to requirements definition, design, development, launch, maintenance, and user support. Waiting for your response Regards; TopIThub
€450 EUR in 2 days
5.0 (49 reviews)
7.2
7.2
User Avatar
Hello! Offering comprehensive web scraping services for your 1 million-link domain, adept at bypassing CloudFlare protection. Our automated solution ensures full HTML capture with resources (JavaScript, images), while also downloading CSVs, Excel, Word, and PDF files for a seamless and thorough data extraction experience. Thank you-
€350 EUR in 3 days
4.9 (270 reviews)
7.3
7.3
User Avatar
As one of the top 5k members on this platform, I have consistently demonstrated my passion and dedication towards providing 100% client satisfaction. With my team's vast experience in web development (including PHP, HTML, CSS and JavaScript - essential for your project), we have successfully worked with over 150+ companies on various domains. Our proficiency in scraping and extracting data from websites is unparalleled and well-suited for your current requirement. With a project of this magnitude, time management becomes crucial. As an expert in website development resources such as JavaScript and images explicates my ability to extract every single site belonging to the domain and download any associated files like CSVs, PDFs or Excel files as requested by you. Handling CloudFlare’s anti-scraping mechanisms is certainly doable with the right skill-set that we undoubtedly possess. Having served numerous clients over the years, we understand how important it is to provide progress updates on-time. I assure you that I will provide timely updates throughout the project till its final completion - importantly, providing you with a sample of 100 pages before assigning the entire project! Be it a matter of guaranteeing quality in saved HTML pages or securing these files after downloading on your required timeline - we utterly prioritize on delivering rankings of both impeccable result and customer satisfaction.
€500 EUR in 7 days
5.0 (125 reviews)
6.4
6.4
User Avatar
Hello Ismae O., I have read the requirements for the website scraping project and I am confident that I can handle it with perfection. If you have any questions or need further clarification, please feel free to connect with me in the chat. Looking forward to the opportunity to work together. Best regards, Christopher
€500 EUR in 6 days
5.0 (35 reviews)
6.2
6.2
User Avatar
Hi there, I'm thrilled to apply for your Website Scraping project. With 4-5 years of experience in JavaScript, CSS, PHP, HTML and Web Scraping, I'm confident in my ability to bring valuable insights and expertise to your initiative. Please note that the initial bid is an estimate, and the final quote will be provided after a thorough discussion of the project requirements or upon reviewing any detailed documentation you can share. Could you please share any available detailed documentation? I'm also open to further discussions to explore specific aspects of the project. Feel free to check out my profile, showcasing my portfolio, past jobs, and client reviews. It reflects the quality and professionalism I bring to every project. My goal is to provide a competitive budget without compromising on quality. Thanks for considering my proposal. I'm eager to collaborate and contribute to your project's success. Let me know if you need any more information. Best regards, Rashid Amjad
€700 EUR in 15 days
5.0 (29 reviews)
6.0
6.0
User Avatar
Hello, As an experienced full-stack web developer with a deep understanding of leading-edge technologies, I believe I am the right fit for your website scraping project. My expertise using languages like CSS, HTML and JavaScript, is exactly what you need to ensure this job is well-done. My familiarity with CloudFlare security measures, which you noted as a concern, means I have the skills required to navigate and automate data gathering under stringent circumstances such as these. Furthermore, my technological capabilities extend to back-end development, particularly in handling large-scale databases and data management - a valuable asset when dealing with over 1 million links. Thanks
€500 EUR in 7 days
4.9 (19 reviews)
6.0
6.0
User Avatar
Respected Sir..., Here a Full-stack developer, specialize in end-to-end development of websites. I have around more than 8+ years of experience in Website Development. My expertise includes HTML, PHP, WordPress , JavaScript, CSS , Web Scraping , responsive,laravel,HTML5,Bootstrap,eCommerce,Woo-commerce, graphic design etc. I've developed a wide range of websites and web applications using various CMS and frameworks. Thanks & Regards Developer Deepika
€250 EUR in 7 days
4.5 (93 reviews)
6.3
6.3
User Avatar
Greetings, I possess the expertise needed to accomplish your task seamlessly. Having completed numerous similar projects with success, I invite you to review my profile: https://www.freelancer.com/u/AutoScrape123TX Feel free to initiate a discussion, and together, we can expedite the completion of your project.
€500 EUR in 3 days
5.0 (9 reviews)
5.6
5.6
User Avatar
Hi, We went through your project description and it seems like our team is a great fit for this job. We are an expert team which have many years of experience on PHP, JavaScript, CSS, Web Scraping, HTML Lets connect in chat so that We discuss further. Regards
€500 EUR in 7 days
5.0 (8 reviews)
5.0
5.0
User Avatar
Hi, Greetings for the day! As you are looking for a Python Scrapy Expert, I am a seasoned software developer and have experience of more than 6 years in writing robust Python utility Scripts for Scraping, Automation, and Importing. I can write custom code to crawl and extract different sorts of data and provide the Best Web Scraping and Data Extraction Services. I can efficiently scrape data from websites, aggregate them, and report for business operations. I can automate the task while performing the following steps- - Access data behind user authentication by solving captcha in some cases. - Pull together transaction records by navigating to various characters, numeric fields, calendars. - Iterate to complete transactions for a time period. - Prepare the data from each website to a set schema ready for BI ingestion. My expertise lies in- • Scraping websites with bare-bones structures and complex to parse • Regular expression( regex) to extract data • Selenium scripts to automate activities on the web • Bot development • ETL Please let me know when we can begin with it. Regards
€500 EUR in 7 days
4.6 (18 reviews)
5.6
5.6
User Avatar
Hi, I have used PHP Laravel Dusk to scrap js driven data in a website and Goutte package to scrap the normal data content as well. I can scrap both types of data in PHP. I am an expert PHP developer and I can easily do your job. Let us start work and you will be happy after hiring me. Regards, Adil
€700 EUR in 30 days
4.9 (21 reviews)
5.1
5.1

About the client

Flag of UNITED KINGDOM
Pozuelo de Alarcón, United Kingdom
0.0
0
Member since Mar 4, 2024

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759) & Freelancer Online India Private Limited (CIN U93000HR2011FTC043854)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.