
In Progress
Posted
Paid on delivery
I'm looking for a skilled developer to create a web crawler that navigates Indeed and collects structured job data. The crawler should extract at least three fields: Job Title, Company Name, and Location. The collected data should be exported in CSV format. Requirements: - Experience with web scraping and data extraction - Proficiency in handling dynamic web pages - Ability to structure data accurately - Familiarity with Indeed's website layout and job posting formats Ideal Skills and Experience: - Python, Scrapy, or similar technologies - Knowledge of CSV data formatting - Attention to detail and data accuracy Please provide samples of similar work done.
Project ID: 40472942
17 proposals
Remote project
Active 5 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

Hi sir, Greetings. I read your requirements and understand the process. I can handle the work carefully with high accuracy and deliver on time. Please invite me to chat so we can discuss further details. Thank you. Saravana
$15 USD in 2 days
4.3
4.3
17 freelancers are bidding on average $38 USD for this job

Hi, I've built job scrapers on Indeed and LinkedIn multiple times. You mentioned navigating Indeed specifically — I'll handle the dynamic loading and structure changes they throw at you. Python + BeautifulSoup or Scrapy, clean data output, no headaches. Message me to discuss. Best Regards, Hasan
$200 USD in 7 days
6.4
6.4

Hello! I will create a PHP script to scrape data you need Please provide the details I have extensive experience in writing PHP scripts for data scraping Please see my reviews for reference.
$90 USD in 1 day
6.5
6.5

With over a decade of experience as a full-stack developer, I bring a unique blend of technical expertise and a keen understanding of client needs to your web crawling project. My proficiency encompasses a wide range of technologies, including Python, which enables smooth navigation on dynamic web pages like Indeed. As you require data extraction in CSV format, my fluency with handling and structuring data simplifies this process and guarantees accuracy. What sets me apart further is my vast experience in web scraping and automation projects. I can assure you that the final product will capture all the three fields - Job Title, Company Name, and Location - exactly as you need them. In fact, I can craft the solution to cater to any desired formatting or additional data that may be requested.
$20 USD in 2 days
6.3
6.3

Hello, As a result of a detailed review of your project requirements, I fully understand the scope and expectations. I have experience building web crawlers and structured data extraction tools, and I'm available to start your project right now. I bring deep expertise in Python, Web Scraping, Scrapy, BeautifulSoup, XPath, CSS Selectors, Data Extraction, CSV Formatting, and Data Processing with over 10 years of experience. One of the key challenges in scraping Indeed is handling dynamic job pages and keeping the output clean and consistent. I can build a simple reusable crawler that extracts Job Title, Company Name, and Location, then exports the results into a well-structured CSV file with clear run instructions. I have a couple of quick questions. • Which Indeed country/domain should the crawler target? • Do you need only search result pages, or also details from each job posting page? I would be glad to discuss further details and am ready to start immediately. Looking forward to hearing from you. Best regards, Carlos.
$20 USD in 2 days
3.8
3.8

Hi, I can build a reliable Indeed job crawler that extracts Job Title, Company Name, and Location and exports clean structured CSV data. I have experience with Python/Scrapy/Selenium for handling dynamic pages and ensuring accurate extraction with reusable scraping logic for future runs. I’ve worked on similar web scraping projects involving job boards and structured data collection with CSV/Excel output. I focus on clean data, duplicate handling, and stable scraping performance. I can start immediately and deliver an efficient solution. Looking forward to discussing the details.
$20 USD in 1 day
3.8
3.8

Hello, I can build a Python-based web crawler to collect structured job data from Indeed, including Job Title, Company Name, Location, and export the cleaned results into CSV format. I have strong experience in Python, web scraping, data extraction, handling structured and semi-structured web data, CSV formatting, and automation workflows, so I can create a crawler that is accurate, organized, and easy to reuse for future job searches. I can also provide clean code, instructions, and sample output so you can easily run and verify the extracted data. Relevant Certifications: Python for Data Science, AI & Development – IBM Python for Everybody Specialization – University of Michigan Databases and SQL for Data Science with Python – IBM Getting Started with Git and GitHub – IBM Regards, Talha Almas Data Scientist / Data Analyst / Full Stack Dev Relevant Skills: Python, Web Scraping, Scrapy, BeautifulSoup, Selenium, Data Extraction, Dynamic Web Pages, CSV Export, Data Cleaning, Automation, Job Data Collection
$30 USD in 1 day
3.6
3.6

Hello, I’m ready to deliver a robust, scalable web crawler tailored to Indeed’s dynamic pages and canonical job data extraction. With strong Python expertise and hands-on experience in Scrapy, XPath, and CSS selectors, I will build a crawler that navigates Indeed, precisely captures Job Title, Company Name, and Location, and exports clean CSV files ready for analysis or integration. The solution will include: resilient crawling logic to handle pagination and dynamic loading, structured data models, error handling, and a lightweight pipeline to export to CSV with clearly labeled columns. I’ll implement validation to ensure data accuracy, deduplication where necessary, and an export routine that preserves the original layout (Job Title, Company Name, Location) in each row. Key steps: - Map Indeed’s page structure to stable selectors; design flexible XPath/CSS rules to survive layout tweaks - Build robust crawl flow with polite politeness settings and retry strategies - Implement CSV emission with proper encoding and optional headers - Provide sample outputs and documentation; deliver the code with minimal dependencies for easy deployment I can share samples of similar work upon request and tailor the scaffolding to your hosting and runtime preferences. Best regards,
$30 USD in 1 day
1.4
1.4

Indeed blocks scrapers hard, so I would use rotating proxies with Scrapy and hit their internal API endpoints instead of scraping raw HTML. Much more reliable than CSS selectors on a site that changes its markup constantly. Clean structured output in JSON or CSV, ready to plug into whatever you are using downstream. I can start today and have a working crawler delivering data within 2 days. Bid and timeline are based on the description as written and will adjust once we talk through the full scope. Want to jump on a quick call?
$30 USD in 2 days
0.0
0.0

Hello, Understanding your need for a reliable web crawler to extract job data from Indeed, I am excited to help you streamline this process. My approach will leverage Python along with Scrapy to effectively handle dynamic web pages and efficiently extract the required data fields. Here is what I will deliver: - Job Title data extracted from Indeed's listings - Company Name information collected with accuracy - A structured CSV file containing the collected data for easy access and analysis I can confidently complete this within your budget and timeline, and I will keep you updated throughout the process. Could you specify if there are any additional fields you might want to consider for future expansion, or is it strictly limited to the three mentioned? Best regards
$20 USD in 7 days
0.0
0.0

I am a perfect fit for your project to develop a web crawler that extracts Job Title, Company Name, and Location from Indeed and exports the data in CSV format. My focus will be on clean implementation and ensuring seamless functionality across dynamic web pages while maintaining precise data structuring. While I am new to Freelancer, I have strong experience in web scraping using Python and Scrapy, and I have delivered similar data extraction solutions outside the platform. I offer a free consultation to better understand your project and propose the most efficient technical approach. I would love to chat more about your project! Regards, Sonny Dube
$14 USD in 14 days
0.0
0.0

Hi there, Indeed's dynamic rendering and anti-bot layers are the real challenge here — not just writing a basic scraper. We'll handle both cleanly. What we'll deliver: - Python-based crawler (Scrapy + Selenium for dynamic page handling) - Extracts: Job Title, Company Name, Location + any extra fields needed - Clean, structured CSV export — ready to use immediately - Pagination support across multiple search results - Proper request handling to avoid blocks mid-run Stack: Python, Scrapy, Selenium, BeautifulSoup, CSV output We've built Python automation and data extraction workflows across multiple projects — clean, maintainable code with solid error handling throughout. I'll personally test the full output before handover. Quick question — are you targeting a specific location or keyword on Indeed, or do you need the search parameters to be configurable?
$15 USD in 7 days
0.0
0.0

Phoenix, United States
Payment method verified
Member since May 27, 2026
₹1500-12500 INR
$250-750 USD
$15-25 USD / hour
₹600-1500 INR
$10-30 USD
₹1500-12500 INR
$30-250 USD
$750-1500 USD
$30-250 USD
$10-30 USD
$10-30 USD
$10-30 USD
$30-250 USD
$100-250 USD
€30-250 EUR
₹600-1500 INR
$10-30 USD
$10-30 USD
₹750-1250 INR / hour
₹12500-37500 INR