Data Extraction Web Scraping Data Mining jobs

I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product...

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

...process. As of now, I manually gather numerical data from a variety of unstructured sources like images, text, and PDFs. This data includes formulas and is stored both on my local computer and the web. At present, I get ChatGPT to convert this data into a table which I then paste into excel. I do calculations in excel to find out what percent each ingredient is of a total formula. Then I create a new entry into a table in Airtable and paste this data into a different table in Airtable which references the first table. I need someone to automate this data extraction process, calculations and entry into two separate Airtable tables so I can do it repeatedly myself. I work in a standardised operating environment for work so ideally I need a ...

Task at hand is to extract vocals from a highly distorted audio file OF APPROXIMATELY 8 MINUTES. I DO HAVE OTHER FILES I WOULD LIKE DONE AS WELL, IF EXTRACTION IS SUCCESSFUL. As a client, my ultimate target is related to: - Enhancing intelligibility within the dialogue to bring utmost clarity. - Identifying specific words or phrases that may prove crucial. - The file is from a criminal setup with the audio of a father setting up his son; thus every word could change the narrative. The audio clip has been intentionally distorted over crucial conversation. Do whatever it takes to make the conversation extremely clear irrespective of the overall audio quality. Those offering skills and experience in forensic audio analysis, audio software engineering will ideally match the job req...

I'm working on a school project that involves the development of a Coal Mining Security Alert System. I need someone who can code in Quarky to create this block code system. Unfortunately, I haven't gotten to the point of defining the complete scope of the project, but I'd like to start with the code development. I'm looking for someone who can: - Use Quarky to build a block code system - Understand and implement basic security alert functionalities - Be ready for subsequent feature additions and changes Key Features: = Face Detection: Implement face detection functionality to identify individuals within the mining area. = PPE Kit Verification: Utilize image processing techniques to ensure that miners are wearing proper PPE kits. The system should stop i...

I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.

Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501

I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of you...

I want a mobile application for iOS that can effectively extract text from images captured by the camera and then accurately highlights specific words. Key Features: - **Text Extraction:** Accurate OCR technology that can interpret and transcribe text from images with precision. - **Word Highlighting:** The app should be able to highlight certain words based on user input. I prefer these highlights to be done via color changes. - **Image Handling:** The app should allow users to take photos from within the application itself or upload from gallery Ideal Skills: - Proficiency in iOS app development. - Experience with Optical Character Recognition (OCR) technology. - Knowledge of effective text highlighting within a mobile app. - Familiarity with designing a user-friendly inter...

I require a professional data entry freelancer to help me with a PDF data extraction task. The project involves extracting and organizing information from a series of PDF files. The data to be extracted varies and includes both text data and numerical data, in addition to images or diagrams. The ideal freelancer for this project should be experienced in data entry and be comfortable working with PDF files. Key requirements for the project include: - Extracting text and numerical data from PDF files - Organizing the extracted data in an easily accessible format - Ensuring accurate extraction of information - Handling images or diagrams within the PDF files The extracted information will be used for further analysis and...

I'm in need of a skilled online data entry professional for a project involving the extraction of data from various websites and organizing it into a database. Key Responsibilities: - Conducting online data entry tasks from multiple websites. - Ensuring the accuracy and completeness of the data. - Organizing the entered data into database entries. Ideal Skills and Experience: - Proven experience in online data entry. - Proficiency in web browsing and data extraction. - Strong attention to detail and accuracy. - Experience with organizing data into database entries would be considered a plus. Please only apply if you have a strong track record in online data entry and can guarantee the quality of t...

I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during sc...

...script (the script name will be shared privately upon project commencement). Unfortunately, it's currently unknown which specific script to be used, but clarity will be provided as the project progresses. - Discern the implemented functions within the script. The functionalities mainly centered around recognizable trading indicators like Moving averages, Pivots, Fibonacci and MACD. - The code extraction should consider compatibility with variable timeframes. Whilst exact timeframes aren't specified yet, flexibility should be maintained to accommodate potentially any (e.g. 1 minute, 5 minutes, 1 hour, and more) I expect freelancers interested in bidding for this project to have proven experience in Pine Script programming and a reliable understanding of trading indica...

I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extract...

...skills. Expectations from the investigation include: • High level of detail: I need precise features clearly identified, even clear text if possible. The ultimate goal is to achieve the best possible clarity on the obscured parts of these crucial images. Therefore, this job best suits individuals who are proficient in digital forensics, image enhancement algorithms, and any related visual data extraction techniques....

I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant experience in your bid.

I'm seeking a skilled analyst to develop a geographic profile map that displays crime rates within the city. The goal of this representation is to visualize and understand patterns in city-level criminal activities. Ideal Skills and Experie...within the city. The goal of this representation is to visualize and understand patterns in city-level criminal activities. Ideal Skills and Experience: - Proficient in Geographic Information Systems (GIS) or similar software for cartographic design - Background in criminology or relevant areas is beneficial - Familiarity with data extraction from various online sources Project Responsibilities: - Extract data from internet sources - Analyze and present the data in a geo-visual format - Maintain accuracy in repr...

...software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a reliable and efficient tool t...

I'm urgently seeking a skilled individual with experience in data entry. The main tasks include completing online form filling and helping me decipher an image. Key Responsibilities: - Online Form Filling: The job involves handling online form completions. The forms are fairly straightforward and shouldn't be overly complex. - Image Deciphering: You'll be required to assist me with interpreting an image. The complexity level is not specified, but it's anticipated to be moderate and should be manageable for an experienced professional. Key Requirements: - Proficiency in data entry, particularly in the domain of online form filling. - Strong attention to detail is crucial, as the correctness of the entries is paramount. - Experience with deciphering images...

I am seeking an expert capable of efficiently and accurately pulling LinkedIn data from a list of companies and cataloging employees who previously worked at a specified set of organizations. The ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant sho...

I'm looking for a seasoned AWS Data Engineer with over 8 years of experience to support me in handling data extraction and transformation tasks. Key Responsibilities: - Data Extraction: The engineer will be responsible for extracting structured data held in SQL databases. - Data Transformation: You will be required to transform the extracted data into a usable format for our analytics and reporting. Skills and Experience: - 8+ years of experience as an AWS Data Engineer. - Proficient in working with structured data, in particular, SQL databases. - Extensive experience in data transformation. - Expertise in AWS services, especially Amazon S3 and Glue. Your support will be essential in ensuring the smooth fl...

...application or website that can provide comprehensive takeoffs from uploaded residential and commercial slab plans. Key Features: * Object Detection and Text Extraction AI Capabilities - Uses advanced AI algorithms to detect and interpret various elements within the slab plans. * Supports Multiple Formats - Must be able to process JPEG and PDF formats. * Comprehensive Detail Analysis - Capability to identify and count specific components such as void formers, reinforcement bars, and structural beams. Ideal Skills and Experience: * Extensive experience in AI Development, specifically in the fields of Object Detection and Text Extraction * Demonstrable experience in creating software that can process and interpret renderered images in multiple formats * Prior experience o...

I'm searching for an expert in cryptocurrency mining to help establish a mining pool for Quark. Key tasks for this role include: - Configuring the mining software specifically for Quark; - Providing guidance for a mining pool of less than 10 miners; Ideal candidates will have: - Proven experience in setting up diverse cryptocurrency mining operations, especially Quark; - Thorough knowledge of mining setup and operations for pools with less than 10 individuals. Please provide your proposed approach and relevant past experiences during bidding.

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

...effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task...

...system for recording painting/repair locations. - Fields for indicating the type of paint or repair needed. - An integrated cleaning schedule that doesn't disrupt ongoing summer camp activities. - A remark section to note if the cleaning crew has cleaned, dusted and removed furniture from the areas needing repairs. - Detailed focused cleaning taskers, such as Hi/low dusting, Carpet cleaning ( extraction & encapsulation) table and chair details, and dispenser replenishments With your help, we aim to maintain an efficient schedule and record-keeping system that will ensure our facility stays in top shape while eliminating scheduling conflicts between maintenance and ongoing events. it's very important that this sheet schedules the teams to work in a manner were the...

Extraction of bricks from a proposed drawing.

I need a skilled Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're

I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise....

I need a freelancer to search for the "Business Directory" URL on 342 websites. The websites ar...directory URLs for the first four entries, as a sample): You will search for the business directory URL on each website, then enter the URL in the "Business Directory" column of that Google Sheet. (Note: some websites don't use the exact term "business directory". What I'm looking for is the web page on each site that contains the list of businesses in each city, so the business directory could be called something else, for example "business listings".) The task is a one-time search. My budget is $20. This is an excellent project for a new freelancer who is looking for a 5-star review.

I have a PDF membership directory that was emailed to me. I need someone skilled in data extraction to help convert it into an easily readable CSV file. The ideal candidate should possess: - Proficiency in working with both PDF and CSV file formats. - Strong data extraction skills. - Attention to detail for data accuracy. Each member listed per row with the perinate contact information separated into its own cells ie: entity/last name/first name/address/ste#/city/state/zip/office ph/email/cell ph The task should be completed by 5/23/24.

...in NodeRed Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpages (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpages, indicating what needs to be extracted/copied to set up the new flow bymyself in the future. For example, on this web page, by pressing F12, yo...

I require a one-time data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience: - P...

I need an expert in Optical Character Recognition (OCR) technology to convert text from high-resolution, clear photographs to editable text. Key Project Details: - **Purpose**: The primary objective of this task is to extract data from various documents. - **Image Type**: The text extraction will specifically be from photographs of text. - **Image Quality**: All photographs are high resolution and clear. Ideal Skills and Experience: - Proficient in Optical Character Recognition (OCR) technology - Prior experience in extracting data from images - Excellent attention to detail to ensure accurate transcription - Ability to work efficiently with high-resolution images

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready ...

I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - P...developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, ...

Start your offer with the word in the attachment, otherwise we dropp you out. We are looking for a database with websites, HAVING EMBEDDED YOUTUBE Videos on their sites...the site, PLZ, City, State, Phone, Mail, Website Niches: Construction Systems in Austria, Germany and Switzerland Phsiotherapeuts in Austria, Germany and Switzerland I would like to have at least 2000 websites with top-quality data. Delivered in 1 day. Delivery in one Excel file. Time of delivery is a key element in our decision. Offer a price for 2.000 data entries. We extend our partners for this kind of task´s. With all of them we have a longterm Partnership. To decide who is our partner and to see your understanding, please provide a sample with at least 50 data entries within 2 hours o...

I urgently need someone to extract shareholder information from the Madagascar business registry. The work needs to be done as soon as possible. Key Requirements: - Retrieve shareholder data from the Madagascar business registry - The data should be presented in a clear, easily understandable format

scrape data from darty site and export it into excel file.

I'm looking for a Python developer to assist with a variety of tasks on a medium-scale project. This would include web development, data analysis, automation scripting, and web scraping. Your responsibilities would cover: - Web Development: Creating and maintaining web applications using Python frameworks. - Data Analysis: Handling and analyzing data to derive insights. - Automation Scripting: Developing scripts to automate manual tasks. - Web Scraping: Extracting and structuring data from websites. Communication is key, and I'd prefer to receive regular updates and progress reports via email. The ideal candidate for this position will have experience with each of these tasks and be able to work on a m...

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

I'm seeking to secure funding for a multi-industry workers' accommodation project. The accommodation caters to construction, seasonal farm, wind farm, abattoir, and gold mine workers. For this, I need a professionally crafted project proposal and a corresponding financial model in Excel. Ideal freelancers for this project should possess: - Proven experience...Excel. Ideal freelancers for this project should possess: - Proven experience in drafting project proposals related to housing or accommodation - In-depth knowledge in the creation of financial models using Excel - A strong understanding of multi-industry accommodations - Great analytical and strategic thinking skills - Familiarity in the Construction, Agriculture, Energy, Food Processing, and Mining Industries wo...

...crypto mining but I have a strong interest in it. My main goal is to generate passive income through this method, but I'm also eager to learn more about the technology and support the network. I'm looking for a consultant who can guide me through the following aspects of crypto mining: • Mining hardware selection: I need assistance with understanding what kind of hardware is necessary for efficient mining. • Mining software setup and configuration: I require help setting up and configuring the mining software on my hardware. • Mining profitability analysis: I would like a detailed breakdown of the potential profitability of my mining operation, including the costs and potential returns. Ideal skills and ...

I'm looking to integrate Optical Character Recognition (OCR) into my web application. The primary goal is to automate data entry processes. The current application contains manual data entry. I am attaching a screenshot of how it is entered manually and a picture of the paper from which it is typed. OCR should be done automatically. We can take pictures with a mobile phone in a few seconds so that everything is finished. The application is in spring boot and angular. The database is mysql. Functionality for Taking Photos Using HTML5 and JavaScript, you can use an input element with the type file and the attribute accept="image/*" to allow users to take pictures of documents directly from the browser on a mobile device. Uploading the Image to the Serv...

There is a website that I do not have access to the hosting and I just need an embedded video extracted from it and saved as an MP4 file. Let me know if this is something you can do, looking to get it done now within the hour.