Crawling data extraction data mining jobs

...developer who can handle automation tasks related to ETL pipeline, data extraction from Snowflake, and a dbt environment. Key Requirements: - You should be proficient in Python programming. - Be familiar with the Window Task Scheduler. - Have experience with ETL pipeline development. - Know how to extract data from Snowflake and a dbt environment. The Purpose: - The ETL pipeline is crucial for handling data analysis, reporting, and data integration tasks. - The data size to be processed in the ETL pipeline is medium, up to 10 GB. Ideal Candidate: - You should have prior experience in handling similar tasks. - A strong understanding of data handling and automation through Python and ETL tools. - Proven expertise in data extr...

...need a php script that will use an ocr library (like tessaract) to convert data in the image of the nameplate that user uploads to text and get the electricity consumption info.. Electricity info has one of these values: Amperes, W, kW, Ton, BTU, and HP.. the script will get the value of the unit available in the nameplate and will fill the data in the calculator's form based on data on the nameplate .. for example, the name plate shows: 7 KW.. the script will read this and fill the form: Unit: KW, power: 7.. attached an image of the form.. now ONLY if the unit is amperes the script will get these additional data from the nameplate and fill them in the calculator's form: Voltage, Phase.. also please note that the data might be horizonta...

...need of a highly proficient data extraction specialist who can effectively collect details from 8,000 Facebook group members for market research purposes. Your main task will involve extracting the following data: - Member's name - Current job title - Date of group membership - Page URL Key Project Requirements: - All data must be scraped without violating Facebook's terms of service. - Information needs to be organized according to the date of joining the group. - Extracted data should be handed over in the form of an Excel spreadsheet. Skills and Experience: - You need to have proven experience in data scraping, particularly from social media sites like Facebook. - Good knowledge of Excel is required. - Familiarity with the Fa...

I'm looking for an expert in data scraping to effectively extract text data from online databases. Primarily, I am interested in customer details. This data will be pivotal to my operations. Key tasks include but are not limited to: - Extracting textual data from specified online databases - Focusing on customer details during extraction - Organizing the extracted data in an easily accessible format The ideal candidate is proficient in data scraping and has a deep understanding of online databases. Proficiency in using tools and scripts for scraping is necessary. Previous experience with customer data extraction will be a plus. A rigid approach to data privacy and ethical scraping standards is imperative. Accurac...

Project Description: We are seeking a proficient Python developer to complete and refine a web crawling application with a graphical user interface (GUI). The primary function of this application is to extract specific job-related data from websites based on input parameters such as job title and location. Key Responsibilities: Review and refine existing Python code for web crawling to ensure robust and efficient data extraction. Develop and implement a user-friendly GUI that allows users to input search criteria easily. Ensure the application can parse and extract data accurately from various webpage structures. Output the extracted data into a structured spreadsheet format. Test the application to ensure its reliability and accuracy unde...

I need an innovative Android app developer who will create an app to extract interaction chains from...extract interaction chains from another app. This is for research purposes. The main focus is to analyze the types of interactions within the targeted app. Specifically, the app should record detailed chains of user interaction. Ideal skills for this job would include extensive experience in Android app development, a deep understanding of data extraction methods, as well as a good grasp of user behavior analysis. In addition to these skills, experience in data driven research would be highly advantageous. Your role will not be limited to just creating an app, but to bring a research tool to life. This project is more than creating an app; it's an exploration int...

...determine my decision as favorable. For example, a brief design of a stirling cryocooler, some previous work references, precision compression examples and heat exchange differential compression flow if can provide. The main key factors to this project are precision flow as through compression, timing of heat exchange through compression, the balance units as density of the gas, pressure of gas extraction, heat exchange after compression and the travel flow of the gas....

...sheet. There would be a subsequent function for field extraction to compile a final report. - Desired Skills and Experience: • Proficiency in OCR technology for handwriting detection • Experience in custom software development • Excel programming expertise for auto-consolidation of data • Knowledge of report generation mechanisms within software Successful execution of this task would drastically streamline data processing in my start-up. To increase accuracy, the OCR program needs to be trainable, in order to recognize unique handwriting styles of different individuals. To provide you a sense of the variety, samples of these handwriting styles will be made available. I am seeking a freelancer who understands the intricacies of OCR, dat...

I'm seeking an experienced freelancer to lead a data collection project targeting mobile contact numbers from India exclusively. Key tasks: - Collect a substantial database of mobile contact numbers within India for market research purposes. - Guarantee the accuracy and legitimacy of all collected data. - Strictly adhere to data privacy and protection standards. Ideal Candidates: - Prior experience in data collection specifically with mobile numbers. - Proficiency in data mining and scraping. - Detailed knowledge of data privacy laws in India. - Market research background would be a plus. Your understanding of these requirements and your capabilities in fulfilling them will be critically evaluated. Apply if you believe you'r...

I'm in need of a professional data extractor who'll meticulously pull out the specified financial information of general insurance companies in India from their public financial reports. The extracted data should cover: - Profit and loss statements - Balance sheets - Cash flow statements - Specific Insurance-related data In terms of insurance-specific details, it's important to focus on: - Premium revenue - Claims expenses - Underwriting profit/loss The data should be compiled from multiple years and not just the current or previous year. Ideal candidates must be proficient in financial analysis, data extraction, and have an understanding of insurance company financials. An understanding of Indian general insurance companies woul...

We're moving away from NetSuite after using it as our ERP for over a decade. Active/recent data will be imported into out new ERP as part of the implementation project, but older legacy data will not. However, we still need to be able to access the older legacy data in the future but not in NetSuite. Maintaining any licensing with NetSuite is not a preferred option. We require a different solution that will allow us to access this data in the future if required. Hoping to partner with someone who can suggest a solution and assist us with the data extraction.

...expertise in data warehousing in Oil and Gas sector. We are going to use MongoDB. Key Requirements: - Data Integration: We need someone who can seamlessly blend data from various sources, ensuring accuracy and consistency. - Data Modeling: The ideal candidate should have a deep understanding of how to organize data in a way that supports business needs and decision-making. - ETL Processes: The selected freelancer will be responsible for the extraction, transformation, and loading of data into our warehouse. We are working with a medium-sized dataset (1-10 terabytes), so we need someone who is not only experienced in data warehousing but also with datasets of this size. Ideal Skills and Experience: - Proven track record in d...

I'm looking to data scrape the price of popular electronics across different retailers and online marketplaces in Australia. Some of these Australian websites/competitors include: - - - - - There is also a similar competitor called , that gets the prices of thousands of retailers across australia and displays it to the customer. If we can see how they are achieving this or tap into that data, that will add to this perfectly. if possible, we also need to collect data from the bigger marketplace giants such as , facebook marketplace (AU) and even amazon. If not possible, we can discuss getting data through external API tools such as

I am experiencing significant issues with indexing on my business website. Specifically, I am facing problems with pages not getting indexed and multiple indexing errors. The SEO plugin I am currently utilizing is Yoast SEO. Ideally, I require a specialist with: * Proven expe...am facing problems with pages not getting indexed and multiple indexing errors. The SEO plugin I am currently utilizing is Yoast SEO. Ideally, I require a specialist with: * Proven experience in resolving indexing issues on business websites. * Expert knowledge in handling Yoast SEO and optimizing it for better performance. * Ability to identify and rectify indexing errors to ensure seamless crawling and indexing by search engines. * Proficiency in providing strategic solutions to prevent such issues in t...

I'm looking for a skilled professional in green screen extraction and digital backdrops, specifically for photography purposes. Key Requirements: - I need a standard JPEG format for the final images. - The subjects to be extracted from the green screen are individuals with simple poses, so complexity is relatively low. Ideal Skills and Experience: - Proven experience in photography green screen extraction. - Proficiency in working with JPEG images. - Ability to handle simple subject compositions.

...Research and Data Collection: The freelancer should be proficient in online research and data scraping. Identify reputable sources, databases, and directories where radiologist information can be found. Collect accurate and up-to-date details for each radiologist. Data Fields: Full Name Clinic/Hospital Name Clinic Address Phone Number Email Address (if available) Specialization (e.g., diagnostic radiology, nuclear medicine, etc.) Creativity and Resourcefulness: Think creatively to find hidden or less obvious sources of information. Explore medical association websites, healthcare directories, and professional networks. Utilize search engines, social media, and other platforms to extract relevant data. Quality Assurance: Ensure the accuracy and completene...

...companies within the hi vis industry in Australia. Key Responsibilities: - Expand the market reach of the designer clothing to various industries including Construction, Mining, Logistics, Retail and Healthcare in Australia. - Develop and maintain relationships with clients to ensure repeat business. - Achieve set sales targets and report on sales performance. Ideal Skills and Experience: - Proven experience in sales of designer clothing or related high-end fashion products. - Strong communication and negotiation skills. - Familiarity with the hi vis industry and/or experience in B2B sales within Construction, Mining, Logistics, Retail or Healthcare. - Ability to work independently and meet sales targets. - Knowledge of the Australian market and previous sales experien...

...core functionalities with the potential to integrate AI features in future updates based on user feedback and demand. Core Functionalities: Camera Integration: Users should be able to access the smartphone camera to take pictures of receipts. Data Storage: Extracted data should be organized and stored in an online spreadsheet service. Image Storage: Images of the receipts should be stored in an online file storage service with references noted in the spreadsheet. User Authentication: Implement secure user authentication to allow users to access their data securely across devices. UI/UX: Design a user-friendly interface that is intuitive and easy to navigate for users with varying levels of tech-savviness. The design should be responsive and follow current best pra...

I'm in need of a data processing expert who can assist me in developing an architecture to analyze knowledge graphs using ETL and machine learning. Key Tasks: - Leveraging Data Processing Expertise: I need someone with a strong background in data processing, particularly in relation to graph technologies. Your role will be to harness this knowledge to create an efficient and effective architecture for analyzing knowledge graphs. Ideal Skills and Experience: - Strong Data Processing Background: A deep understanding of data processing is crucial for this project, particularly in the context of graph technologies. Experience in working with large datasets and complex data structures is highly desirable. - Familiarity with Graph Technologies: Kn...

I'm in need of a data processing expert who can assist me in developing an architecture to analyze knowledge graphs using ETL and machine learning. Key Tasks: - Leveraging Data Processing Expertise: I need someone with a strong background in data processing, particularly in relation to graph technologies. Your role will be to harness this knowledge to create an efficient and effective architecture for analyzing knowledge graphs. Ideal Skills and Experience: - Strong Data Processing Background: A deep understanding of data processing is crucial for this project, particularly in the context of graph technologies. Experience in working with large datasets and complex data structures is highly desirable. - Familiarity with Graph Technologies: Kn...

I'm after detailed data on different YouTube channels and content creators of those channels for the purpose of market research. This project will require you to compile data on 100 YouTube Channels and channel owners with more than 100,000 subscribers in a set of categories (details provided in a spreadsheet to be filled). The data will include, subscriber counts, video counts, monetization activity, other social media presence and activity, and different engagement metrics including likes, comments, and shares from YouTube channels. This is currently a one-time requirement, but may lead to further projects in the future. - Ideal Skills: - Web Scraping - Data Mining - Social media search and scraping - Experience: - Previous experience in sim...

I require a competent professional with database gathering skills to generate a list of 50 email addresses. The key details for this task are: - The email address list should only pe...addresses. The key details for this task are: - The email address list should only pertain to US workers. Familiarity with US working sectors will be useful in this task. - The list should only include email addresses. No other personal information (like name or phone number) is necessary. - The task needs to be completed as soon as possible, so rapid work efficiency is desired. Your experience in data mining, particularly email lists gathering, will be a deciding factor for this project. Please include any relevant information on your ability to complete this task efficiently and ethically ...

I'm in need of a compound extraction specialist who can help me with a research project. Key Requirements: - Source: The compound is derived from plant material. Experience with plant extraction is beneficial. - Purity: The extracted compound only needs a basic level of purity for identification and study. Ideal Skills and Experience: - Prior experience with compound extraction, ideally for research purposes. - Knowledge of plant material extraction techniques. - Ability to achieve basic levels of purity for research purposes.

I'm in immediate need of a skilled data miner to copy the results from 1,000 Google search links into a Google Sheets document. TASKS: - Mining data from 1000 Google search results - Transferring these results into a Google Sheets document REQUIRED DATA: - The URL of the website - Additional details such as Company name, Address, and Phone numbers ALL TOGETHER INTO ONE CELL DESIRED SKILLS/EXPERIENCE: - Competency in data extraction - Proficiency with Google Sheets - Attention to detail is a must - Previous experience in a similar project would be beneficial Please note, I need this project completed ASAP. Flat fees; 10 NZD Please start your bid with 10NZD Thank you

I am searching for a talented illustrator to bring my concept to life. This project involves designing a mining sticker with a humoristic theme targeted at miners. The sticker will depict two cartoon characters in high visibility gear trying to access an underground coal face. One character, the miner operator, will be uttering the phrase "Seek approval before coming on my face". To be successful in this project, you ideally should: * Have experience in creating cartoon character designs. * Be able to effectively merge humor with illustration, as the humor in the design is crucial and should be conveyed through both text and character expressions. * Understand the mining industry to create a relatable and enjoyable design for miners. This project provides an opp...

I'm looking...focused on wholesale and retail medical stores located in India. Here are a few additional details about the project: - Sourcing: I will purchase leads from a known data provider, therefore, the freelancer must have experience in lead purchasing and data mining. - Criteria: Leads should be from the wholesale and retail medical stores industry, with a specific emphasis on leads located in India. - Quantity: The scale of this project is significant, as I'm looking to acquire more than one lakh (100,000) leads, implying the freelancer should be capable of working with large datasets. Ideal Skills: - Experience in lead mining and data acquisition - Familiarity with medical store industries - Ability to work with large datasets - Pr...

I need a proficient Embedded Engineer to design a PCB prototype for cryptocurrency mining. More details will be shared over a chat

I require the assistance of a skilled professional in web data scraping from Website 1. Your primary task will be to extract contact details. Upon successful scraping, these data needs to be cleaned and formatted before being delivered in an Excel sheet. The ideal candidate for this job would have solid experience in data mining, data cleaning and Excel. Skills and Experience: - Data Scraping - Data Cleaning - Microsoft Excel proficiency

I need a professional to help me generate a list of retail businesses from three specific markets - USA, UK, and UAE. - The businesses I want to be listed include Bakers, Clothing companies, Jewellery companies, and all other types of Retail businesses. The total quantity required are 200 each Bakers, Clothi...For each business, I require the following details: - Contact details (especially email addresses) - Location - City, State, Country - Business Domain / Industry It's important that the contact details are all provided in email format. You should be able to source and collate lists efficiently, ensuring the information is up-to-date and accurate. Experience in lead generation and data mining would be a huge asset for this task. Accuracy and attention ...

...host to the container -Validate Keystore file works successfully Cron Automation for Pipelines: -Set up a cron job to run each of the 13 pipelines hourly, starting at 02:00 AM, with subsequent pipelines running at one-hour intervals (e.g., pipeline 2 at 03:00 AM, pipeline 3 at 04:00 AM, etc.). Data Volume Management: -Mount a volume named logstash-data for persistent data storage. Simplification of Deployment: -Preferably, package the necessary files into a single tar archive to simplify extraction and execution within the container. Deliverables: A Podman Compose file that meets the above requirements. Documentation on how the system is configured and instructions for future modifications. Additional Notes: Familiarity with Logstash, Docker/Podman, and...

i want who can start work immediately just simple scan the QR code and push to server using webservice, i need this to be by today itself. Looking for a skilled developer to create a mo...accurately extract text from various image types. Ideal Candidate: - Proven experience developing cross-platform mobile applications - Prior experience with OCR technology is a must - Strong understanding of image processing - Ability to deliver high-quality, efficient code Requirements: - Build a mobile app for iOS and Android - Integrate accurate OCR technology - Develop a feature for text extraction from images - Ensure seamless functionality and bug-free operation. - Agile-based process with regular updates and iterations Please submit your application with a related portfolio and milestone ...

I need a proficient Embedded Engineer to design a PCB prototype for cryptocurrency mining. More details will be shared over a chat

...Implementation of NLP for easy user interaction - A recommendation engine for personalized advice Data Analysis: The system must be proficient in analyzing various types of financial data, including but not limited to: - The user's income and expenses to track financial habits and frequent expenditures - Investment portfolios for trend analysis, risk assessments, and potential growth opportunities - Credit card transactions to gain additional insights into purchasing behaviors Ideal Skill Set: - Experience in AI Development - Proficient in Predictive Analytics, NLP, and Recommendation Engines - Strong understanding of finance and personal budgeting systems - Deep knowledge in data mining and analysis Please note that the project's success will ...

I'm seeking a freelancer with proficiency in Python3 and OCR processes to assist with my forthcoming project. The objective is to establish an environment that can accurate...seeking a freelancer with proficiency in Python3 and OCR processes to assist with my forthcoming project. The objective is to establish an environment that can accurately extract printed text content from PDF documents. This extracted data should then be converted and provided in CSV format. The possible necessity of machine learning integration is anticipated, hence experience with such is advantageous. Key job requirements: - Python3 expertise for environment setup - Proficient in OCR for printed text extraction - Capability to export extracted data into CSV format - Familiarity wit...

...success rate and profitability of each trader based on their trading history. Provide a user-friendly interface to view and analyze the collected data, including visualizations and filtering options. Implement robust error handling and data validation mechanisms. Ensure the tool is scalable and can handle a large number of wallets and transactions. Desired Skills and Experience: Proficiency in blockchain development, preferably with experience in the Base Blockchain or similar networks. Strong understanding of cryptocurrency trading, wallets, and DEX protocols. Expertise in data analysis, data mining, and web scraping techniques. Familiarity with data visualization libraries and creating user-friendly interfaces. Solid problem-solving and anal...

I'm seeking an experienced data scientist with a strong background in machine learning and expertise in LSTM (Long Short-Term Memory) networks for a project of deep learning for speech emotion recognition. Here are the details: - The goal is not specified yet. The system might be used to enhance voice assistants, improve customer service, or analyze psychological data. - I expect applicants to provide detailed project proposals including steps you would take to complete this project and tools that would be used. - For data extraction and labelling, we will be utilizing existing datasets. Therefore, experience or familiarity with publicly available speech emotion databases will be an added advantage. Skills and Experience: - Expertise in LSTM and de...

...specific type of data from a social platform. Only Indian Python Developer Required. Key Details: - Purpose: The primary purpose of this script is to extract numbers from the social media platform. - Complexity: The data to be scraped is relatively straightforward. It's all about extracting numbers and not complexly nested or paginated. - Source: The numbers are scattered across various parts of the social media platform. Ideal Skills and Experience: - Proficiency in Python: A strong background in Python scripting is essential. - Web Scraping: Experience in web scraping will be crucial for this project. - Social Media Data Extraction: Prior experience in extracting data from social media platforms is a significant advantage. - Attention to Detai...

...homes, dental practices, and law firms. For each lead, we require the following information to be accurately sourced and documented: Phone Number Email Address Website URL The project will encompass a total of 450 leads, distributed evenly across the three sectors with 150 leads each. The data must be current, verifiable, and neatly organized in CSV format for seamless integration into our CRM system. We prioritize accuracy and are looking for someone who can guarantee the correctness of the provided data. The chosen freelancer should have a proven track record in lead generation and scraping techniques, preferably with access to the necessary tools to streamline the process. It is essential that the freelancer is willing to work closely with our team, ensuring open co...

I'm looking for an experienced professional in Celonis Business Process Mining. The assignment consists of performing the following six tasks on Celonis. The Dashboard must report the methods and findings (how you solved the task and the insights). Please, have a look at the BPI website1 for an overview of the process. Tasks: Perform the following tasks. 1. Use the Process Variant components to explore the key features of the domestic and international process. What are the main differences between the two processes in terms of activities? And in terms of KPIs? 2. For both the domestic and the international process, what is the average throughput time in days from the first submission from an employee (Declaration SUBMITTED by EMPLOYEE) to the

...Keyphrase Extraction Using BERT and Unsupervised Embedding Approach **Overview:** This project focuses on developing an AI-based keyphrase extraction system for scientific documents. It aims to address the challenge of extracting keyphrases from longer documents by leveraging advanced NLP techniques. The project utilizes the S20RC dataset and incorporates tools like GROBID for document preprocessing. **Objectives:** 1. Implement a keyphrase extraction system using BERT and unsupervised embedding approaches. 2. Utilize the S20RC dataset for training and evaluation. 3. Evaluate the system's performance using the F1 score metric. 4. Integrate GROBID for structured data extraction from PDF documents. 5. Develop a pipeline for document ...

...sophisticated bot that leverages language models to interact contextually with user queries based on extensive text data. This role involves implementing cutting-edge technologies to ensure precise information retrieval and context-aware interactions. Additionally, the role includes another critical project focusing on enhancing data analysis techniques. You will develop systems to evaluate and refine the accuracy of data extraction methods, particularly by minimizing error rates in automated data categorization using language model capabilities. Key responsibilities include coding in Python, integrating open-source language models, and creating robust mechanisms for error handling and data filtering. The ideal candidate will possess strong pr...

I urgently require a web scraper built to scrape the exercise program layout from a specific fitness website. Your task will be to extract data pertaining to the personal training categories, subcategories, and filters. Specifically, the scraper should be: - Able to extract the training categories and subcategories - Efficient in scraping price filters - Functional and delivered by today The ideal freelancer for this project should have previous experience in creating a web scraper and a strong understanding of data extraction from complex website layouts. Prompt delivery is of the essence for this project.

I'm looking for a skilled developer to create a mini app for Telegram. - The app needs to allow user authentication and secure logins. - It should utilize the Telegram platform for both its frontend and backend. - The main purpose of the app is to facilitate cryptocurrency mining. - The app should support mining within the Telegram interface. - App should be Connected to telegram wallet. Ideal Skills: - Experience in developing Telegram apps. - Proficiency in cryptocurrency mining. - Strong understanding of user authentication and secure systems. Please let me know if you have relevant experience in this area.

Looking to hire an experi...files, Word documents, and HTML data from two targeted websites. Here's a little more information about what you'll need to do: - Develop a cron job to automate the web scraping process - Utilize IP rotation proxy in order to prevent site blocking - Implement the extraction of specified metadata and documents - Store extracted metadata in a database - Download and organize extracted documents in a local folder - pick up incremental data from last run. Ideal Skills and Experience: - Proficiency in Python - Extensive experience with Robot Framework - Work experience in web scraping - Experience with cron jobs - Understanding of IP rotation proxies - Experience working with databases - Comfortability dealing with PDF files, Word do...

I need an SQL query to extract specific information from the Moodle database. The query should pull the name of the user, a list of activities they have completed, and the time they have spent on SCORM packages if they have interacted with any. Key requirements include: - Extracting user's name and completed activities. - Differentiating SCORM packages and calculating time spent on t...including them in the results with zero activity count. If you are familiar with PostgreSQL and Moodle database structure, and have experience writing efficient SQL queries, this project is for you. Your query should be optimized for general use, without specific version constraints. The ideal candidate for this task should understand how to navigate Moodle's database structure for effective ...

I'm currently seeking a professional data scraper who can successfully extract specific content from an existing mobile app.

I urgently require a tech wizard to install Binwalk on my Windows 11 PC. The expert on the other end should be proficient in setting up software on different versions of Windows and, ideally, have experience with Binwalk. Need it for firmware extraction and other tasks. Key Objectives: - Successful installation of Binwalk - Ensure flawless operation of Binwalk on my PC Ideal Skills: - Prior experience with Binwalk - Knowledge of various Windows OS versions. Given I need this completed ASAP, a swift and efficient service is necessary.

I need a freelancer to help with a standard data extraction project. - Main Purpose: The main aim of this project is to crawl data for me. - Data Type: This project specifically requires the extraction of contact information. - Source: The data is to be extracted from business directories. I'm looking for a professional with experience in web scraping and data extraction. The ideal candidate should be familiar with the nuances of handling contact details and should be able to deliver the extracted data in a structured and organized format.

Build Python Program for web data extraction. Name, Mobile & email of Real Estate Agents

I'm looking for an expert in Bitcoin mining with ASIC Miners. I already have the hardware required, but I need help to set it up. Key responsibilities are: - Assisting with the miner setup process - Configuring the miner to work with my chosen mining pool The ideal freelancer for this project should have: - Extensive experience with Bitcoin mining - Experience setting up ASIC miners - Knowledge about effectively joining and configuring miners for a specific mining pool Your guidance will greatly contribute to the success of this mining operation. I'm excited to learn from your expertise.