Find Jobs
Hire Freelancers

Python or R code to copy data from an XML output of a url to a txt file and continue the loop.

$10-30 USD

Cancelled
Posted about 4 years ago

$10-30 USD

Paid on delivery
I have a website which I need to run after every 3 minutes and copy its XML output into a csv or txt file. The url updates data after every 2 minutes , so after every new update there are some new data posted and some of the old data remains in the url. I want to code to copy all new values added to xml url, The problem is that when the data increases in the txt file, it takes longer to check the duplicates and the code lags behind in collecting data. I need someone who can do this.
Project ID: 24131751

About the project

11 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
11 freelancers are bidding on average $100 USD for this job
User Avatar
Hello, I can help you with your project - Python or R code to copy data from an XML output of a url to a txt file and continue the loop. I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Please visit : https://www.freelancer.com/u/schoudhary1553 I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you. Kinds Regards, Sandeep
$90 USD in 2 days
4.9 (540 reviews)
8.5
8.5
User Avatar
Hello I have almost 4 years of experience with Python and Web Scraping What is URL you need to scrap? About searching duplicates, we can use various dictionaries and hashtables to search duplicates. Also,maybe it's better to use database for it, like MySQL or maybe even SQLite There would be needed another script to extract data from DB to text file. But it would solve "slowness problem" significantly.
$32 USD in 1 day
5.0 (727 reviews)
7.3
7.3
User Avatar
Hi there, Yes! This task is for me please. Don't worry about the speed, let us use sqlite db in place of text file. So that duplicates will be checked, no matter of its size. Best regards, Ishaq
$30 USD in 2 days
5.0 (176 reviews)
6.7
6.7
User Avatar
Hi , Honest and reliable Australian company delivering at a LOW COST and on-time. 1) Same or lower prices than individual developers. 2) Great communication skills 3) Large pool of skilled and professional team members. Software, Web apps, Mobile apps, E-shops Please note that we placed a bid to initiate the conversation but we will require specific instructions and details in order to provide you with an accurate price estimate. Do not hesitate to contact us for any further clarification. Data Processing, PHP, Python, Web Scraping, XML
$450 USD in 7 days
4.9 (11 reviews)
6.1
6.1
User Avatar
Hello, We can collect the information into json file and check the duplication and we don't have to check every code in xml, we can find the latest that is crawl 2 minutes before. And I can implement multithreading very well it works really fast or we can map the outputs to search quicker. There are ways to overcome the problem but still I need more information and the website to work on. You will be satisfied for sure. Thanks Best
$59 USD in 7 days
5.0 (47 reviews)
5.4
5.4
User Avatar
Professional software developer, expert in web scraping and XML/JSON parsing. Can easily set up this script for you. HTTP request to the website to load in the data, reformat as a CSV of text file (your preference) and save / overwrite existing file. Happy to help and ready to start right away.
$20 USD in 1 day
5.0 (12 reviews)
4.3
4.3
User Avatar
Hi, how are you? I can do your project! And i have a very smart idea to make it no lag! Please contact me! Hope to work with you!
$10 USD in 2 days
5.0 (4 reviews)
2.5
2.5
User Avatar
Hello I can do that. New mechanism is need to implement there. Pawel
$333 USD in 7 days
5.0 (3 reviews)
2.1
2.1
User Avatar
Very easy task I can do it in one day without problems. I've done it many times. Please just share the details. Thanks.
$28 USD in 1 day
5.0 (2 reviews)
1.4
1.4
User Avatar
Hello there, i hope this proposal finds you in the best of your health. I saw your job posting and i would like to take this on and provide you with the most efficient results. I have hands on knowledge about web scrapping and Bot automation in Python. I have spend around 3 years in this field and i have confidence in myself that i'm the right guy for this job. Looking forward to hearing from you.
$20 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hey there! I'm interested in your problem statement. I have a good command over python modules & data analysis. Let's discuss this in details.
$30 USD in 6 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Philadelphia, United States
4.9
36
Payment method verified
Member since Feb 19, 2018

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759) & Freelancer Online India Private Limited (CIN U93000HR2011FTC043854)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.