Find Jobs
Hire Freelancers

Crawler & parser

$100-300 USD

Cancelled
Posted almost 12 years ago

$100-300 USD

Paid on delivery
A python crawler and parser of links on web pages needs a few features added. At present it crawls links and lists them. It needs: 1) Saving the parsed and additional data into a fast database that can handle many millions of records without read or write delays or glitches 2) an added line to use proxies 3) add alexa rank of the top level domain of the crawled page, pagerank of the page, information if the link is a no-follow or do-follow, the link anchor, SERP position of the page, facebook, twitter and g+ likes of the page, time accessed and of course page of access to parsed record data. Advise if LXML should be used a parser or if the current set-up is OK in terms of speed and being as light on the target websites as possible. **Important:** Please name the inventor of the Python programming language for your bid to be considered. The 3 days deadline is only a testing period. **The project WILL BE extended** IF sufficient progress is observed during the first 3 days and at each successive extension period.
Project ID: 2742201

About the project

2 proposals
Remote project
Active 12 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
2 freelancers are bidding on average $124 USD for this job
User Avatar
See private message.
$120.70 USD in 3 days
5.0 (3 reviews)
2.5
2.5
User Avatar
See private message.
$127.50 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of GUADELOUPE
Key Farto, Guadeloupe
4.7
32
Member since Jul 19, 2005

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759) & Freelancer Online India Private Limited (CIN U93000HR2011FTC043854)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.