DMOZ / Open Directory RDF Dump Parser(repost)(repost)

Completed Posted Nov 9, 2009 Paid on delivery
Completed Paid on delivery

**Easy parser; great for RAC newbies! You can do it! :-)** The Open Directory provides all of its data as *enormous* RDF files. We only need the URL's for a certain subset, delivered as a text file. Write the software in your favorite language.

Even though we are buying the software, it's only going to be run a few times, on your computer. This project gives us the right to have you run this five times, (with different queries of a similar nature), but you will be paid in full upon the first successful run.

## Deliverables

All parsing should be done on the file(s) from the [Open Directory RDF Dump][1]. You need to determine *which* file(s) is/are most appropriate, based on what is stated there. (Warning: Those files are absolutely enormous!) **Do _not_ "scrape" the human-readable area of the site;** those are only mentioned below for the convenience of communication!

The first run is to extract all URL's from [Health: Alternative][2] and *all* subordinate sections (recursively) *except* for the [Opposing Views][3]. Future runs will have a similar specification.

Generate a text file with one URL per line. Remove the "http://" or "https://" (or any other protocol) from the beginning of the URL. If the URL then starts with "www.", strip that, as well. (Yes, I understand that this step may/will generate some broken URL's.) If the URL *ends* with a *trailing* "/", strip that, too. Do *not* strip any other "/" characters that may remain!

**Example:** "ftp://[login to view URL]" should be stored as "[login to view URL]", even if DNS is not set up to make that a valid, working URL.

The deliverable is the text file and the software used to generate it.

There is no such thing as a stupid question. Please feel free to ask me anything!

We will retain all rights to the software produced.

* * *1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables):

a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

Any platform, any language. Line breaks should work under Windows, i.e., don't forget to use "\r\n" if you are on Unix.

Engineering MySQL PHP Software Architecture Software Testing Translation Web Hosting Website Management Website Testing

Project ID: #2956930

About the project

7 proposals Remote project Active Nov 10, 2009

Awarded to:

jamezb

See private message.

$12.75 USD in 3 days
(1 Review)
0.2

7 freelancers are bidding on average $112 for this job

idealsolutionvw

See private message.

$425 USD in 3 days
(105 Reviews)
5.5
frankdull

See private message.

$84.15 USD in 3 days
(26 Reviews)
4.6
kaifucomputing

See private message.

$127.5 USD in 3 days
(15 Reviews)
5.0
chameleonde

See private message.

$59.5 USD in 3 days
(4 Reviews)
3.3
websystemsAm

See private message.

$42.5 USD in 3 days
(16 Reviews)
2.4
albertlr

See private message.

$34 USD in 3 days
(4 Reviews)
1.9