Completed

Write some Software

This project was successfully completed by mwarrenschultz for £111 GBP in 3 days.

Get free quotes for a project like this
Employer working
Project Budget
£20 - £250 GBP
Completed In
3 days
Total Bids
10
Project Description

I'm looking for someone to write a web crawler that can allow us to make a list of every URL on our website domain, which is www.basketballmegastore.com.

We are about to rename our business and move over to a new domain, so I need all of the URL's from our current site so that I can set up forwarding for every page to the new domain.

I've tried using some off the shelf crawlers that are available on the internet, but they only ever pull back maybe 700 - 1000 page URLs which is too few, and the lists were definitely incomplete.

I would need the data supplied in an Excel sheet, with a URL on each line.

Any questions, please just ask.

Completed by:

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online