Write some Software

I'm looking for someone to write a web crawler that can allow us to make a list of every URL on our website domain, which is

We are about to rename our business and move over to a new domain, so I need all of the URL's from our current site so that I can set up forwarding for every page to the new domain.

I've tried using some off the shelf crawlers that are available on the internet, but they only ever pull back maybe 700 - 1000 page URLs which is too few, and the lists were definitely incomplete.

I would need the data supplied in an Excel sheet, with a URL on each line.

Any questions, please just ask.

Skills: Script Install, Software Architecture

See more: free software write company profile, software write websites idea, software write book images, java, perl, microsoft excel, software write books, software write protection, mysql regex pull image urls, free software write book, post software project internet, software write book, paid write internet, write internet marketing proposal, write internet sales page clickbank, software write protect software, software write technical manual

About the Employer:
( 1 review ) Newcastle upon Tyne, United Kingdom

Project ID: #11747961

Awarded to:


Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the URL Crawling program you require. To do so, I will use the libra More

£111 GBP in 3 days
(24 Reviews)

10 freelancers are bidding on average £131 for this job


Looking forward to discuss more details about the project and deliver the same to your specifications.

£111 GBP in 3 days
(73 Reviews)

I am expert in all your required SKILLS.I can give you best [login to view URL] for your reply. I can start working right now. Thanks,PS-M

£200 GBP in 3 days
(12 Reviews)

HEY . Now all the links from your site [login to view URL] I have experience scrape some data from a website into Excel. I write a parser in Excel VBA. very comfortably. You p More

£150 GBP in 3 days
(7 Reviews)
£222 GBP in 3 days
(1 Review)

hi The previous web crawler works on this website are from secure websites ctrac, tripadvisor and expedia I'm a freelance developer from 4 years and as a freelancer I develop automation works like filling forms, fetc More

£100 GBP in 3 days
(5 Reviews)

Hello There, I have this kind of work and certainly confident to do this. I will provide a screen shortly as sample and if ok then I can proceed with full list. I have extracted each and every link. Snapshot is at More

£150 GBP in 3 days
(1 Review)

hi I experienced with web scrape 5+ years. I know your incomplete reason.I can do your project. Lets interview. Thanks

£55 GBP in 3 days
(0 Reviews)

I can finish this job by today. I can comply to all your requirements. lets start chatting to discuss on how to start the project?

£75 GBP in 1 day
(0 Reviews)

A proposal has not yet been provided

£136 GBP in 4 days
(0 Reviews)