Find Jobs
Hire Freelancers

BrownRecluse Script -WebSpider

$30-250 USD

Completed
Posted about 15 years ago

$30-250 USD

Paid on delivery
I am needing a custom script written for BrownRecluse. I am looking to have some data mining done for my own site, pdmautoparts.com. I will use it essentially to create a product data feed. Now a majority of the data is generated dynamically and I would like to be able to pull all this info down. For example, I need all the year, make, model, category, price, and etc info to be pulled down and then be exported to a CSV file. The data to be retrieved can be found by starting the drill down process here: [login to view URL] . As you can see the data is pulled dynamically but I only need to the actual text to be crawled, i.e. 2005 BMW 325i Sedan (Engine:M54; Chassis:E46;) then all the part categories, etc for each vehicle make. This can be done as I have seen it before. If you are unfamiliar with BrownRecluse, it is a spider that is 100% programmable. I have attached the installer for the program and there is also a small synopsis of how it can be coded/written, SEE BELOW. "The programming language used in BrownRecluse was developed by SoftByte Labs, and is called SBL (Spider Bot Language) which is also the company initials. It is based on Pascal but uses some javascript/Basic concepts to accommodate almost all programmers. It is a structured object oriented language and is very easy to master. The language was designed for Internet spidering programs. This means, you do not need to worry about making functions to access the internet, pull web pages or files etc. The language already include everything you need. For example, if you wish to pull a web page and display its source code in the output window, you only need 4 statements. One to create a URL object, one to assign the actual URL to pull, one to get the data, and finally, one to display the data. Here's how to do it... Link = New(URL); [login to view URL] = '[login to view URL]'; [login to view URL]; Output([login to view URL]); So you see, it is very easy. You do not need to know how to program sockets and protocols. As you may already know, The Pascal language uses := for assignments. We do not, it is less confusing, and Javascript/Basic programmers can understand the language better. One major thing to remember is the ; (semicolon) at the end of every statements. It is a Pascal/Javascript/PHP/C++ standard, not Basic however. The reason is simple. You can spread a statement across several lines for clarity. Basic uses a line model, thus, the statement must fit on a single line. Here's an example... if [login to view URL] then output([login to view URL]) else Output('There was an error.'); There is no need for the conventional endif closing statement. In short, white spaces (spaces, tabs, returns) are ignored by the compiler, so you can spread your code over as many lines as you wish. SBL uses both, Basic like and C++ like assignments. For example... x++; is the same as x=x+1; x+=y; is the same as x=x+y; " For an experienced programmer, this should ideally take only a few hours. Please post any questions, if there are any. Thanks! Dave Additional Info (Added 4/6/2009 at 9:11 EST)... *** Important *** I will need the crawler/script to retrieve Year, Make, Model, Category, Subcategory, and Product and then have it exported to a CSV file separating into its own columns. If you cannot work with BrownRecluse, I am not opposed to having a custom crawler/scraper made as long as we can stay close to our budget. You can also download the app here: [login to view URL]
Project ID: 418972

About the project

1 proposal
Remote project
Active 15 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
i know how very well how to build this program :)
$130 USD in 2 days
5.0 (33 reviews)
6.7
6.7

About the client

Flag of UNITED STATES
Dunedin, United States
5.0
11
Member since Mar 18, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759) & Freelancer Online India Private Limited (CIN U93000HR2011FTC043854)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.