In Progress

Develop a scraper to analyze information about a website

The code will run via API (No UI needed).

Input: a list of website URLS

Out put: The list of URL's with this extra data about the site:

- Company type: Manufacturer / Online Store / SMB (Suggestion to how to find this data is below).

- Is the website mobile friendly: yes / no

- Load speed (Homepage load speed in msec)

- Is Google analytics installed: yes / no

- Is there a link to facebook: yes/no

- What CMS is used: Wordpress / Joomla / Wix / Drupal/ ExpressionEngine / TextPattern / Radiant CMS / other.

- Contact form link (The URL where a contact form is, if there is one).

Finding the "company type":

In order to find this information, first analyze the text on the homepage.

1- Look for links with the text "products" "our products" "product catalog" also look for "distributors" "find a distributors" and so on. Usually companies that have a link with this language are "manufacturer".

2- Look for "cart" "checkout" or "add to cart" links. If these are present, this is an "online store"

3- Look for "opening hours" or "directions" in the website. Usually if this text is present, this is an "SMB" (small/medium business).

Skills: Data Processing, PHP, Python, Software Architecture, Web Scraping

See more: website develop company in rajasthan, develop company website, develop website content for software development company, website develop company, software write mq4, software write chip epson, useful software write book, software write web specs, free software write user guide, software write edid, free software write company profile, software write websites idea, css based website develop company recent project, software write book images, software write books, software write protection, free software write book, software develop company profile bangladesh, excel website information, vba excel capture website information, software write book, website information excel, develop company knowledge base, update website information automatically php, siemens information systems ltd good company work

Project ID: #11741982

Awarded to:

mwarrenschultz

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the website analysis program you require. To do so, I will use the l More

$133 USD in 3 days
(52 Reviews)
6.3

16 freelancers are bidding on average $121 for this job

mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, More

$68 USD in 2 days
(259 Reviews)
7.3
Maariyaa

Hello Dear, HERE Ready to start!!! I can perfectly do it. I have lot of experience related and different types of projects. I am waiting to your quick positive reply. Feel free ask me question if any. I Look for More

$250 USD in 3 days
(197 Reviews)
6.6
abupabuya

hi sir i had very high and fresh quality 2016 list may be u interested of it YELP.com 2016 150,000 email list https://www.dropbox.com/s/qkmly9cp3siehmt/yelp_email_sample_2016.csv?dl=0 houzz.com 2016 150,000 More

$50 USD in 3 days
(70 Reviews)
5.9
amitarai

Hello My name is Pranav I have checked the details shared by you will do done exactly what you want Please consider my bid and we can discuss more so that i can assist you in better way our services always with More

$155 USD in 7 days
(65 Reviews)
5.7
einnovention

Hi! While reading your project description, It’s proud to say that I can demonstrate my professionalism on the highest level. I am ready to assist you day and night, 24/7. Your queries/questions will be answered promp More

$105 USD in 3 days
(61 Reviews)
5.6
marcocatania

Python programmator since 2012. I used to create a lot of applications about Web Scraping/Crawling with BeautifulSoup/Selenium/PhantomJS/lxml I love Computer&Hack and I'd like to share my passion helping someone with c More

$277 USD in 3 days
(18 Reviews)
4.9
$272 USD in 5 days
(44 Reviews)
5.1
sanidhayy

Hello, I am a Highly Experienced Freelancer from India. I have read your project description and I have some questions regarding your project. I would like to talk to you directly to discuss more about the project. You More

$165 USD in 1 day
(12 Reviews)
4.1
arthurbarros

Pretty straight forward we could even use Google Pagespeed API to extract even more meaningful data. I intend to use Python 2.7, python-mechanize, requests lib, RabbitMQ as a Queue broker and MongoDB as the database wh More

$140 USD in 2 days
(1 Review)
0.4
DavHack

A proposal has not yet been provided

$45 USD in 2 days
(0 Reviews)
0.0
DashaDotNET

Hello there! My name is Dasha, i'm Business Development Manager in InternetDevels company. We are located in Ukraine and having 100+ developers with 9+ years of experience in the Drupal and around 11 years of experien More

$155 USD in 3 days
(0 Reviews)
0.0
halilceliksu

I and my friend are python proggramer. We wrote some codes that get and analyse urls and informations from different news web sites. So we can do what you want.

$88 USD in 3 days
(0 Reviews)
0.0
shumiakter

Dear sir Your project is based on..............................I have done many job like as your project. Provide me your budget, time frame and more detail's please ! Thanks.

$35 USD in 3 days
(0 Reviews)
0.0
saymajahan

Hi, I'm Sayma Jahan. I have enough experience in this field. I can easily complete this project as per your instructions. How much is your budget and how long will be the time frame? Thank you.

$30 USD in 3 days
(0 Reviews)
0.0
muhamedze

A proposal has not yet been provided

$55 USD in 1 day
(0 Reviews)
0.0
lizakter

I mainly create eye catching eCommerce sites and high quality service websites. I love WordPress and social media. I will create website in WordPress platform for you and promote using social media. I also know sear More

$30 USD in 3 days
(0 Reviews)
0.0
$155 USD in 3 days
(0 Reviews)
0.0