Data upload tools for a web-based repository

Job Description

We need a client-side tool/ GUI that allows users to upload data into our web-based system. We are looking for bidders with expertise in data science. Our desired candidate should have previous database creation/management experience, creative approaches to problems that arise, strong communication skills and long term foresight. A proof of concept as well as the use of the data aggregation tool may be necessary so that the candidate can demonstrate the necessary skills. If the relationship is successful, we would be interested in extending it over the longer term. A significant part of this project will be understanding what the existing systems does when reading the already existing data sets, and then building the import tool by making sure the end product meets the requirements set for the existing datasets.

Over the long term, we want to build the data import feature out to be fully automated by crawling websites to look for data updates and automatically bring them into the data aggregation tool, format them appropriately and analyze the data for any anomalies. Additionally, the feature would be able to translate data headers (such as country names) into one uniform moniker. For example, the tool would be able to convert any iteration of the United States (US, USA, United States of America) into a single identifier.

About the tool

The current data aggregation system is developed using Python in Django framework. At the backend it relies on MongoDB and MySQL. Moreover, the tool uses several third-party programs including jsonschema, xlrd, xlsxWriter and xlwt. The tool aims to build a crowd-source data analytics platform to serve as a collaboration tool for sharing, cleansing, and augmenting data sets among an online research community, which gears up domain-specific studies with data science methodologies including exploration, visualization, and quantitative analytics.

The system has a django based backend API that links to the repository and generates .JSON format data sets for reading into the web API. These data set were loaded into the repository at the beginning of the designing process. From these initial datasets, the backend API generates JSON encoded data sets , parses them into HTML (using .getJSON), and populates them into the user interface. The user interface displays a list of matrices whose content can be downloaded in .JSON format conforming to a specific parsing format.

Specific task

At its current state, the system can display and export data in .JSON format for the set of already existing datasets. However, it does not have the tools to replicate the process of uploading these datasets or any additional new data sets. The task for the developer is therefore, to develop a tool to convert raw data in .xls, format it into the current .JSON format, and finally into the format compatible to the DataGator database.

We have attached some supporting and background documents. In addition, we have attached python and other codes that were initially meant to import data but were not utilized. Please familiarize yourself with all attached documents and respond with any questions or suggestions you may have.

Skills: Django, Javascript, NoSQL Couch & Mongo, Python, RESTful

See more: when to look for a new job, what we need for web developer, what to look for in a web developer, what is web research job, what is web designing, what is mongodb, what is augmenting, what a developer should have, web research job description, web develop on python, web developer with codes, web developer science, web developer python, web developer programs, web developer names, web developer job requirements, web developer django, web developer database problems, web developer community, web designing programs, web designing html codes, web designing codes in html, web based programs, visualization job, upload yourself

About the Employer:
( 55 reviews ) United States

Project ID: #6664902

18 freelancers are bidding on average $1458 for this job


Hello , May I discuss with you for further details about this project? I'm a webdeveloper over 6 years experienced, solid knowledge MCV and OOP. I have a lot of experienced with PYTHON (Djdango framework) . More

$1421 USD in 20 days
(228 Reviews)

Let's discuss over freelancer Personal Message Box for the proper estimation of cost and time. I am myself doing programming so you will directly work with one person and that's me. No mediators. No managers. No sub More

$1365 USD in 20 days
(23 Reviews)

Dear Sir, We have read your Project Description to understand the scope of work. This is very much doable & technically there are no hurdles but I am afraid that our estimate is higher, so would you be flexible in y More

$1546 USD in 30 days
(8 Reviews)

Hello, I have read your post and understood your requirement. I have great experience in handling Wordpress /Magento/Joomla/Drupal/PHP/Java/node.js/AngularJS Python/Django/Javascript/MySQL/ HTML5/CSS3/ More

$1546 USD in 15 days
(28 Reviews)

If you want a quality site for a fair price contact me! Custom sites, all programming languages and database types. Sites include administrative back end systems. All bids and durations are just an estimate until you c More

$1263 USD in 25 days
(10 Reviews)

A proposal has not yet been provided

$1111 USD in 10 days
(63 Reviews)

I am willing to deliver the project as per your specifications and discuss about the same .

$1184 USD in 20 days
(48 Reviews)

Dear Client Our Python Case Studies: [login to view URL] [login to view URL] We are also open for technical interview. We are ready to start the project immediatel More

$1546 USD in 25 days
(15 Reviews)

Hi, Placing our estimated bid as per description but price may vary after further responses. The project involves importing the .xls format data => such as [login to view URL] to JSON format =>(Similar to previ More

$1333 USD in 25 days
(24 Reviews)

Python & Django expert here. Hi I am is Hadi, Freelance software developer with an special interest on free software, GNU/Linux and Python programming language. After years of experience working on Network App More

$1388 USD in 30 days
(12 Reviews)

Hi! I have checked your requirement carefully. I am a expert of WebSite development and mobile apps. I am an iOS/Android software expert with rich experience. I have built several successful iOS/android games: si More

$3436 USD in 12 days
(1 Review)

Dear Hiring Manager, First of all,its my pleasure to bid on your project, I have gone through description provided in project post. But we need to see full documentation of your requirements, So that we will be abl More

$750 USD in 20 days
(20 Reviews)

Sir i along with my team of [login to view URL] are being developing these types of projects from past 6 years. We can do your project with full anlaysis and research. We are bidding in your project an approximate amount t More

$2000 USD in 120 days
(0 Reviews)

I have been developing many applications on DJango,Django Rest Framework, Python, Postgres,Web API, Knockout.js, Kendo UI , Unit Testing from last 2 years. I am 3.5 years .Net developer. I developed projects on ASP. More

$1000 USD in 45 days
(0 Reviews)

A proposal has not yet been provided

$1111 USD in 10 days
(0 Reviews)

I am a Django Developer , Graduated from the TU Berlin: Technische Universität Berlin Computer science and German University in Cairo for Business informatics , Have been using Django as main language for 3 Years now More

$1666 USD in 14 days
(0 Reviews)

A proposal has not yet been provided

$1250 USD in 20 days
(0 Reviews)

Dear Client, We have gone through given requirement detail and confident to deliver you best solution as we have expert in-house team of Python programmers who deliver best & bug free solution to our clients. We More

$1333 USD in 30 days
(1 Review)