ISO of season programmer/DBA for data scrapping and data collection.
What I need: - Mine users from various social networks in an organized and structured format using non API strategies. ex: if the user has their Facebook account and open to the public vs users w/higher restrictions. Names, places, etc... must be stored in a DB in an organized (on-the-fly) fashion especially since different social networks provide different datasets. - compare user datasets and provide a clean user dataset with 95% accuracy or higher - DB should be well structured and maintained. Speed of receiving the data is essential therefore DB should be efficient and every millisecond counts. Therefore data should be small and fast.
Broad Strokes - Scrap data from Social Networks - Clean data to create one unique dataset of users. - store in DB with the purpose of retrieving large datasets fast and efficient. ie. 10gigs of data compressed and ready for d/l. Required - know the in-and-outs of the most popular social networks in the US. such as facebook, google, snap, instagram and be able to scrap data from the app directly. - programming to match datasets to create unique datasets. - experience DBA who understands format/structure and compression.
If there is existing code for scrapping than please provide me with the facts and how you can modify the code to be able to improve upon its collection functionalities. I have searched the internet and found a lot of scrapping code. We can use the tools provided to us by the internet and not recreate the wheel. Please be honest and fast with your work.
I am searching for a professional who has experience with this topic and able to speak daily either on the phone or msg. Don't be difficult. Thank You .
Answer these questions: - how many Data Mining projects have you worked on? -
please provide me with three of the most exhaustive data mining YOU completed.
What was your actual role?
- Do you have a data mining program?
- How would you data mine Facebook?
- What type of data will be mined? be specific.
- How would you clean up the data? be specific.
- How would you store the data? in what format? and the reasons for the selection
- How would the data be encrypted, compressed, and downloaded? whats the encryption, compression, and speed for d/l of 10gigs via a cable connection.
- How is the data presented? etc... T
Those with true knowledge can answer these questions in detail. Please help me decide to select you with knowledge of developments.
9 freelancers are bidding on average $1123 for this job
Hi there, I have checked the details I have rich experienced with Data Mining, Data Processing, Database Administration, Hadoop. Please initiate chat so we can discuss this job.
hi dear. i read your description carefully. i have a good experience for your idea. so i bid to you. please contact me, then you can check out me for your idea. thank you. best regards.