Find Jobs
Hire Freelancers

Pyspark python data transformation project EMR AWS

min $50 CAD / hour

Closed
Posted over 3 years ago

min $50 CAD / hour

This is an on-going project. Potentially more than 6 months This phase of the project is on : Writing classes and functions using Python and PySpark using specific framework to transform data Transformations are easy rules. ex: if field1=A, field2=b , change field3 and field4 Data is in csv file on EMR cluster but for now we will use the test in script work will be between 2 hours to 20 hours per week. can be different each week
Project ID: 28230398

About the project

21 proposals
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
21 freelancers are bidding on average $53 CAD/hour for this job
User Avatar
Hello yasisarin,   We have 20 years of strong experience in Python, Data Processing, SQL, Amazon Web Services, PySpark, as a result, we can successfully complete this project.   Please, review our profile here: https://www.freelancer.com/u/tangramua Here detailed information about our company, our portfolio, and the client's recent reviews.   Also, we wanted to personally discuss questions about your project, which helps us to give you the right estimation.   Best regards, Tangram Canada Inc.  
$64 CAD in 5 days
4.9 (27 reviews)
6.6
6.6
User Avatar
Hi, hope you are fine. I have gone through your job description. You want to write ETL scripts using PySpark and you want to deploy ETL jobs on EMR. I'm AWS Certified Technical Professional with more than 4 years of experience in writing ETL Jobs using PySpark on EMR and Glue. Can you tell me which storage are you using? Are you using S3, RDS or some other service? For reference, please visit my profile portfolio, I have uploaded Architectures of some of my recent projects on AWS. Looking forward to have a detailed discussion with you. Thanks.
$53 CAD in 20 days
5.0 (46 reviews)
5.9
5.9
User Avatar
Hello There, How're you? I am interested to work on your project (Pyspark python data transformation project EMR AWS).I am having strong experience in Amazon Web Services, Data Processing, PySpark, Python, SQL. Could you provide me the project detail and how many hours in a week you need from my side for this project? Can we discuss the project via a quick chat session? I'm ready to initiate the project and can start the work immediately. I can do this within your budget too min $50 CAD / hour Regards
$50 CAD in 30 days
5.0 (3 reviews)
5.3
5.3
User Avatar
I'm a Python expert with rich experience in PySpark. I understand clearly your requirement and I'm interested in your project. I promise I can finish your project in time with high quality. I can start work immediately. I will wait for your positive response. Kind Regards.
$50 CAD in 40 days
4.9 (18 reviews)
5.5
5.5
User Avatar
----- Pro Python/ Big data processing/ Math/Algorithm/ Machine Learning Expert! -------- Hi, Dear Your project is very attracting my mind because I have rich experiences and high skills on this project. I have been completed many similar projects before and am working in these branches for 8+ years. If given a chance, I am highly confident in my ability to deliver the highest quality. I look forward to hearing from you. Kind Regards
$50 CAD in 40 days
5.0 (13 reviews)
5.2
5.2
User Avatar
Hi, I have 6+ years of experience in Hadoop technologies like HDFS, MapReduce, Spark, Hive etc as well as data mining techniques. I can complete your project Please contact me...
$50 CAD in 40 days
4.9 (5 reviews)
3.9
3.9
User Avatar
Hi! Thank you for your Propsal. I have read your post carefully. I am an software engineer. I would like to discuss with you via chat. I am willing to help you. I am familiar with the pyspark. best regard
$50 CAD in 40 days
5.0 (5 reviews)
1.9
1.9
User Avatar
Dear customer. I've checked your job details. I have full experience in python development. Python is my major programming language. Also, I have some experience in data analysis with pyspark. I want to know your requirement in more detail. I'll look forward to hearing from you for further process. Regards.
$50 CAD in 10 days
5.0 (1 review)
1.4
1.4
User Avatar
Hi, there I have been playing in Data Analytics, Big Data, Data mining area for 4 years AWS is also my main domian. What kind of classes and functions are you going to use to transform data? How about Pandas, Numpy, Python 3.x Thank you Ethan Blount
$90 CAD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello Sir, I am a Tech Enthusiast & a Cloud Engineer ,who loves to explore the new and high end technologies and passionate to learn it to all the advance level. MY PASSION - 1. Willing to learn new technologies from its core and expertise it to all the advance level in order to create something new which will be beneficial to the world. 2. Especially passionate towards Data Science and Cloud Technologies and likes to do project related to Automation. 3. Passionate in furnishing my skills by continuous practicing and try multiple new things to make a new product that will make my country proud. 4. Experienced enthusiast on Cloud Technologies and Automated System. MY SKILLS - 1. I have expertise in various DevOps Technologies and also have done multiple Real Industry Projects by integrating multiple technologies both Nationally and Leadership Skills and Communication Skills Internationally. 2. Hands On : Experience on multiple Cloud Services like (AWS, GCP, OpenStack, Oracle Cloud > and multiple Automation tools. MY TECHNOLOGIES : OpenStack | AWS | Microsoft Azure | Docker | Jenkins | HTML5 and Advance CSS | Solidity | Advance Excel | Microsoft Word | Adobe Acrobat Expert | Salesforce | GCP Amazon (AWS) : ● Amazon Lex ● Amazon RDS, DocumentDB ● Amazon IAM, VPC ● Amazon Elastic Container Service ● Amazon CloudFront Microsoft Azure : ● Virtual Machine ● Load balancer ● SQL DataBase ● Storage Accounts ● Virtual Networks ● Azure Active Directory ● Azure Backup
$50 CAD in 20 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, Greetings! I am a Data Engineer having extensive working expertise on using pyspark with huge volume of data from Data Cleansing to Data Transformation. I have utilized pyspark on developing multiple data solution on AWS EMR and jupyter notebooks. Having designed and developed multiple end-to-end data solutions on AWS platform native services like - AWS S3, AWS EMR, AWS RDS, AWS Redshift and certified on the same, I reach out to you to express my interest in this project. I would love to connect with you to understand more on the project requirements and further provide with you with projected milestone for this project. If interested, Kindly contact me via chat for further details and discussion. Since this is a long term project, I would love to commit myself on this project and I am also flexible with the timings. I will charge only $30 USD/hr. PS: Please don't judge me on the basis of number of projects I have done, but the professionalism I bring to the project, since I am new to this platform Looking forward to working with you. Thanks & Regards, Arun
$50 CAD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello , I am professional AWS cloud and PYTHON BigData Developer with an experience of 6 plus years. I have so far worked on multiple AWS services and have a good hands-on as well as architectural design knowledge on AWS based services and data pipeline. I will be really very happy to collaborate with you on this engagement and you trust on me with the task.
$50 CAD in 20 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Have more than 10 years of Big Data experience working for IT giants. Specialize in Spark (Pyspark) on AWS ( EC2/ EMR). Also developed multiple spark frameworks in the past for large engagements. Expert in writing optimized pyspark scripts for complex transformations, following all industry best practices including ABCR.
$50 CAD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I'm PhD of particle physics, working as a data scientist (current working environment is spark). During my career I have worked with different frameworks. I also have completed Udacity nanodegree programmes (data analyst, data scientist). I can help you, with the project. I'm looking forward to hear from you. All the best, Gvantsa
$50 CAD in 40 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I am a full time Senior Pyspark Developer, building data pipelines for the biggest retail companies about their sales and inventory problems. For that reason; I am very interested to the project, confident to deliver the weekly work at the highest quality. Thank you! Cem Karagozlu
$50 CAD in 20 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of CANADA
Toronto, Canada
0.0
0
Member since Nov 20, 2020

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759) & Freelancer Online India Private Limited (CIN U93000HR2011FTC043854)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.