Closed

Looking for an Experienced Software Engineer, Data Platform

Looking for an experienced Software Engineer for a long-term project, 6 months +. This contract includes multiple sub-projects. Must be experienced in Python, Linux and Bash scripting, Docker & AWS. Experience or desire and ability to learn Apache Spark, Airflow, Snowflake, and dbt is highly desirable.

Some of the projects you'll be working on in order of priority, include but not limited to

Automate dbt docs generation.

Airflow is used to schedule dbt job runs. After each run will need to generate dbt docs and host a static site on s3

We’d also need to use Route 53 to create a DNS

Build a command-line tool to launch spark jobs, both python and java/scala.

Create build files - jars/zip/egg/pip - for CI/CD deployment and productionizing of Spark jobs

These are some of the initial projects you'd be working on, with more to come in the future.

Although I have a preference for someone who'll be available during US Central time zone I'm open to any time zone as long as you're very very responsive in communicating. We'll be using Slack for any and all conversations.

If you are interested in this project, please reply with your prior experience.

Skills: DevOps

About the Client:
( 0 reviews ) Dnipro, Ukraine

Project ID: #33709661

7 freelancers are bidding on average $184/hour for this job

dikirahmanme

Hi I am DevOps engineer I have experience with AWS, Docker, Kubernetes, Terraform/IAC, CI/CD and others DevOps tools and I am willing to learn according to company needs please contact me for discussion Thank you

$35 USD / hour
(2 Reviews)
2.8
alambharathkumar

Hello, I have 11 plus years of experience and worked in projects of python development, AWS involving CI/CD. I have experience in scheduling jobs using Jenkins and wrote scripts in bash scripting as well. I also have w More

$20 USD / hour
(0 Reviews)
0.0
BillyandFam

Hello Dear Client, after thoroughly reading your PROJECT DESCRIPTION i have clearly understood it and i would like to work with you. I am Certified PHD holder in SOFTWARE ENGINEERING and DEVELOPMENT. I am a skilled and More

$1125 USD / hour
(0 Reviews)
0.0
shubhamchavan101

A Professional having 2.10+ years of IT experience software industry in DevOps and AWS Cloud using various CI/CD tools such as GIT, JENKINS, ANSIBLE, DOCKER and AWS Cloud Services • Hands on experience on AWS services More

$20 USD / hour
(0 Reviews)
0.0
prateekhanda07

Hi I have been working in the industry for more than 11 years now and have been providing solutions to different clients in the domain related to Devops, Cloud, Infrastructure, Automation. I have worked on the above m More

$40 USD / hour
(0 Reviews)
0.0
abdf2010

Hi, It is easy, I can do on time. I work online, where you can track progress of your project. I have 6 years of experience in development(websites, web applications, mobile apps, desktop applications, I/UX), using PHP More

$20 USD / hour
(0 Reviews)
0.0
sarvan92

Hi I am Bigdata engineer and I am having rich experience in data pipelines and data processing on Hadoop,Azure and AWS using pyspark and java I can build a simple script for your requirements and we can make a great pi More

$30 USD / hour
(0 Reviews)
0.0