Needed a dev to add mornitoring feature to ETL pipeline built with Apache Airflow.

Hi there, Regarding your project, I have experience in building ETL pipeline with Python, Airflow using Docker containers and I'm familiar with Airflow dashboard and email functionality. I'm ready to start working immediately and looking forward to hearing from you soon. Best Regards ChangShan

Main specialization: * developing Windows Desktop and Web solutions (mainly using C, C++, C#, ASP.NET) * converting/translating/porting code from one programming language to another programming language. * writing wrappers around miscellaneous libraries, packages and SDKs, mainly for using it with other programming languages C & C++ & & C# expert ? JAVA & Qt expert ? AWS & Google cloud ? PYTHON ? ANDRIOD

I have done many projects with Airflow with over 100+ pipelines. I am a full time data engineer and I always deliver high quality code. Thank you, Alberto

Hello, I have the skills required for this Task. My Office work, Has given me experience in this type of job.

I have already done a similar type of work. rech u at Skype live:navneetdwivedi I can help you with that

I understood your requirment. I recently worked upon a similar project where I used dataflow jobs for ingesting the data into BigQuery and all the data pipelines were scheduled using cloud composer(Apache Airflow) with all the email alerts for each job as well as the final summary email per day with number of jobs passed or failed. I can provide more details as in how and where to start with and even in BigQuery we can setup multiple datasets as layers like stage, warehouse and reporting layers for fast loading, good performance and removing duplicates. Let me know if we need to discuss further on call