Setup a scalable backend system with Docker and with logging for my python script farm on AWS

BUDGET: $100 MAX, can be only increased if you prove that you are competent enough.

I am an AWS architect but need help for the implementation phase of the improvement of my functioning script farm since I am already overloaded by other projects.

I have python scripts already working fine on AWS EC2 instance setup by me, on which instance there is also a wordpress multisite instance is running. What I want from you is to design the system which will:

1-)Spawn/kill a new Docker instance for the python script as soon as the appropriate command will come from the frontend (e.g. through API gateway via a lambda function), front and will be all website, an app or chrome extension. the incoming commands will be parametric and will have an impact on the python script. The docker instance shall also include a simple bash/python script for tracing some specific output prints and inform frontend appropriately (details will be provided). So the data transfer between frontend and backend will be in both ways

2-) Setup the auto-scale group so that will scale up/down depending on the network/CPU usage, making sure that it is compatible with my load-balancer setup for the Wordpress Multisite which is on the same instance! (details will be provided)

3-) Create a RDS instance (better in another VPC since it will be internally used only) and the tables which will be accessed by the EC2 instance (details will be provided)

4-) Make sure the setup will be working smoothly along with manual interruption as well, e.g. if I want to build 20 dockers I will be able to do that or if I remove a record from RDS and/or stop a Docker instance.

5-) A simple bash/python script which will regularly check if there is a new merge/version of the python script and if there is at a decided hour will terminate all the dockers and restart them with the new version.

6-) Cloudwatch setup which will report CPU/network metrics, errors and occurrences of some specific outputs from the Docker instances

7-) Most importantly, DOCUMENTATION! Everything you have setup should be carefully documented, This is as important as the success of the project! The documentation shall include the commands used and the purpose of running them, all the scripts created, all the created/used AWS services in the project as well as and a full architectural depiction of the backend.

In your bid, please include your opinions about the items 1,2,3 to be considered. Otherwise you will NOT be considered.

If you have better ideas for implementing, you may propose them, if your ideas overcome mine for backend, I can even increase the budget!

Skills: Amazon Web Services, Aws Lambda, Backend Development, Docker, Python

See more: aws mobile hub, aws appsync angular, aws appsync chat app, deploy django app on aws ec2, aws python web app, aws django python 3, aws chat app, aws chat service, python script installieren, python script output text file, python script read html page, read csv file using python script, python script scrapes results google search, python script text files, python script modify file content, python script city, python script crawl, python script harvast email, python script csv tab, python script modify html

About the Employer:
( 7 reviews ) Katowice, Poland

Project ID: #18266602

Awarded to:


Hi, I've 5 years of Computer Networking/Cloud experience working for companies like Alcatel Lucent, Dell, HPE, Juniper Networks, etc ([login to view URL]). I also have Linux Academy certification ([login to view URL] More

$150 USD in 7 days
(9 Reviews)

4 freelancers are bidding on average $131 for this job


Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.

$140 USD in 2 days
(23 Reviews)

Hi, First of all the projects looks really exciting to me. About me: I work full time as a Site Reliability Engineer. My job includes maintaining 100s of servers and ensuring we always meet the SLAs. Designin More

$200 USD in 10 days
(2 Reviews)

Hello, After reading your offer this looks like a perfect fit for my skill sets. I have built a large number of creative designs /Development for different businesses. My name is Kandarp P and I am a USA web D More

$35 USD in 3 days
(0 Reviews)