Create python script to backup a mongodb database and upload it to a cloud service

Closed Posted 11 months ago Paid on delivery
Closed Paid on delivery

The goal of this project is to create a container that can backup our MongoDB database, and upload the file to the cloud service of our customer's choice. This container will be run as part of a daily cron job in Kubernetes to facilitate platform backups.

1 Python Script

1.1 Written in Python 3.7+

1.2 Use libraries for Azure, AWS, and gCloud, and mongodb

1.2.1 Azure Blob Storage

1.2.2 Google Cloud Storage Buckets

1.2.3 AWS S3 Blob Storage

1.3 Invoke mongodump as an external process to create or restore the dump file

1.4 All inputs shall be passed via environment variables

1.5 Dump file shall be stored locally before being updated.

1.6 Dump file shall be streamed from the disk to the cloud service, it cannot be read entirely into memory (as it can be large).

1.7 General flow for backup shall be as follows:

1.7.1 Connect to mongodb and find all collections over a specified size (for example 100MB), add these to a "history" list.

1.7.2 Create a mongodump excluding the collections from 1.7.1 as [login to view URL]

1.7.3 Create a mongodump of all collections as [login to view URL]

1.7.4 Connect to the specified cloud service

1.7.5 Stream the backup files and set their names to include YYYYMMDD-HHMM datestamp in the name, such as [login to view URL]

1.8 General flow for restore shall be as follows:

1.8.1 Connect to the specified cloud service

1.8.2 Download the specified backup file, if "latest-full" is specified, find the most recent full backup, and if "latest-config" find the most recent config backup and download it.

1.8.3 Invoke mongorestore to restore the downloaded file

1.9 Status and errors shall be logged to the console

1.10 Sample environment variables

MONGO_URI - the URI used to connect to the database

MONGO_DB - database name to backup

AZURE_CONNSTRING - connection string for Azure

AZURE_CONTAINER - container in Azure storage account to store backups

BACKUP_PREFIX - prefix to prepend on all backup files

RESTORENAME - filename to be restored

AWS/GCLOUD env variables TBD

Python Amazon Web Services Linux MongoDB Azure

Project ID: #36689942

About the project

18 proposals Remote project Active 10 mos ago

18 freelancers are bidding on average $176 for this job

maan627

Hi , I have read your project description and can surely help you with it. I am an expert cloud solutions architect with more than 6 years of experience. I am an Oracle Certified foundations associate with ample exp More

$155 USD in 1 day
(21 Reviews)
4.4
devendrathakur12

I am an experienced Python developer specializing in cloud services and database management. I am confident in my ability to create the required container for backing up your MongoDB database and uploading the files to More

$250 USD in 5 days
(21 Reviews)
4.4
asherry137

Hi there, I understand your requirement to create a Python to create a backup of a MongoDB database. I have extensive experience in similar tasks and can deliver you an excellent program to work as defined. All this in More

$140 USD in 7 days
(2 Reviews)
4.1
arbu1499

Hi there! My name is Arbaz and I'm a freelance designer and developer with extensive experience in the industry. I understand that you're looking for someone to create a python script to backup a mongodb database and u More

$70 USD in 1 day
(5 Reviews)
3.8
SheriffOladejo

HELLO, Greetings of the day! 2.2 Configure the cron job to pass the environment variables to the python script 2.3 Configure the cron job to run the python script in a container I am confident that I can deliver a py More

$146 USD in 7 days
(5 Reviews)
3.9
muhammadsaaddata

Hello greetings, After going through your project description, I feel confident and excited to work on this project for you I am confident that I have the required skills and experience to deliver high-quality work th More

$140 USD in 7 days
(11 Reviews)
3.8
Arez1122

Dear Client, I am writing to express my interest in the project titled "Create python script to backup a mongoDB database and upload it to a cloud service" that you posted. I am confident that I have the necessary ski More

$250 USD in 12 days
(1 Review)
3.5
martinbuz123

Got it. As a talented Python , MongoDB< Azure developer, I can build your script perfectly. Please contact me for our project. I will start immediately.

$140 USD in 7 days
(2 Reviews)
2.3
rohit5081

✅✅Certified Expert in Amazon Solution Architect✅✅ ✅Experienced in Azure, Docker, CI/CD, Jenkins, Terraform✅ ✅Certified Kubernetes Administrator✅ ✅Thank you for considering my services. I have thoroughly reviewed your More

$140 USD in 7 days
(1 Review)
0.2
nekpaldevloper

Hi, We went through your project description and it seems like our team is a great fit for this job. We are an expert team which have many years of experience on Python, Linux, Azure, Amazon Web Services, MongoDB Le More

$140 USD in 7 days
(0 Reviews)
0.0
akannujiya321

I am seo from freelancer I am doing your wofk in best type I am very powerful seo Jay mahskal Iam a seo I have many claint I want doing your work

$140 USD in 2 days
(0 Reviews)
0.0
lilyqinworking

I'm excited to hear that you are looking for someone to create a python script to backup a mongodb database and upload it to a cloud service! As someone with extensive experience more than 10 years in micro service(k8s More

$120 USD in 3 days
(0 Reviews)
0.0
techindia999

Hi Greetings! We are team of software developers. We have big team of around 1500 software developers all over the world associated with us. We have developers working on almost all the technologies. We will assign yo More

$250 USD in 7 days
(0 Reviews)
0.0
ashhhu7

I understand that you are looking for someone to create a python script to backup a mongodb database and upload it to a cloud service. I believe I am the perfect fit for this project because of my extensive experience More

$225 USD in 3 days
(0 Reviews)
0.0