Sign in Subscribe

python

Apache Airflow Tutorial – Part 2 Install with Docker

Apache Airflow Tutorial – Part 2 Install with Docker

Install Apache Airflow With Docker Overview In this part of the series I will cover how to get a nice Apache Airflow instance up and running with docker. You won't need to have anything installed locally besides docker, which is fantastic, because configuring all these pieces individually would

Setting up a Local Spark Development Environment using Docker

Setting up a Local Spark Development Environment using Docker

Every time I want to get started with new tech I figure out how to get a stack up and running that closely resembles a real-world production instance as much as possible. This is a get up and running post. It does not get into the nitty gritty details of

Deploy a Celery Job Queue With Docker – Part 2 Deploy with Docker Swarm on AWS

Deploy a Celery Job Queue With Docker – Part 2 Deploy with Docker Swarm on AWS

Overview In Part 1 of this series we went over the Celery Architecture, how to separate out the components in a docker-compose file, and laid the ground for deployment. Deploy With AWS CloudFormation This portion of the blog post assumes you have a ssh key setup. If you don'

Deploy a Celery Job Queue With Docker – Part 1 Develop

Deploy a Celery Job Queue With Docker – Part 1 Develop

Overview In this post I will hopefully show you how to organize a large docker-compose project, specifically a project related to a job queue. In this instance we will use Celery, but hopefully you can see how the concepts relate to any project with a job queue, or just a

Deploy a Full Stack Web Application with Docker and Traefik

Deploy a Full Stack Web Application with Docker and Traefik

Overview Have you ever had to deploy a full stack web application? With different services, some mapping to different ports, some static html, maybe a couple databases thrown in there? Have you ever banged your head against your desk trying to figure out how to expose different ports on a

Docker Ecosystem

Docker Ecosystem

Containers, Compose, Swarm, Desktop? Docker isn't simply a container or a virtual machine, its an entire ecosystem. Luckily, each component is a layer that builds upon its previous layer. There are definitely a lot of moving pieces, but from a birds eyes perspective there are three main components.

Develop a Python Flask Application with Docker and Deploy it to AWS – Part 3 Bring it together with docker compose

Develop a Python Flask Application with Docker and Deploy it to AWS – Part 3 Bring it together with docker compose

Recap Up until this point we covered: * Building a custom docker container using the official python miniconda container as our base. * Interactively running commands in our custom image * Giving docker build time instructions and run time instructionswith RUN and CMD. * Spinning up a webserver that we can access on our