Sign in Subscribe

python

Setup a Postgres + Python Docker Dev Stack

Setup a Postgres + Python Docker Dev Stack

Query a Postgres DB from a Python Application By the end of this blog post you will have all the tools you need to query a Postgresdatabase, with some dummy data, from a python application, all without installing a single thing besides docker onto your computer! Learning Curve If you

Setup a MySQL + Python Docker Dev Stack

Setup a MySQL + Python Docker Dev Stack

Learning Curve The Pain The first time I setup an app to connect to a mysql database I spent at least a full hour fiddling with that connection string, before throwing my hands up in frustration and taking a walk. I find walking to be very therapeutic, so I calmed

Creating a Custom CellProfiler Docker Image

Creating a Custom CellProfiler Docker Image

Overview If you've ever worked with scientific software you will know that installing them is not necessarily straightforward. I think this is changing quite a bit with tools like conda and docker, but sometimes we need to just sit down and debug an installation. There is hope here,

Setup PyCharm to use a Project Interpreter in a Docker Compose Service

Setup PyCharm to use a Project Interpreter in a Docker Compose Service

Overview If you are anything like me, you heavily rely on a debugger. Likewise, you install all your development environments into a docker container because installing things on your own computer is FOR THE BIRDS. I cannot tell you what a relief it is to have all my development environments

Apache Airflow Tutorial – Part 4 DAG Patterns

Apache Airflow Tutorial – Part 4 DAG Patterns

Overview During the previous parts in this series, I introduced Apache Airflow in general, demonstrated my docker dev stack, and built out a simple linear DAG definition. I want to wrap up the series by showing a few other common DAG patterns I regularly use. In order to follow along,

Apache Airflow Tutorial – Part 3 Start Building

Apache Airflow Tutorial – Part 3 Start Building

Overview If you've read this far you should have a reasonable understanding of the Apache Airflowlayout and be up and running with your own docker dev environment. Well done! This part in the series will cover building an actual simple pipeline in Airflow. Start building by getting the

Apache Airflow Tutorial – Part 1 Introduction

Apache Airflow Tutorial – Part 1 Introduction

What is Apache Airflow? Briefly, Apache Airflow is a workflow management system (WMS). It groups tasks into analyses, and defines a logical template for when these analyses should be run. Then it gives you all kinds of amazing logging, reporting, and a nice graphical view of your analyses. I'