Bioinformatics Solutions on AWS

 

Bioinformatics Solutions on AWS For Exploratory Analysis aws bioinformatics distributed computing hpc python Aug 10, 2020

This is part 1 of a series I have in the works about Bioinformatics Solutions on AWS. Each part...

Continue Reading...
Dask on HPC dask distributed computing hpc parallel computing python Sep 25, 2019

Recently I saw that Dask, a distributed Python library, created some really handy...

Continue Reading...
Apache Airflow Tutorial – Part 4 DAG Patterns apache airflow distributed computing docker job queues python Mar 20, 2019

Overview

During the previous parts in this series, I introduced Apache Airflow in...

Continue Reading...
Apache Airflow Tutorial – Part 3 Start Building apache airflow distributed computing docker job queues python Mar 14, 2019

Overview

If you've read this far you should have a reasonable understanding of the Apache...

Continue Reading...
Apache Airflow Tutorial – Part 2 Install with Docker apache airflow distributed computing docker job queue python Mar 08, 2019

Install Apache Airflow With Docker Overview

In this part of the series I will cover how to get a...

Continue Reading...
Apache Airflow Tutorial – Part 1 Introduction apache airflow distributed computing docker python Mar 08, 2019

What is Apache Airflow?

Briefly, Apache Airflow is a workflow management system...

Continue Reading...
Setting up a Local Spark Development Environment using Docker apache spark distributed computing docker python Mar 01, 2019

Every time I want to get started with new tech I figure out how to get a stack up and running...

Continue Reading...
Deploy a Celery Job Queue With Docker – Part 1 Develop celery distributed computing docker job queue python Feb 08, 2019

Overview

In this post I will hopefully show you how to organize a large docker-compose...

Continue Reading...