If you are running a High Content Screening Pipeline you probably have a lot of moving pieces. As a non exhaustive list you need to:
These tasks are much easier to accomplish when you have a system or framework that is built for scientific workflows.
If you prefer to watch I have a video where I go through all the steps in this tutorial.
Apache Airflow is :
Airflow is a platform created by the community to programmatically author, schedule and...
Subscribe to the newsletter! You'll get a weekly tutorial on all the DevOps you need to know as a Data Scientist. Build Python Apps with Docker, Design and Deploy complex analyses with Apache Airflow, build computer vision platforms, and more.