Sign in Subscribe

Best Practices

Bioinformatics Pipeline Engineering: Do This Not That: Split Tasks

Bioinformatics Pipeline Engineering: Do This Not That: Split Tasks

Overview In the last installment of this series, we talked about how to handle large files without bringing down the wrath of your local sys admin. Today we're tackling how to think about breaking up tasks. You've probably written it. I've definitely written it.

Bioinformatics Pipeline Engineering: Do This Not That: Large Files

Bioinformatics Pipeline Engineering: Do This Not That: Large Files

Overview If you've worked with bioinformatics data, you've likely encountered the dreaded experience: your Python script chugging along, consuming memory at an alarming rate, and then—crash. Out of memory. Your computer becomes unresponsive, and you're left frustrated wondering why your beautiful analysis script