Hello stranger, and welcome! 👋😊 I'm Rasmus Bååth, data scientist, engineering manager, father, husband, tinkerer, tweaker, coffee brewer, tea steeper, and, occasionally, publisher of stuff I find interesting down below👇
If you’ve ever looked at a Makefile in a python or R repository chances are that it contained a collection of useful shell commands ( make test -> runs all the unit tests, make lint -> runs automatic formatting and linting, etc.). That’s a perfectly good use of make , and if that’s what you’re after then here’s a good guide for how to set that up . However, the original reason why make was made was to run shell commands, which might depend on other commands being run first, in the right order . In 1976 when
Here I’ll give you a handy template and some tips for building a data pipeline using python and make . But first, let’s look at an example data pipeline without make .
Mark Huckvale - Speech, Phonetics, Computers