Really good post Lukasz ! At Kensu ( we are building a Data Activity Manager to automate these great advices of yours directly from the data (science, ETL, BI, …) tooling.

We allow data citizens (folks using data) to publish metadata directly from their code (some tools are even fully integrated with our custom collectors) to our Analytics Governance platform.

In a way, we minimise the time spent by data scientists on documentation (specially the boiler plates like writing in plein text what they did in code already :-D) and the managers/DPO time by applying our own AI to discover peculiar events requesting their attention.

Sorry for the pitch but I am so glad to see people like you getting to the same idea as we have at Kensu ;-).

Keep writing awesome stuff, I’m following you from now on!


I get energy from using his expertise in mathematics, data technologies to build innovative solutions to help organisations - former Spark Notebook creator