A lightweight stack to track Analytics standardization at scale: dbt + duckdb + Observable Framework

We transitioned at Decathlon from a centralized Analytics organization to a decentralized business domain organization this year. However, we had the ambition last year to reduce the number of DBT repositories on our Github from 250 to 15 repositories (1 per domain), in order to enable simpler governance and to allow DBT architectures to converge.

To continue our standardization work at scale and monitor the evolution of these 15 repositories, we chose to apply DORA metrics to each of the repositories. We developed an analytics stack that is entirely embedded in Github.

We use:

- duckdb as the execution engine, which recently supports table reading

- Deltadbt-duckdb to orchestrate modeling

- Observable Framework to build a dataviz application, deployed statically on Github Pages