Serious Data Engineering on a seriously tight budget
▲ 50 r/DataBuildTool+2 crossposts

Serious Data Engineering on a seriously tight budget

Glad to join this community and that I am allowed 1 self promotion post 😀
In my spare time I developed this project, using Open Source tooling. This ‘modern data stack’ uses DuckDB, DuckLake, Dagster, dlt and Metabase with a relatively advanced SCD2 handling (including deletes) in the ‘Silver’ layer. Is this unique? Surely not, but I learned a lot building it. Maybe someone can use it, or help me improve it.

github.com
u/EdwinWeber_Data — 9 days ago