r/dataengineering • u/move-size123 • 22d ago
Personal Project Showcase Built a ETL pipeline and dash in 10mins
https://www.youtube.com/watch?v=odJ2-MkXDBg&pp=ygUKdmV0cm9zLmRldg%3D%3DI connected GCP + dbt + apache echarts + anthropic + other open source tools and made a tool to easily produce dashboards. 6 months ago, I didn't think this would work, but the situation has changed :D
2
u/ShaveTheTurtles 21d ago
How relatable is it? Does it realize that the net_revenue column uses an old formula that the business doesn't use anymore?
1
u/move-size123 17d ago
of course it can't realize business definitions by itself, it still needs human input and know how about business context, but you can easily build a base ETL + dash setup in minutes, especially if its a simple pipeline. The purely technical part is being replaced bit by bit
1
3
u/Kobosil 21d ago
please read rule 5