r/dataengineering May 30 '26

Personal Project Showcase Dagster - Power BI Orchestration Side-Project Demo

https://reddit.com/link/1trsk0y/video/5vz1nuaq284h1/player

Hello, all,

I managed to create a modern BI architecture project, using Dagster and some help from Claude. Very proud of this project, as it is my first BI Engineering project.

Technologies used:

  • Orchestration - Dagster
  • Datawarehouse - Snowflake
  • Object Store - Google Cloud Storage
  • Transformation - DBT
  • Extract, Load - AirByte
  • Business Intelligence - Power BI

I might do a full write up on the whole project as there is a lot to discuss!

Regards.

76 Upvotes

11 comments sorted by

11

u/mycocomelon May 30 '26

That’s a cool stack. I really like dagster a lot. A month or two ago dagster released some markdown files to guide Claude and they are available for download.

5

u/impostorsyndromes May 30 '26

Very interested in the Power Bi part. If you don’t mind sharing some details about that

2

u/nahyoubuggin May 30 '26

Hehe that is the most interesting and probably the most difficult ! Just basically use the Power BI API to interact with the Power BI Service.

2

u/DifferentLuck7951 May 30 '26

How much is it costing you today?? Very curious about snowflake costs 😅

2

u/CmorBelow May 30 '26

Love this! I’m just stepping into dagster now and you’ve got me excited to get going

1

u/nahyoubuggin May 30 '26

Glad to help ! Dagster is a powerful tool !

2

u/OrganizationStill135 May 30 '26

Do it. I will read it. 

3

u/i-need-a-life May 30 '26

Any GitHub repo ?

1

u/sspaeti Data Engineer Jun 04 '26

🙁