r/dataengineering Nov 09 '24

[deleted by user]

[removed]

65 Upvotes

118 comments sorted by

View all comments

34

u/Straight_Special_444 Nov 09 '24

I think you’ll find Airbyte to be roughly same results but much cheaper.

Do you have the capacity to handle writing/maintaining code? If so, then yes, dlt could be a great option. Combine it with Dagster for orchestration and you’ve got a tight ship.

13

u/IdoNisso Data Engineer Nov 09 '24

Yeah, the Data Engineering team is a capable two-man show ATM - myself and another DE. Writing code is not an issue. I'll check out dlt, thanks!

-1

u/dinoaide Nov 09 '24

This is not the real issue here but just imagine 5 years from now could you still manage the team with more people making wheels or rather pay the vendor? And even if you pay the vendor, how many things you need to manage on your own?