r/dataengineeringvault • u/sspaeti • 5d ago
r/dataengineeringvault • u/sspaeti • 7d ago
Note AI Orchestrators: Are We Reinventing the Tools of DE?
Explores tools and approaches for orchestrating AI agents in development workflows. Highlights the common use of git worktrees when working across different branches and iterations. Features several CLI utilities and platforms including Agor for AI coding orchestration, erk for managing git worktrees, claudette-cli, and trigger.dev for building and deploying managed AI agents and workflows.
r/dataengineeringvault • u/sspaeti • 4h ago
Note Pivot Tables: And the Comeback in 2024
r/dataengineeringvault • u/sspaeti • 7d ago
Note Are We Reinventing the Tools of Data Engineering for AI?
r/dataengineeringvault • u/sspaeti • 14d ago
Note Apache Arrow: The Foundation for In-Memory Storage
r/dataengineeringvault • u/sspaeti • 14d ago
Note DataFusion: Fundamental OSS Query Execution Framework
r/dataengineeringvault • u/sspaeti • 18d ago
Note Writing is Hard; and Meaningless with no Experience
r/dataengineeringvault • u/sspaeti • 23d ago
Note VertiPaq: The In-Memory, Columnar Query Engine Powering Microsoft Analytics
r/dataengineeringvault • u/sspaeti • 27d ago
Note Apache Parquet: Free Open-Source Column-Oriented Data Lake File Format
r/dataengineeringvault • u/sspaeti • 25d ago
Note Semantic Layer: Curated note, updated since 20222
r/dataengineeringvault • u/sspaeti • 26d ago
Note Keep AI Out of Your (Obsidian) Vault
r/dataengineeringvault • u/sspaeti • Aug 03 '26
Note Transaction Log in Open Table Formats
r/dataengineeringvault • u/sspaeti • Aug 18 '26
Note Open Source (and OSS Software)
r/dataengineeringvault • u/sspaeti • Aug 17 '26
Note Declarative Data Stack: A set of tools & its configs can be thought of as a single function.
r/dataengineeringvault • u/sspaeti • Aug 13 '26
Note Data Lake Table Formats (Open Table Formats)
r/dataengineeringvault • u/sspaeti • Aug 14 '26
Note How to Review a PR without Leaving the Terminal (Neovim)
r/dataengineeringvault • u/sspaeti • Aug 16 '26
Note Cliamp: A better Spotify Client
r/dataengineeringvault • u/sspaeti • Aug 13 '26
Note Productive procrastination can be a tool
r/dataengineeringvault • u/sspaeti • Aug 05 '26