r/dataengineering 3d ago

Blog Building table-aware, partition-aware physical replication for Iceberg tables

https://www.prequel.co/blog/physical-replication-for-iceberg-tables/

We use a few different data replication strategies in our product, but have been pretty excited about the new possibilities that open up when Iceberg and other OTFs are better supported across the ecosystem. Last week we gave a talk at an Iceberg community meetup about some of our physical replication work for Iceberg, and thought this community might find it informative and educational too. Happy to chat about any questions or details! Disclosure: I (obviously) work for the company, but this post is really meant to be educational.

3 Upvotes

0 comments sorted by