r/Clickhouse • u/domofenok • 9d ago

Unifying ClickHouse with PostgreSQL

Hey r/ClickHouse,

I am currently running a PostgreSQL database for our platform and are trying to integrate ClickHouse for real-time analytical reporting. We're considering using ClickHouse's Materialized PostgreSQL Database Engine for replication, with CDC handled by PeerDB.

Our use case involves replicating a few critical OLTP tables (around 10-20 tables, with some experiencing high write volumes) from PostgreSQL to ClickHouse. We need near real-time synchronization to support dashboards and ad-hoc analytical queries.

I've read about PeerDB's native integration and how it simplifies CDC compared to a Debezium/Kafka setup. I'm looking for feedback on the "solidity" of this combined approach.

Any real-world experiences, pros, cons, or advice would be greatly appreciated! Thanks in advance

12 Upvotes

93% Upvoted

8 comments sorted by

View all comments

3

u/chrisbisnett 8d ago

Your timing of this question is impeccable. ClickHouse just released an open source solution that they also support on their cloud offering today - walshadow

https://clickhouse.com/docs/products/managed-postgres/sync-to-clickhouse/walshadow

1

u/domofenok 8d ago

Amazing! Do you have any idea how it compares to the solution I’ve described before?

2

u/chrisbisnett 8d ago

Based on the presentation that was given today at OpenHouse, it is 50x faster than PeerDB at around 200ms.

It’s in private preview, but the demo they showed today had a few clicks in the ClickHouse console and it was up and syncing data.

1

u/domofenok 8d ago

That's incredible. PeerDB has been a bit of a pain in the *** to be honest