Get the latest tech news
Reliably replicating data between Postgres and ClickHouse
Using PeerDB open source to reliably replicate data from PostgreSQL to ClickHouse.
First, unlike many ETL tools that aim to support a wide variety of database connectors, PeerDB focuses exclusively on PostgreSQL as a data source. This specialisation has allowed the team to create one of the fastest and most scalable CDC solutions for PostgreSQL, with support for advanced features like complex data types and partitioned tables. Aside from these gotchas, the Open Source PeerDB version was relatively easy to deploy and run and we found a single instance to be scalable to millions of rows with low latency.
Or read this on Hacker News
