Get the latest tech news

We made Postgres writes faster, but it broke replication


Zero-ETL search and analytics for Postgres

It turned out that Postgres's out-of-the-box support for physical replication, built on Write-Ahead Log (WAL) shipping, isn't quite enough for an advanced data structure like an LSM tree to be replication-safe. Physical consistency means the replica contains structurally valid data — each page or block on disk is well-formed and corresponds to a state that did exist on the primary at some point. Adapting algorithms to work atomically at the block level is table stakes for physical replication: if you don’t do it, your data structures are broken, and you won’t be able to use them consistently.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Postgres

Postgres

Photo of replication

replication

Related news:

News photo

Postgres to ClickHouse: Data Modeling Tips

News photo

Replication of Quantum Factorisation Records with a VIC-20, an Abacus, and a Dog

News photo

Pgactive: Postgres active-active replication extension