Architecture for Durability and Scalability
Lakebase Postgres introduces a sophisticated architecture that effectively separates its operations into two distinct layers, enhancing both durability and scalability. The compute layer operates on standard Postgres, managing essential functions such as SQL parsing, query planning, and execution without any alterations. This layer is intentionally designed to be ephemeral, allowing it to scale dynamically, start and stop as needed, or even terminate without jeopardizing the integrity of the data.
In contrast, the storage layer is meticulously crafted to uphold correctness, durability, and historical accuracy. It is composed of three integral components:
- Safekeepers: These entities are tasked with replicating Write-Ahead Logging (WAL) records through a quorum-based protocol, ensuring durability across the system.
- Pageserver: This component materializes WAL records into page versions, effectively transforming the logs into usable data states.
- Object Storage: Serving as a repository, this storage retains the materialized versions and historical states in an immutable format, safeguarding the database’s integrity from being dependent on any single compute node.
This innovative architecture not only fortifies data durability but also enhances the overall scalability of the system, allowing it to adapt seamlessly to varying workloads while maintaining a robust and reliable database environment.
