Concepts Archives

Tech Optimizer

July 2, 2026

From monolith to Lakebase to LTAP: rethinking the database from storage up

Sixteen years ago, the author began their PhD at UC Berkeley and was advised to focus on analytics rather than OLTP databases, which were considered solved. This led to the creation of Apache Spark and Databricks. However, during the development of Databricks, it was found that OLTP databases were not solved problems; they were difficult to scale and fragile. This realization led to the development of Lakebase, a serverless Postgres database designed with modern technology. Lakebase architecture separates the write-ahead log (WAL) and data files into independent, scalable services. The WAL is externalized to a service called SafeKeeper, which uses Paxos-based replication for durability, while data files are managed by PageServer, which stores them in cloud object storage. This design addresses challenges such as data loss, scaling, and performance interference between transactional and analytical workloads. Lakebase maintains compatibility with Postgres, offers unlimited storage, serverless compute, durable writes, and simpler high availability. It also introduces LTAP (Lake Transactional/Analytical Processing), which allows both transactional and analytical processing to operate on a single data copy in real time, eliminating the need for separate data copies and reducing costs. LTAP utilizes a unified storage layer that allows data to be materialized in both row and columnar formats, optimizing it for both transactional and analytical workloads. The system ensures that analytics can access the most current data without affecting transactional performance by using a log sequence number (LSN) to retrieve the latest changes. Unlike traditional CDC approaches, LTAP requires no explicit table replication, as all data is stored in a single governed copy. This architecture circumvents common issues faced by hybrid transactional/analytical processing (HTAP) systems, such as incomplete feature sets, lack of ecosystem support, and performance contention. The Lakebase architecture has unlocked capabilities like unlimited storage, elastic compute, durable writes, and instant branching, with ongoing developments anticipated in the future.

Tech Optimizer

July 2, 2026

From monolith to Lakebase to LTAP: rethinking the database from storage up

Sixteen years ago, the author began their PhD at UC Berkeley, where they were advised to focus on analytics rather than OLTP databases, which were considered a solved problem. However, upon developing Databricks, they found that OLTP databases were cumbersome, challenging to scale, and fragile. This led to the creation of Lakebase, a serverless Postgres database designed to address these issues by externalizing the write-ahead log (WAL) and data files into independent services. Lakebase architecture separates the WAL into a distributed service called SafeKeeper and data files into another service called PageServer, allowing for improved durability, scalability, and performance. This architecture eliminates data loss risks associated with disk failures and misconfigurations, simplifies high availability, and allows for elastic compute resources. Lakebase also introduces LTAP (Lake Transactional/Analytical Processing), which enables transactions and analytics to operate on a single data copy in real-time, avoiding the need for separate data copies and reducing costs. The system retains Postgres's ACID semantics while storing data in open columnar formats, making it accessible to both transactional and analytical engines without the delays and complexities of traditional replication methods. The architecture allows for unlimited storage, serverless compute, and instant branching, while ensuring that analytics can read the most current transactional data without affecting transactional workloads. LTAP aims to unify transactional and analytical processing by leveraging distinct compute engines for each workload while integrating at the storage layer.

AppWizard

June 30, 2026

Hideki Kamiya thinks there should be a cozy Resident Evil game, where ‘retired Leon goes fishing in the countryside’

Hideki Kamiya, a key figure in the gaming industry, was involved in the Resident Evil franchise as a designer for the original game and director for Resident Evil 2. Despite his contributions to horror gaming, he does not consider himself a fan of the genre and has expressed a desire for a "non-scary mode" in Resident Evil games. Kamiya envisions a game featuring a retired Leon Kennedy living a peaceful life in the countryside, engaging in activities like fishing, baking, and helping neighbors. He has communicated with Capcom about the demand for a less frightening version of Resident Evil, indicating a genuine interest in innovation within the franchise. Currently, he is working on a sequel to Okami at his new studio, Clovers.

Winsage

June 27, 2026

Forget PowerToys, Windows 11 needs this feature immediately

Microsoft is enhancing Windows 11's multitasking capabilities by integrating a feature from its PowerToys suite called AltWindowCycle. This utility allows users to quickly navigate between multiple windows of the same application using the Alt + shortcut, similar to the Alt + Tab function. The concept of cycling through application windows is already utilized in Linux distributions. The addition of AltWindowCycle is expected to improve productivity for users without complicating the user experience.

AppWizard

June 25, 2026

From Idea to Launch: Essential Steps for Building a Successful Android App

Building a successful app requires transforming a strong idea into a useful, reliable, and discoverable product. Key steps include addressing a genuine problem, developing an effective initial version, conducting thorough testing, and launching with a strategic plan. Many apps fail by neglecting essential steps, leading to confusion or lack of real need. It is important to identify specific problems the app aims to solve rather than starting with an extensive feature list. Understanding the target audience and their pain points is crucial for making informed decisions. Validation can be achieved by examining reviews of competing apps and engaging with potential users to assess interest in the solution. The initial app version should be the smallest iteration that delivers tangible results, focusing on the primary user journey. Outlining the user flow is important for a smooth experience, ensuring that permission requests are logical and intuitive. Early-stage apps should exhibit stability, integrating analytics and crash reporting from the beginning to understand user behavior. A gradual launch is recommended, starting with internal tests and moving to closed tests with target audience members. This phased approach allows for learning and adaptation, ensuring that the initial version effectively addresses a real problem and engages users.

AppWizard

June 25, 2026

Grand Theft Auto 6 preorders begin tonight at midnight local time in the US; here’s where to buy — get yours now, it’s in the garage and ready to roll

The preorder pages for Grand Theft Auto VI will go live at midnight local time across the United States. Gamers can choose between the Standard and Ultimate editions, with digital preorders offering a month-long subscription to GTA+. The Ultimate Edition is priced at .99 and includes additional side missions, vehicles, weapons, and outfits for protagonists Jason and Lucia. The game is set to be released on November 19. PC gamers will have to wait another year for the game to run natively on their systems.

Tech Optimizer

June 22, 2026

The database that refused to die: How Postgres survived its own creators

Postgres, originally developed by Michael Stonebraker in the early 1980s, is an open-source database system that evolved from Ingres. It was designed to handle complex data types and introduced user-defined data types, operators, and functions, leading to the support for abstract data types (ADTs). The initial commercialization of Postgres occurred through a startup named Illustra, later acquired by Informix. In 1995, graduate students Andrew Yu and Jolly Chen revived Postgres, transitioning it from QUEL to SQL, resulting in Postgre95, which evolved into PostgreSQL. Today, Postgres is one of the most popular database systems globally, known for its extensibility and high code quality. However, it currently lacks features like file-level encryption (TDE), which are standard in commercial systems, relying instead on the operating system for encryption. Efforts to implement TDE have faced challenges due to the complexity of required code changes.

Tech Optimizer

June 20, 2026

PostgreSQL 18 on Amazon Aurora and Amazon RDS: Performance enhancements

PostgreSQL 18 addresses common performance challenges for users, including managing query performance across composite indexes, diagnosing memory spills in materialized Common Table Expressions (CTEs), and upgrading major versions without plan regressions. Key enhancements include skip scan optimization for multicolumn indexes, improved EXPLAIN functionality, and optimizer statistics that persist through major version upgrades. Skip scan optimization allows PostgreSQL to efficiently utilize multicolumn B-tree indexes even when leading columns are not specified in the WHERE clause, significantly improving query performance. The EXPLAIN command has been enhanced to include buffer statistics by default, providing deeper insights into query execution and resource usage. PostgreSQL 18 also introduces visibility into the storage of materialized nodes in query plans, indicating whether intermediate results were stored in memory or spilled to disk. A new metric, Index Searches, has been added to EXPLAIN ANALYZE output, indicating how many times the database traversed the index tree during query execution. Additionally, Self-Join Elimination (SJE) automatically detects and removes unnecessary inner joins of a table to itself, optimizing query performance. The autovacuum mechanism has been improved with the introduction of autovacuum_vacuum_max_threshold, which caps the number of dead tuples that can accumulate before autovacuum triggers a VACUUM, addressing issues with large tables. The vacuum_truncate parameter provides a server-wide control point to disable VACUUM’s file truncation behavior, reducing locking issues on busy systems. PostgreSQL 18 also separates the allocation of autovacuum worker slots from their usage, allowing for dynamic adjustments to autovacuum_max_workers without requiring a server restart. Finally, new columns in pg_stat_all_tables track cumulative time spent on maintenance operations, providing better insights into maintenance overhead for each table.

AppWizard

June 17, 2026

All roads lead to philosophy, as this Wikipedia game proves

The "Philosophy Game" on Wikipedia reveals that clicking the first hyperlink in a series of articles often leads back to the article on Philosophy. Matthew Prebeg explains this phenomenon as related to abstraction and categorization, where items can belong to the same category without sharing a singular characteristic. He illustrates the hierarchical nature of categorization, showing how a specific item can fit into broader categories. The game highlights the foundational role of philosophy in structuring our understanding of concepts. Philosophy is segmented into four primary domains: epistemology, metaphysics, ethics, and logic, which serve as the basis for other fields of inquiry. The Philosophy Game also exemplifies experimental philosophy, using empirical data to draw philosophical conclusions and encouraging a cycle of inquiry through Wikipedia's interconnected knowledge.

Winsage

June 16, 2026

The RTX 20 series has officially become Nvidia’s Windows 7

Windows 7 now has a user base of only 0.07%, while 8.54% of Nvidia RTX owners still use the RTX 20 series graphics cards. The RTX 20 series, launched in 2018, introduced technologies like ray tracing and DLSS, which have since evolved and become standard in modern gaming. Despite their decline, both Windows 7 and the RTX 20 series are still utilized by loyal users, with the RTX 20 series being the oldest generation still in use. The RTX 20 series is recognized for laying the groundwork for advancements in PC gaming, and its long-term impact is expected to be significant.