NewApp Digest
search bot

reading

From monolith to Lakebase to LTAP: rethinking the database from storage up
Tech Optimizer
July 2, 2026

From monolith to Lakebase to LTAP: rethinking the database from storage up

Sixteen years ago, the author began their PhD at UC Berkeley and was advised to focus on analytics rather than OLTP databases, which were considered solved. This led to the creation of Apache Spark and Databricks. However, during the development of Databricks, it was found that OLTP databases were not solved problems; they were difficult to scale and fragile. This realization led to the development of Lakebase, a serverless Postgres database designed with modern technology. Lakebase architecture separates the write-ahead log (WAL) and data files into independent, scalable services. The WAL is externalized to a service called SafeKeeper, which uses Paxos-based replication for durability, while data files are managed by PageServer, which stores them in cloud object storage. This design addresses challenges such as data loss, scaling, and performance interference between transactional and analytical workloads. Lakebase maintains compatibility with Postgres, offers unlimited storage, serverless compute, durable writes, and simpler high availability. It also introduces LTAP (Lake Transactional/Analytical Processing), which allows both transactional and analytical processing to operate on a single data copy in real time, eliminating the need for separate data copies and reducing costs. LTAP utilizes a unified storage layer that allows data to be materialized in both row and columnar formats, optimizing it for both transactional and analytical workloads. The system ensures that analytics can access the most current data without affecting transactional performance by using a log sequence number (LSN) to retrieve the latest changes. Unlike traditional CDC approaches, LTAP requires no explicit table replication, as all data is stored in a single governed copy. This architecture circumvents common issues faced by hybrid transactional/analytical processing (HTAP) systems, such as incomplete feature sets, lack of ecosystem support, and performance contention. The Lakebase architecture has unlocked capabilities like unlimited storage, elastic compute, durable writes, and instant branching, with ongoing developments anticipated in the future.
silver Android smartphone
Tech Optimizer
July 2, 2026

From monolith to Lakebase to LTAP: rethinking the database from storage up

Sixteen years ago, the author began their PhD at UC Berkeley, where they were advised to focus on analytics rather than OLTP databases, which were considered a solved problem. However, upon developing Databricks, they found that OLTP databases were cumbersome, challenging to scale, and fragile. This led to the creation of Lakebase, a serverless Postgres database designed to address these issues by externalizing the write-ahead log (WAL) and data files into independent services. Lakebase architecture separates the WAL into a distributed service called SafeKeeper and data files into another service called PageServer, allowing for improved durability, scalability, and performance. This architecture eliminates data loss risks associated with disk failures and misconfigurations, simplifies high availability, and allows for elastic compute resources. Lakebase also introduces LTAP (Lake Transactional/Analytical Processing), which enables transactions and analytics to operate on a single data copy in real-time, avoiding the need for separate data copies and reducing costs. The system retains Postgres's ACID semantics while storing data in open columnar formats, making it accessible to both transactional and analytical engines without the delays and complexities of traditional replication methods. The architecture allows for unlimited storage, serverless compute, and instant branching, while ensuring that analytics can read the most current transactional data without affecting transactional workloads. LTAP aims to unify transactional and analytical processing by leveraging distinct compute engines for each workload while integrating at the storage layer.
Tiny Bookshop Coming to iOS and Android on July 9th
BetaBeacon
July 1, 2026

Tiny Bookshop Coming to iOS and Android on July 9th

- Manage a tiny bookshop by the sea in a cozy narrative management game - Decorate your shop with items collected and interact with customers - Recommend books to customers and befriend quirky characters in the town - Stock books of different genres to attract customers - Explore the town of Bookstonbury-by-the-Sea and discover its history and secrets
Microsoft quietly sped up File Explorer in June's optional update
Winsage
June 30, 2026

Microsoft quietly sped up File Explorer in June’s optional update

A recent Microsoft update, KB5095093, enhances the user experience on Windows 11, particularly by significantly accelerating File Explorer. The update reorganizes the "Home" tab in File Explorer for improved performance, resulting in faster access and functionality. It also improves the reliability of the address bar with quicker suggestions and enhances responsiveness when mounting disk images and adjusting folder view case sensitivity. This update is part of June's optional Windows update and will become mandatory in July. Users can install it via Windows Update or the Microsoft Update Catalog.
Microsoft Reveals Windows Setting to Safely Remove USB Drives and Prevent Data Loss
Winsage
June 30, 2026

Microsoft Reveals Windows Setting to Safely Remove USB Drives and Prevent Data Loss

Removing a USB drive from a port without using the “safely remove” option is generally acceptable on many Windows computers, depending on the policy for the external device. Microsoft provides two main options for removable drives: quick removal and better performance. Under the quick removal policy, users can disconnect the device without the “Safely Remove Hardware” process, although this may reduce system performance. Since Windows 10 version 1809, quick removal has been the default policy for external devices. However, users must ensure that all operations, such as copying or formatting, are completed before removal. The better performance policy requires users to use the safe removal option to prevent data loss, as it allows write caching. Failing to do so increases the risk of data loss if the drive is disconnected while Windows is still processing writes. The highest risk of data loss occurs when the drive is removed while Windows or an application is engaged in file operations. The safe removal icon serves as a confirmation that the drive is not in use, helping to prevent accidental ejection during active processes. Users can check the flash drive policy by accessing the device properties in Disk Management. The chosen setting may persist upon reconnection to the same computer port, leading to different experiences for users with similar drives. To minimize data loss, it is recommended to wait for operations to finish and use safe removal when uncertain about the drive's status.
Minecraft Adventure Maps — okay so let me just tell you what actually works
AppWizard
June 26, 2026

Minecraft Adventure Maps — okay so let me just tell you what actually works

Adventure maps in Minecraft allow players to experience curated gameplay without survival mechanics or resource gathering. These maps are designed in Adventure Mode, preventing players from altering the environments. They vary in length and complexity, with some lasting only 20 minutes and others several hours, often featuring custom dialogue and narratives. Quality adventure maps can be found on platforms like Planet Minecraft, MCPEDL, CurseForge, and the Minecraft Marketplace. It's important to check version compatibility to avoid glitches. Recommended adventure maps include Herobrine’s Mansion, Diversity 3, SkyBlock, The Forgotten, Chronos, and Parkour Paradise. Multiplayer maps should be labeled as such to avoid common issues like skipped puzzles and disrupted story pacing. Installing maps differs between Java and Bedrock editions, with Java scanning the saves folder and Bedrock requiring the opening of a .mcworld file. Players may face issues like command blocks failing or visual discrepancies due to missing resource packs or version mismatches. To evaluate a map's quality before downloading, check the download count and read comments for potential bugs. Java and Bedrock maps are not interchangeable, so verifying the edition and compatibility is crucial for a smooth experience.
Russia’s state-backed messaging app Max blocks regional chats where users tracked gas availability and shared information about lines at filling stations
AppWizard
June 25, 2026

Russia’s state-backed messaging app Max blocks regional chats where users tracked gas availability and shared information about lines at filling stations

The Max messenger has blocked chat groups in at least four Russian regions—Ivanovo, Vladimir, Tver, Krasnokamsk, and Chita—where users were tracking gas availability and information about filling station queues. The chat group "Benzin 33" in the Vladimir region gained 15,000 subscribers in three days, while "Benzin Ivanovo" had around 8,000 members, and the Tver chat reached 9,000 subscribers. The blocking in Vladimir was due to a technical violation related to subscriber registration with Roskomnadzor, while the reasons for blockings in other regions are unclear. Russia is facing a fuel crisis exacerbated by Ukrainian strikes on oil refineries, leading to restrictions on gasoline sales in over 20 areas and widespread shortages at gas stations. Additionally, the Federal Antimonopoly Service has banned the sale of gasoline on digital platforms, resulting in blocked listings on e-commerce sites like Ozon and Wildberries.
I Turned Off All Antivirus Protection for a Week. Here's What I Learned
Tech Optimizer
June 22, 2026

I Turned Off All Antivirus Protection for a Week. Here’s What I Learned

The author conducted an experiment by disabling both Bitdefender and Windows Security for a week to rely solely on personal cybersecurity instincts. They took precautions by using a secondary device and backing up important data. Throughout the week, the author experienced heightened awareness while navigating online tasks, encountered a phishing email, and adapted to a more deliberate browsing rhythm. Key takeaways included exercising caution, verifying sources, being aware of URLs, and keeping software updated. The experiment highlighted the importance of both good habits and antivirus software in maintaining cybersecurity. The author concluded that while personal vigilance is crucial, antivirus software is essential for those lacking strong instincts.
PostgreSQL 18 on Amazon Aurora and Amazon RDS: Performance enhancements
Tech Optimizer
June 20, 2026

PostgreSQL 18 on Amazon Aurora and Amazon RDS: Performance enhancements

PostgreSQL 18 addresses common performance challenges for users, including managing query performance across composite indexes, diagnosing memory spills in materialized Common Table Expressions (CTEs), and upgrading major versions without plan regressions. Key enhancements include skip scan optimization for multicolumn indexes, improved EXPLAIN functionality, and optimizer statistics that persist through major version upgrades. Skip scan optimization allows PostgreSQL to efficiently utilize multicolumn B-tree indexes even when leading columns are not specified in the WHERE clause, significantly improving query performance. The EXPLAIN command has been enhanced to include buffer statistics by default, providing deeper insights into query execution and resource usage. PostgreSQL 18 also introduces visibility into the storage of materialized nodes in query plans, indicating whether intermediate results were stored in memory or spilled to disk. A new metric, Index Searches, has been added to EXPLAIN ANALYZE output, indicating how many times the database traversed the index tree during query execution. Additionally, Self-Join Elimination (SJE) automatically detects and removes unnecessary inner joins of a table to itself, optimizing query performance. The autovacuum mechanism has been improved with the introduction of autovacuum_vacuum_max_threshold, which caps the number of dead tuples that can accumulate before autovacuum triggers a VACUUM, addressing issues with large tables. The vacuum_truncate parameter provides a server-wide control point to disable VACUUM’s file truncation behavior, reducing locking issues on busy systems. PostgreSQL 18 also separates the allocation of autovacuum worker slots from their usage, allowing for dynamic adjustments to autovacuum_max_workers without requiring a server restart. Finally, new columns in pg_stat_all_tables track cumulative time spent on maintenance operations, providing better insights into maintenance overhead for each table.
Search