partitions Archives

Tech Optimizer

April 15, 2026

Postgres to Iceberg in 13 minutes: How Supermetal compares to Flink, Kafka Connect, and Spark

Supermetal introduced Iceberg sink support, allowing for data transfer from Postgres to Iceberg. In a performance comparison, Supermetal completed snapshotting in 13 minutes, while Flink took 90 to 116 minutes, Kafka Connect required 120 minutes, and Spark exceeded 3 hours. The tests focused on throughput during the snapshotting phase rather than latency. The setup used the TPC-H dataset with a scale factor of 50 and involved AWS infrastructure. Supermetal operates independently of Kafka, enabling direct data delivery from source to sink. It utilizes a JSON configuration file for deployment, supporting various catalogs and advanced configuration options. Supermetal's Iceberg writer can adjust settings based on the CDC source phase. Throughout the tests, Supermetal maintained low CPU and memory usage, while other tools faced challenges with performance and resource management. Data synchronization was validated across all tools, with Supermetal achieving at least 7x faster snapshotting performance without tuning.

Winsage

April 15, 2026

Mega Upgrade for Windows 11! Storage Suddenly Much Larger

Microsoft has lifted the FAT32 file system's volume limit in a recent preview version of Windows 11, allowing users to format storage devices with capacities of up to 2 terabytes, an increase from the previous maximum of 32 gigabytes. This change addresses a long-standing limitation that has existed since 1996. Additionally, Microsoft is enhancing the partition tool in Windows 11, improving its speed and responsiveness for managing multiple partitions. These updates are currently being tested in the Windows Insider Program, with no confirmed timeline for broader availability.

Winsage

April 13, 2026

Windows 11 is finally removing the 32GB FAT32 capacity limit

Microsoft has released new test builds for Windows Insiders, specifically Dev Build 26300.8170 and Beta Build 26220.8165, which remove the 32GB limit on FAT32 formatting for external drives. Users can now format external drives up to 2TB using FAT32 through the Command Prompt. This change, which has been anticipated by users, is a shift from the long-standing restriction that required third-party applications or specialized commands for larger drives. The enhancement applies only to the Command Prompt, as the graphical interface remains unchanged, and the 4GB file size limit for individual files on FAT32 drives still applies. This feature is currently available only in preview versions for Windows Insiders, with a broader rollout planned for future standard Windows 11 updates.

Tech Optimizer

April 1, 2026

EDB Postgres AI for WarehousePG: Reclaiming control of the enterprise data warehouse

Many enterprises are transitioning from traditional proprietary data warehouse platforms, such as Teradata and Snowflake, due to issues like vendor lock-in, unpredictable pricing, and limited flexibility. EDB Postgres® AI (EDB PG AI) offers WarehousePG, an open-source, petabyte-scale data warehouse built on Postgres, designed to provide control, predictability, and data sovereignty while maintaining performance. WarehousePG utilizes a massively parallel processing (MPP) architecture, allowing it to efficiently execute complex queries across large datasets. It offers predictable performance without proprietary constraints, enabling organizations to avoid vendor-controlled execution engines. WarehousePG supports hybrid storage and SQL access to external data lakes through the Platform Extension Framework (PXF), simplifying ETL processes. It includes FlowServer for real-time data ingestion and supports in-database AI and machine learning, allowing for advanced analytics without transferring data outside the warehouse. The platform is engineered for high availability and enterprise readiness, with features like workload management and observability. Migration from legacy platforms is facilitated through a low-risk modernization pathway. Overall, WarehousePG provides a modern alternative to traditional data warehouses, emphasizing architectural control and open-source economics.

Tech Optimizer

March 19, 2026

Building a High-Performance Postgres Time Series Stack with Iceberg

Postgres extensions, specifically pg_lake, pg_partman, and pg_incremental, provide a vendor-agnostic, open-source solution for managing high-performance time series data. PostgreSQL serves as the foundation, while pg_partman automates time partition management, pg_lake connects Postgres with data lakes for offloading cold data, and pg_incremental processes append-only data in batches. These extensions are maintained by the Postgres team at Snowflake. An example system for monitoring temperature readings uses local storage for recent data and transitions cold data to an Apache Iceberg table on S3. The process includes creating a partitioned table in Postgres, establishing an Iceberg table, using pg_incremental for data appending, eliminating old partitions with pg_partman, and querying from both local and cold tables to optimize storage and costs. A time-partitioned table enhances performance by allowing efficient deletion of outdated data, speeding up queries, and reducing fragmentation.

Winsage

March 15, 2026

Microsoft Updates Windows 11 ISO Tool, How To Install It Without A Microsoft Account Or Internet Connection

A clean install of Windows can improve system performance and resolve issues. To begin, back up important files to a NAS, secondary PC, external storage, or cloud service. Wipe the system disk and start fresh. For installing Windows 11, options include performing a Cloud Download reinstall via the Windows Recovery Environment or using external storage with Microsoft's Media Creation Tool or an ISO. Microsoft updates installation ISOs monthly, reducing the need for additional driver installations. Download necessary drivers beforehand, focusing on graphics and chipset drivers. To perform a clean installation, download the latest Windows 11 Disk Image (ISO) from Microsoft's website and use Rufus to write it to external storage. Rufus allows bypassing certain Windows 11 requirements, such as Secure Boot and TPM 2.0, and can facilitate creating a local account instead of using a Microsoft account. Ensure updated BIOS installations are checked if applicable. After writing the installation media, boot from it by accessing the boot menu or adjusting the UEFI setup. During installation, delete existing partitions and select empty space to proceed. Finally, install drivers post-installation.

Winsage

February 22, 2026

Windows 12 Forecast Six Expert Predictions

Microsoft is preparing for the release of Windows 12, which is expected to feature an AI-native experience with deep integration of Copilot, showcasing capabilities like on-screen comprehension, voice activation, and task automation. The hardware requirements will be elevated, necessitating 16GB of RAM, rapid NVMe storage, and a Neural Processing Unit (NPU) for advanced features. Windows on Arm is gaining momentum, with improvements in app compatibility and battery life, while a modular architecture called CorePC is being developed to facilitate faster updates and enhance security. Licensing for Windows 12 is expected to remain unchanged for consumers, with optional cloud-enhanced services available. The update cadence will increase, allowing for faster feature drops independent of major OS releases, with the Windows Insider Program continuing to test new features. Upon its release, Windows 12 will integrate Copilot, provide a more cohesive OS core, and support both x86 and Arm architectures.

Tech Optimizer

February 19, 2026

How OpenAI Scaled to 800 Million Users on PostgreSQL

OpenAI has scaled PostgreSQL to support over 800 million active users of ChatGPT, making it one of the largest PostgreSQL deployments globally. The database can handle millions of concurrent connections and a very high volume of requests per second. OpenAI employs several strategies to optimize performance: 1. **Connection Pooling with PgBouncer**: Reduced database connections from 10,000 to 200, enhancing efficiency by a factor of 50. 2. **Read Replicas**: Distributes read requests across multiple replicas while the primary database handles writes. 3. **Horizontal Sharding**: Partitions data across multiple instances based on a shard key, such as user_id or tenant_id. 4. **Query Optimization**: Analyzes slow queries and creates appropriate indexes to maintain performance. 5. **Connection Management**: Implements timeouts and connection limits to prevent overload. 6. **Caching**: Uses application-level caching with Redis to reduce database load. 7. **Monitoring and Observability**: Tracks key metrics like connection counts and query latency to identify issues early. These strategies enable OpenAI to maintain performance and reliability for a large user base.

Winsage

December 24, 2025

Windows 11 has a hidden driver that may boost NVMe SSD performance

Windows users have relied on the disk.sys driver for storage management since 2006, which has not changed significantly despite support for NVMe since Windows 8.1. Microsoft has introduced nvmedisk.sys for Windows Server 2025 and a version in Windows 11 25H2, which improves performance by enhancing integration with NVMe technology. Tests show that nvmedisk.sys offers better raw throughput in sequential and random read/write tasks compared to disk.sys, as it removes the legacy SCSI translation layer, reducing overhead and improving latency, particularly on high-end SSDs. However, enabling nvmedisk.sys may cause system instability or boot failures if the SSD controller lacks compatibility, and users are advised to check the current driver in Device Manager and back up data before switching drivers. The new driver is still in a soft launch phase, and there is uncertainty about when it will be available in a stable build.

Winsage

December 22, 2025

Windows 11 hack: Higher SSD speeds with new Microsoft NVMe driver

The process of enhancing SSD performance involves modifying the Windows registry with specific commands to unlock improvements in data transfer speeds, particularly for PCIe 4.0 SSDs. The commands to add values to the registry are: 1.

reg add HKEYLOCALMACHINESYSTEMCurrentControlSetPoliciesMicrosoftFeatureManagementOverrides /v 735209102 /t REG_DWORD /d 1 /f

reg add HKEYLOCALMACHINESYSTEMCurrentControlSetPoliciesMicrosoftFeatureManagementOverrides /v 1853569164 /t REG_DWORD /d 1 /f

reg add HKEYLOCALMACHINESYSTEMCurrentControlSetPoliciesMicrosoftFeatureManagementOverrides /v 156965516 /t REG_DWORD /d 1 /f

After executing these commands, a system restart is required to see changes in the Device Manager, where SSD drives will shift from "Disk drives" to "Storage disks," indicating the use of the nvmedisk.sys driver. Users may experience a 10 to 15% increase in data speeds for PCIe 4.0 SSDs, with even PCIe Gen 3.0 SSDs showing improvements. Benchmark results indicated up to a 45% increase in sequential reading performance and a 15% increase in write performance. For a specific 1TB SSD, sequential read performance improved by approximately 23%, and write performance increased by 30%. However, caution is advised as some users reported issues with SSD management tools, and compatibility with all NVMe SSDs is not guaranteed.