performance improvement Archives

Tech Optimizer

February 27, 2025

Upgrade strategies for Amazon Aurora PostgreSQL and Amazon RDS for PostgreSQL 12

Standard support for Amazon Aurora PostgreSQL-Compatible Edition and Amazon RDS for PostgreSQL version 12 will end on February 28, 2025. The final update for PostgreSQL 12, version 12.22, was released on November 21, 2024. PostgreSQL follows an annual major version release cycle, supporting each version for five years post-release. Upgrading to newer major versions requires careful planning and testing to ensure application compatibility. New features in higher PostgreSQL versions include performance improvements, enhanced security, and new functionalities. Aurora PostgreSQL now supports AWS Graviton4 instances, which provide up to 40% performance improvement over Graviton3 instances. Recommended upgrades include moving to PostgreSQL 16 or newer, with options for in-place upgrades, blue/green deployments, and out-of-place upgrades. Amazon RDS Extended Support allows continued operation on a major version beyond the standard support end date, available at an additional cost. Extended Support for Aurora PostgreSQL 12.x and Amazon RDS for PostgreSQL 12.x will incur charges starting March 1, 2025, and will cease upon upgrading.

AppWizard

February 5, 2025

Monster Hunter Wilds lowers its minimum PC specs, releases benchmarking too

Capcom has revised the recommended specifications for Monster Hunter Wilds to improve PC optimization based on beta feedback. The minimum CPU requirement is now an Intel Core i5-10400, Intel Core i3-12100, or AMD Ryzen 5 3600, down from an Intel Core i5-10600 or Intel Core i3-12100F. The minimum GPU requirement has been adjusted to Nvidia GeForce GTX 1660 or AMD Radeon RX 5500 XT, and the storage requirement has been reduced from 140 GB to 75 GB. A benchmarking tool is available on the game's Steam page, allowing players to assess system compatibility and performance. Scores above 20,000 indicate a smooth experience at high settings, while scores below 7,000 may require significant settings changes. Testing with high-end hardware yielded an average frame rate of 85 FPS at 1440p with Ultra presets, while mid-range hardware achieved an average of 45 FPS at 1080p with Medium presets. Monster Hunter Wilds is set to launch on PC, PS5, and Xbox Series X|S on February 28, 2025.

Tech Optimizer

December 13, 2024

Benchmark Amazon RDS for PostgreSQL with Dedicated Log Volumes

Organizations face challenges in maintaining the performance of mission-critical databases under demanding workloads. Amazon Relational Database Service (Amazon RDS) offers a managed, cost-effective, and scalable solution. In PostgreSQL, transactions are logged in a Write-Ahead Log (WAL) buffer before being stored in a WAL segment, which is crucial for data recovery and replication. The performance of these transactions is linked to the storage system for WAL segments. By default, PostgreSQL stores all files, including WAL, in one location, but separating WAL storage can enhance performance. Amazon introduced the Dedicated Log Volume (DLV) feature, allowing users to store WAL segments on a separate volume of 1,024 GiB with 3,000 Provisioned IOPS. DLV features write coalescing, reducing IOPS demand by consolidating log writes into larger operations, improving throughput and efficiency while potentially lowering costs. A benchmarking solution involves executing a script on an Amazon EC2 instance to evaluate performance across two RDS for PostgreSQL instances: one with DLV enabled and one without. To benchmark, prerequisites include launching an Amazon EC2 Linux instance, installing pgbench, and creating two RDS instances—one with DLV and one without. The benchmarking script resets WAL statistics and simulates a workload with 64 concurrent clients processing half a million transactions each. The infrastructure for benchmarking includes an EC2 instance with 16 vCPUs and 128 GiB memory, and two RDS instances with 64 vCPUs and 512 GiB memory each, using IO2 storage with 10,000 PIOPS. Key database configuration parameters impact performance, particularly those related to commit, checkpoint, and WAL settings. The benchmarking script uses pgbench to create a TPC-B-like workload and measures performance metrics such as transactions per second (TPS) and latency. Results indicate that enabling DLV significantly reduces runtime from 77 minutes to 40 minutes (a 92.5% improvement), increases TPS by 91.83%, and reduces latency by 95.56%. Key WAL statistics show improvements in write and sync times, confirming DLV's effectiveness in enhancing database performance. Monitoring techniques for DLV include using Amazon CloudWatch for metrics like IOPS and latency, and PostgreSQL's pg_stat_wal for detailed WAL activity statistics. The DLV feature is compatible with PIOPS storage types and supported in specific PostgreSQL versions across all regions.

Tech Optimizer

November 21, 2024

DuckDB inside Postgres!!??

The integration of DuckDB within PostgreSQL has garnered attention due to PostgreSQL's limitations in handling online analytical processing (OLAP) tasks on larger datasets. DuckDB is noted for its speed and is seen as a solution to enhance PostgreSQL's analytical capabilities. To evaluate this integration, a setup involving PostgreSQL with the DuckDB extension and a dataset of 50 million records is required. The process includes creating a Docker container for PostgreSQL, importing the dataset, and running performance queries. Initial tests may not always show a significant performance improvement with DuckDB compared to PostgreSQL, leading to questions about the integration's effectiveness. However, the integration offers innovative data processing methods, such as reading datasets like Iceberg and writing back to cloud storage. The data engineering community is encouraged to critically assess the performance claims and mechanics of this integration.

AppWizard

November 8, 2024

Baldur’s Gate 3 on PS5 Is Essentially The Same As PC Version’s Ultra Settings

Eurogamer confirmed that the graphical settings on the PS5 for Baldur's Gate 3 are comparable to those of a high-end PC running the game on Ultra settings. The game has received numerous updates for performance improvement on PC, and it operates smoothly in Act Three, despite some shared issues between platforms. The game supports both keyboard and mouse controls as well as controllers on PS5 and PC, though the interface may become complex as players progress. The PS5 version runs natively at 1440p without dynamic resolution adjustments and offers two image quality options: Quality mode targets 30fps and Performance mode aims for 60fps, achieving this in most scenarios but experiencing performance dips in densely populated areas. Screen tearing occurs when frame rates drop below 60fps. Despite performance challenges, Baldur's Gate 3 has been well-received on the PS5.

Tech Optimizer

October 21, 2024

Review: FixMeStick is an easy way to protect computers from malware

The FixMeStick is a plug-and-play antivirus tool designed to identify and eliminate infections that bypass standard antivirus software, reboot the system to remove infections, and function alongside existing antivirus solutions. It is simple to set up, requiring users to plug it into a USB port and follow clear instructions. The initial scan takes about five minutes, while a more comprehensive scan lasts approximately an hour. In testing, the FixMeStick identified a legitimate virus from an executable file associated with a PDF reader. Although there was no immediate performance improvement, it provides peace of mind and encourages regular use as a supplementary security measure. The FixMeStick features an intuitive interface but operates on a subscription model, which may not appeal to all users. It is recommended for those looking for an effective method to check for malware.

Tech Optimizer

September 27, 2024

PostgreSQL 17 Released With AVX-512 Optimization & Up To 2x Better Write Throughput

PostgreSQL 17 has been released, introducing significant performance enhancements. Key features include an AVX-512 optimized bit_count() function that offers a 48% performance improvement, a SIMD-optimized JSON escaping feature that can accelerate query performance by up to 4x, and a revamped internal memory structure for the vacuum process that uses up to 20x less memory. Enhancements to the I/O layer are expected to double write throughput for high concurrency workloads. New features include JSON_TABLE support, new MERGE features, a new collation provider, and support for incremental backups with pg_basebackup.

Tech Optimizer

September 26, 2024

PostgreSQL 17 packs big performance and feature enhancements

PostgreSQL 17 has been released by the PostgreSQL Global Development Group, introducing native support for incremental backups, enhancing SQL/JSON capabilities with new functions, allowing configuration of the Simple Least Recently Used (SLRU) cache, and improving logical replication processes. Performance improvements include better handling of write-ahead log (WAL) locks, optimization of queries using the IN clause with B-tree indexes, and support for Intel AVX-512 chip instructions.

Tech Optimizer

September 26, 2024

PostgreSQL 17 Gets Incremental Backup, SQL Queries for JSON

The latest release of PostgreSQL introduces several significant enhancements, including: - **Incremental Backup**: Transfers only changes made since the last backup, reducing bandwidth usage and storage costs, with recovery times improved from an average of 78 minutes to 4 minutes. - **Studier Replication**: Enhancements to replication slots ensure database consistency during failovers, allowing the replication stream to continue seamlessly with the standby server, preventing data loss. - **Hella JSON Support**: Improved support for JSON data types allows querying JSON data using standard SQL statements and introduces a json table feature for rendering JSON data into a table format. - **Hardier Subtransactions**: A redesign of the sub-transaction cache results in a 100x performance improvement for migrations involving nested transactions, particularly beneficial in high-transaction environments like finance.

Tech Optimizer

September 26, 2024

PostgreSQL 17 integrates better with JSON and requires fewer query rewrites

PostgreSQL version 17 is now available, featuring significant improvements in performance, scalability, and ease of use. Key enhancements include better integration with the JSON standard, improved logical replication, and enhanced memory management through a more efficient vacuum process. The update automates query execution for the 'IN' clause with B-tree indexes, reducing the need for manual query rewriting. Additionally, PostgreSQL 17 introduces native support for incremental backups. The maintenance of PostgreSQL is managed by The PostgreSQL Global Development Group, with contributions from over 450 developers and companies.