data migration Archives

Tech Optimizer

April 21, 2025

Best practices to handle AWS DMS tasks during PostgreSQL upgrades

The AWS Database Migration Service (AWS DMS) provides a managed solution for migrating and replicating databases to AWS, supporting both homogeneous and heterogeneous migrations. It allows seamless data migration from PostgreSQL databases to any supported target and vice versa. Open-source PostgreSQL regularly releases new versions, and Amazon RDS aims to support these within five months. Upgrading PostgreSQL instances is essential for security and compliance. Minor version upgrades focus on security and bug fixes without adding new functionalities, while major upgrades can change system tables and data formats. AWS DMS tasks require careful management during PostgreSQL upgrades. For minor upgrades, ongoing DMS tasks should be stopped and then resumed post-upgrade. For major upgrades, replication slots must be dropped before the upgrade, which will invalidate ongoing DMS tasks. After the upgrade, a new CDC-only task should be created to resume data migration. Minor version upgrades of the target PostgreSQL database do not affect AWS DMS CDC tasks, but major upgrades require stopping the DMS task, performing the upgrade, and ensuring compatibility with the replication instance before resuming the task.

Tech Optimizer

April 10, 2025

How Heroku migrated hundreds of thousands of self-managed PostgreSQL databases to Amazon Aurora

Heroku has migrated its multi-tenant PostgreSQL database fleet from a self-managed environment on Amazon EC2 to the Amazon Aurora PostgreSQL-Compatible Edition, improving operational efficiency and customer satisfaction without impacting customers. This transition involved moving over 200,000 databases, utilizing a dual control plane approach and specialized transfer systems for efficient data migration. The new architecture allows Heroku to leverage AWS Cloud services more effectively, alleviating the operational burdens on engineering teams and enabling a focus on customer value. The migration also positions Heroku to introduce advanced features such as AI-enabled database administration and enhanced security measures.

Winsage

February 20, 2025

I’ve been waiting for this possible Windows 11 transfer tool

A new transfer application for Windows 11 has been discovered in a preview build, potentially allowing users to migrate data without external storage or cloud services. Features may include "Back up to this PC" and "Transfer files to a new PC," utilizing a wireless transfer mode that requires both PCs to be on the same Wi-Fi network. The app could leverage technology similar to Nearby Sharing for an intuitive interface. Users may need to pair their devices and connect to a power source for the transfer, though it might not show available controls or a list of files for transfer. The app is integrated into Windows 11’s Backup app, but its development status is uncertain, with no official announcement from Microsoft. The project is not currently undergoing active testing, leaving its future unclear. If released, it could simplify the transition to new devices without additional charges for larger file sizes.

Tech Optimizer

December 17, 2024

Top PostgreSQL Tools for Developers and Administrators

PostgreSQL is utilized by over 48,000 companies, holding a market share of 17.33%. It is known for its robust architecture and advanced features, prompting users to seek various tools for enhanced productivity and database management. The top PostgreSQL GUI tools include: 1. **pgAdmin**: Official tool for database administration, compatible with major OS, with features for SQL scripts, database management, and server performance monitoring. 2. **DBeaver**: Universal database tool supporting around 80 databases, facilitating data editing, navigation, and report generation. 3. **Navicat**: User-friendly tool for managing PostgreSQL servers, creating queries, and analyzing data. 4. **TablePlus**: Modern tool with inline editing, advanced filters, and dashboard creation capabilities. 5. **DataGrip**: Intelligent query console with automatic code completion and bug detection features. 6. **Beekeeper Studio**: Online tool with a spreadsheet interface and robust security features, allowing multiple tabs and SQL query saving. 7. **dbForge Studio for MySQL**: Tool for database development, supporting various platforms and facilitating query creation. 8. **DbVisualizer**: Preferred tool for database navigation and SQL editing, used by organizations like Tesla and NASA. 9. **OmniDB**: Lightweight, open-source tool with an interactive interface and SSH tunnel security. 10. **Postico**: Mac-specific tool for data exploration and analysis. 11. **HeidiSQL**: Free tool for comprehensive data editing and structure management. 12. **Adminer**: PHP-based tool for easy deployment and enhanced security. 13. **PostgreSQL Data Wizard**: Supports multiple file formats for data export and manipulation. 14. **PostgreSQL PHP Generator**: Facilitates rapid web application development without coding. 15. **MySQL Workbench**: Unified tool for SQL development and data modeling, supporting migration. 16. **ClusterControl**: Monitoring tool for automating PostgreSQL management and security. 17. **Convertdb For PostgreSQL**: Cross-database tool for data migration and synchronization. 18. **Luna Modeler**: Tool for database design and SQL script generation. 19. **DronaHQ**: Low-code tool builder for front-end applications connecting to PostgreSQL. 20. **dbForge Data Compare for PostgreSQL**: Tool for comparing table data and managing inconsistencies.

Tech Optimizer

December 12, 2024

Quest Software Accelerates PostgreSQL Adoption with New Monitoring and Migration Solutions

Quest Software has introduced two updates to enhance PostgreSQL adoption: 1. Foglight® with the Performance Investigator for PostgreSQL add-on, which provides database observability and advanced workload analysis to improve performance monitoring. 2. SharePlex®, a data replication and migration tool that now supports synchronization among PostgreSQL 17.0, Oracle 23ai, MariaDB 11.4.2, Google AlloyDB, and Google AlloyDB Omni, facilitating smooth data migrations and real-time synchronization. These solutions aim to optimize PostgreSQL performance, reduce migration risks, and support organizations in leveraging modern database platforms effectively.

Tech Optimizer

December 12, 2024

New Quest Software updates help accelerate enterprise adoption of PostgreSQL

Quest Software Inc. has released two updates to support the adoption of PostgreSQL. The first update, Foglight with the Performance Investigator for PostgreSQL add-on, enhances database observability and performance optimization, allowing administrators to analyze workloads, identify inefficient queries, and resolve resource issues. Foglight provides a unified view across multiple database environments, essential for managing complex multicloud or hybrid landscapes. The second update, SharePlex, offers robust data replication and migration capabilities for PostgreSQL 17.0, Oracle 23ai, MariaDB 11.4.2, and Google AlloyDB, ensuring real-time data synchronization and minimizing disruption during migrations. SharePlex includes "Compare and Repair" features to address data discrepancies and allows parallel operation of legacy systems with PostgreSQL for phased transitions. Quest Software has been owned by private equity firm Clearlake since 2021.

Tech Optimizer

December 10, 2024

How Firmex used AWS SCT and AWS DMS to move 65,000 on-premises Microsoft SQL Server databases to an Amazon Aurora PostgreSQL cluster

Firmex is a provider of Virtual Data Rooms, opening over 20,000 new rooms annually and focusing on security and availability for clients during due diligence processes. The company previously managed around 65,000 databases across four Microsoft SQL Servers but faced challenges related to database limits, backups, and licensing terms. In 2020, engineers recognized they were nearing the maximum database limit and shifted from a database-based isolation model to a schema-based isolation approach using PostgreSQL. This transition involved collaboration with AWS to utilize Aurora PostgreSQL-Compatible Edition, which offered better performance and cost-effectiveness. The migration process required extensive work, including converting stored procedures and addressing data migration challenges such as endpoint and task limits with AWS DMS. Firmex's engineers developed custom tooling to manage the migration effectively, ensuring minimal downtime for customers. Post-migration, they have seen improved performance and reduced operating costs, with ongoing efforts to optimize their PostgreSQL utilization further.

Winsage

December 9, 2024

The Countdown to Windows 10 End of Life: What IT Teams Need to Know

Microsoft will discontinue support for Windows 10 on October 14, 2025. Extended Security Updates (ESUs) will be available for a maximum of three years at approximately per device. Windows 10 is currently the most targeted among older Windows operating systems, facing high-severity vulnerabilities. Organizations should conduct an asset audit, evaluate ESUs, migrate critical systems to the cloud, and establish a decommission plan for legacy systems. Morphisec offers a lightweight security solution for legacy systems, utilizing Automated Moving Target Defense (AMTD) technology to protect against advanced threats without the need for updates or internet connectivity.

AppWizard

December 6, 2024

Linkora: The Ultimate Open Source Tool to Organize Links on Android

Linkora is a FOSS Android application developed using Kotlin that helps users manage and organize links in one accessible location. It allows users to add links easily, categorize them into folders, and offers features such as archiving, copying, sharing, and searching for links. Users can create new panels for specific topics and customize their viewing experience with different layout options. The app supports data migration in JSON and HTML formats and is available for installation on F-Droid, with its source code hosted on GitHub.

Winsage

October 17, 2024

The public preview of Windows Admin Center version 2410 is now available

Microsoft has released version 2410 of its Windows Admin Center app, which cannot be installed alongside version 2311 or earlier versions. Users with a high availability (HA) setup are advised not to install this preview version, as HA is not supported in the current backend implementation. Version 2410 includes enhancements to the virtual machine tool, allowing for quicker listing of virtual machines and a new toggle feature to switch between "detailed" and "light" modes. The update also addresses several bugs to improve user experience. General availability of the app is expected by the end of 2024.