data migration Archives

Tech Optimizer

May 14, 2025

Databricks adds Postgres database with $1B Neon acquisition

Databricks announced its intention to acquire Neon, a developer of a cloud-based dataset platform built on PostgreSQL, to enhance capabilities for developers and autonomous AI agents. The acquisition's estimated value is approximately billion, although financial specifics remain undisclosed. Neon, based in Menlo Park, California, raised .6 million prior to the acquisition. This move will expand Databricks' portfolio with open-source database functionalities, aiding in the development of data and AI applications. Databricks has made several acquisitions to support generative AI development, including MosaicML, Arcion, Einblick, Lilac AI, BladeBridge, and Tabular, with some valued at over billion. Neon's platform allows users to create PostgreSQL instances quickly and features a disaggregated compute and storage architecture for automatic scaling. The Neon team will join Databricks following the acquisition's completion.

AppWizard

May 5, 2025

Microsoft shuts down Skype — messenger worked for over 20 years

The Skype app officially ceased operations on May 5. Microsoft announced that all Skype accounts and users' chat histories will be transitioned to the Microsoft Teams app. Skype users can upgrade to the complimentary version of Microsoft Teams, which retains most of Skype's features and introduces new functionalities. Users can sign in to Microsoft Teams Free using their existing Skype credentials, with contacts and chat histories automatically transferred. A notification will guide users through the migration process. Users who do not adopt Microsoft Teams Free can save their Skype data. Skype was launched in 2003 by Niklas Zennström and Janus Friis and was acquired by Microsoft in 2011 for .5 billion. Microsoft introduced Teams in 2017 as a collaboration platform based on Skype.

Tech Optimizer

April 21, 2025

Best practices to handle AWS DMS tasks during PostgreSQL upgrades

The AWS Database Migration Service (AWS DMS) provides a managed solution for migrating and replicating databases to AWS, supporting both homogeneous and heterogeneous migrations. It allows seamless data migration from PostgreSQL databases to any supported target and vice versa. Open-source PostgreSQL regularly releases new versions, and Amazon RDS aims to support these within five months. Upgrading PostgreSQL instances is essential for security and compliance. Minor version upgrades focus on security and bug fixes without adding new functionalities, while major upgrades can change system tables and data formats. AWS DMS tasks require careful management during PostgreSQL upgrades. For minor upgrades, ongoing DMS tasks should be stopped and then resumed post-upgrade. For major upgrades, replication slots must be dropped before the upgrade, which will invalidate ongoing DMS tasks. After the upgrade, a new CDC-only task should be created to resume data migration. Minor version upgrades of the target PostgreSQL database do not affect AWS DMS CDC tasks, but major upgrades require stopping the DMS task, performing the upgrade, and ensuring compatibility with the replication instance before resuming the task.

Tech Optimizer

April 10, 2025

How Heroku migrated hundreds of thousands of self-managed PostgreSQL databases to Amazon Aurora

Heroku has migrated its multi-tenant PostgreSQL database fleet from a self-managed environment on Amazon EC2 to the Amazon Aurora PostgreSQL-Compatible Edition, improving operational efficiency and customer satisfaction without impacting customers. This transition involved moving over 200,000 databases, utilizing a dual control plane approach and specialized transfer systems for efficient data migration. The new architecture allows Heroku to leverage AWS Cloud services more effectively, alleviating the operational burdens on engineering teams and enabling a focus on customer value. The migration also positions Heroku to introduce advanced features such as AI-enabled database administration and enhanced security measures.

Winsage

February 20, 2025

I’ve been waiting for this possible Windows 11 transfer tool

A new transfer application for Windows 11 has been discovered in a preview build, potentially allowing users to migrate data without external storage or cloud services. Features may include "Back up to this PC" and "Transfer files to a new PC," utilizing a wireless transfer mode that requires both PCs to be on the same Wi-Fi network. The app could leverage technology similar to Nearby Sharing for an intuitive interface. Users may need to pair their devices and connect to a power source for the transfer, though it might not show available controls or a list of files for transfer. The app is integrated into Windows 11’s Backup app, but its development status is uncertain, with no official announcement from Microsoft. The project is not currently undergoing active testing, leaving its future unclear. If released, it could simplify the transition to new devices without additional charges for larger file sizes.

Tech Optimizer

December 17, 2024

Top PostgreSQL Tools for Developers and Administrators

PostgreSQL is utilized by over 48,000 companies, holding a market share of 17.33%. It is known for its robust architecture and advanced features, prompting users to seek various tools for enhanced productivity and database management. The top PostgreSQL GUI tools include: 1. **pgAdmin**: Official tool for database administration, compatible with major OS, with features for SQL scripts, database management, and server performance monitoring. 2. **DBeaver**: Universal database tool supporting around 80 databases, facilitating data editing, navigation, and report generation. 3. **Navicat**: User-friendly tool for managing PostgreSQL servers, creating queries, and analyzing data. 4. **TablePlus**: Modern tool with inline editing, advanced filters, and dashboard creation capabilities. 5. **DataGrip**: Intelligent query console with automatic code completion and bug detection features. 6. **Beekeeper Studio**: Online tool with a spreadsheet interface and robust security features, allowing multiple tabs and SQL query saving. 7. **dbForge Studio for MySQL**: Tool for database development, supporting various platforms and facilitating query creation. 8. **DbVisualizer**: Preferred tool for database navigation and SQL editing, used by organizations like Tesla and NASA. 9. **OmniDB**: Lightweight, open-source tool with an interactive interface and SSH tunnel security. 10. **Postico**: Mac-specific tool for data exploration and analysis. 11. **HeidiSQL**: Free tool for comprehensive data editing and structure management. 12. **Adminer**: PHP-based tool for easy deployment and enhanced security. 13. **PostgreSQL Data Wizard**: Supports multiple file formats for data export and manipulation. 14. **PostgreSQL PHP Generator**: Facilitates rapid web application development without coding. 15. **MySQL Workbench**: Unified tool for SQL development and data modeling, supporting migration. 16. **ClusterControl**: Monitoring tool for automating PostgreSQL management and security. 17. **Convertdb For PostgreSQL**: Cross-database tool for data migration and synchronization. 18. **Luna Modeler**: Tool for database design and SQL script generation. 19. **DronaHQ**: Low-code tool builder for front-end applications connecting to PostgreSQL. 20. **dbForge Data Compare for PostgreSQL**: Tool for comparing table data and managing inconsistencies.

Tech Optimizer

December 12, 2024

Quest Software Accelerates PostgreSQL Adoption with New Monitoring and Migration Solutions

Quest Software has introduced two updates to enhance PostgreSQL adoption: 1. Foglight® with the Performance Investigator for PostgreSQL add-on, which provides database observability and advanced workload analysis to improve performance monitoring. 2. SharePlex®, a data replication and migration tool that now supports synchronization among PostgreSQL 17.0, Oracle 23ai, MariaDB 11.4.2, Google AlloyDB, and Google AlloyDB Omni, facilitating smooth data migrations and real-time synchronization. These solutions aim to optimize PostgreSQL performance, reduce migration risks, and support organizations in leveraging modern database platforms effectively.

Tech Optimizer

December 12, 2024

New Quest Software updates help accelerate enterprise adoption of PostgreSQL

Quest Software Inc. has released two updates to support the adoption of PostgreSQL. The first update, Foglight with the Performance Investigator for PostgreSQL add-on, enhances database observability and performance optimization, allowing administrators to analyze workloads, identify inefficient queries, and resolve resource issues. Foglight provides a unified view across multiple database environments, essential for managing complex multicloud or hybrid landscapes. The second update, SharePlex, offers robust data replication and migration capabilities for PostgreSQL 17.0, Oracle 23ai, MariaDB 11.4.2, and Google AlloyDB, ensuring real-time data synchronization and minimizing disruption during migrations. SharePlex includes "Compare and Repair" features to address data discrepancies and allows parallel operation of legacy systems with PostgreSQL for phased transitions. Quest Software has been owned by private equity firm Clearlake since 2021.

Tech Optimizer

December 10, 2024

How Firmex used AWS SCT and AWS DMS to move 65,000 on-premises Microsoft SQL Server databases to an Amazon Aurora PostgreSQL cluster

Firmex is a provider of Virtual Data Rooms, opening over 20,000 new rooms annually and focusing on security and availability for clients during due diligence processes. The company previously managed around 65,000 databases across four Microsoft SQL Servers but faced challenges related to database limits, backups, and licensing terms. In 2020, engineers recognized they were nearing the maximum database limit and shifted from a database-based isolation model to a schema-based isolation approach using PostgreSQL. This transition involved collaboration with AWS to utilize Aurora PostgreSQL-Compatible Edition, which offered better performance and cost-effectiveness. The migration process required extensive work, including converting stored procedures and addressing data migration challenges such as endpoint and task limits with AWS DMS. Firmex's engineers developed custom tooling to manage the migration effectively, ensuring minimal downtime for customers. Post-migration, they have seen improved performance and reduced operating costs, with ongoing efforts to optimize their PostgreSQL utilization further.

Winsage

December 9, 2024

The Countdown to Windows 10 End of Life: What IT Teams Need to Know

Microsoft will discontinue support for Windows 10 on October 14, 2025. Extended Security Updates (ESUs) will be available for a maximum of three years at approximately per device. Windows 10 is currently the most targeted among older Windows operating systems, facing high-severity vulnerabilities. Organizations should conduct an asset audit, evaluate ESUs, migrate critical systems to the cloud, and establish a decommission plan for legacy systems. Morphisec offers a lightweight security solution for legacy systems, utilizing Automated Moving Target Defense (AMTD) technology to protect against advanced threats without the need for updates or internet connectivity.