orchestrator Archives

Winsage

July 26, 2026

Microsoft finally making much needed improvement to Windows 11 downloads and installs

A significant outage recently affected Microsoft, causing a temporary halt in Windows 11 updates through both the Windows Update channel and the Microsoft Update Catalog. Microsoft is leveraging AI technology to identify vulnerabilities within its updates, addressing security challenges. Users often encounter inconsistencies with the Windows Update progress tracker, leading to uncertainty during the download and installation phases. Microsoft has confirmed improvements in the update management process with the latest Windows 11 24H2 and 25H2 Release Preview builds, including enhancements to the Orchestrator and Arbiter logging components. The update enhances the calculation of update progress in Windows Update Settings and introduces changes to the cleanup logic for improved system performance post-update. These enhancements could benefit users with less powerful PCs, addressing concerns about sluggishness after installations.

Tech Optimizer

July 23, 2026

Simplify AI agent orchestration with Lakebase Postgres

The auditing process has traditionally been labor-intensive, requiring extensive document reviews. CLA (CliftonLarsonAllen LLP) partnered with the Databricks Forward Deployed Engineering team to develop a document processing application that reduces extraction time from hours to minutes while maintaining quality. The application is built on the Databricks platform, utilizing technologies like Lakebase Postgres, Databricks Apps, Lakeflow Jobs, MLflow, and Unity Catalog Volumes. The application addresses challenges in document parsing, including unpredictable per-task latency, rate-limit-aware throttling, workload prioritization, cost attribution per task, and real-time progress visibility. It eliminates the need for multiple specialized systems by integrating components such as a web application for user interaction, Lakebase for state management, an orchestrator for task management, and AI agents for document processing. The task queue is supported by two Postgres tables in Lakebase, tracking task status and execution attempts. Concurrency safety is ensured through a locking mechanism, and crash recovery is facilitated by lease-based locking. The orchestrator implements rate-limit-aware throttling and idempotent webhook callbacks to manage task processing effectively. An operator dashboard provides real-time metrics on task status, agent performance, and workload costs, with live updates through Postgres LISTEN/NOTIFY events. Cost attribution is managed at the application level, allowing for detailed monitoring of expenditures. Lakebase enhances the orchestration process with features like autoscaling compute, OAuth-rotated authentication, Unity Catalog integration, and support for branching and snapshots.

Tech Optimizer

July 21, 2026

I Built My Second ETL Pipeline. This Time, I Started Thinking Like a Data Engineer

The author transitioned from a data analyst role to a data engineer, creating a 12-month self-study roadmap focused on learning by building projects. The first project was a GitHub ETL pipeline, which evolved from a simple Python script to a more complex system using SQLite and GitHub Actions for automation. The author realized that the challenges of data engineering lay in system design and orchestration rather than just writing ETL logic. For the second project, the author built an automated RSS ingestion pipeline to explore engineering decisions in creating a reliable data pipeline. The project emphasized the importance of separating application responsibilities from orchestration tasks, leading to the use of Docker for consistent execution environments and Kestra for orchestration. The author validated each component of the project incrementally: first the Python ETL, then PostgreSQL, followed by Docker, and finally Kestra. This approach ensured that each layer functioned correctly before adding complexity. The final architecture included distinct responsibilities for each component: Python for data processing, PostgreSQL for data storage, Docker for execution, and Kestra for orchestration. The author learned that effective engineering involves considering system reliability, error handling, and observability, shifting the focus from merely writing code to designing entire systems. The experience transformed the author's mindset, emphasizing the importance of incremental building and the separation of execution and orchestration responsibilities.

Winsage

June 9, 2026

Hybrid AI Agents, Orchestration, and the Real Reason Microsoft is Fixing Windows 11 ⭐

Over the past weekend, the author reviewed session videos from Build 2026, focusing on Windows 11. The sessions were categorized into three areas: Windows app development, developer productivity, and agentic AI. The introduction of hybrid agents, which combine local AI sub-agents, was a notable development. Microsoft's partnership with Qualcomm led to the launch of Windows 10 on Arm-based PCs branded as Always Connected PCs, which evolved into Copilot+ PCs with Nuvia-powered chips for Windows 11. The Copilot+ PCs emphasize on-device AI experiences through powerful neural processing units (NPUs). The introduction of second-generation Snapdragon X2-based PCs is underway, although adoption is slower than expected. Microsoft confirmed that Windows 11 will integrate AI agents, including local AI agents and hybrid agents. The capabilities of local AI models are being enhanced, and Windows AI APIs will now support CPUs and GPUs. New Nvidia chipsets will enable large language models to run locally on PCs. The orchestration of local and cloud AI components is essential for efficient AI workload management. Microsoft is addressing user pain points to support a robust local foundation for hybrid AI, aiming to improve Windows 11 overall.

Tech Optimizer

April 15, 2026

Postgres to Iceberg in 13 minutes: How Supermetal compares to Flink, Kafka Connect, and Spark

Supermetal introduced Iceberg sink support, allowing for data transfer from Postgres to Iceberg. In a performance comparison, Supermetal completed snapshotting in 13 minutes, while Flink took 90 to 116 minutes, Kafka Connect required 120 minutes, and Spark exceeded 3 hours. The tests focused on throughput during the snapshotting phase rather than latency. The setup used the TPC-H dataset with a scale factor of 50 and involved AWS infrastructure. Supermetal operates independently of Kafka, enabling direct data delivery from source to sink. It utilizes a JSON configuration file for deployment, supporting various catalogs and advanced configuration options. Supermetal's Iceberg writer can adjust settings based on the CDC source phase. Throughout the tests, Supermetal maintained low CPU and memory usage, while other tools faced challenges with performance and resource management. Data synchronization was validated across all tools, with Supermetal achieving at least 7x faster snapshotting performance without tuning.

Winsage

March 30, 2026

Microsoft’s March Security Update of High-Risk Vulnerability Notice for Multiple Products

On March 11, NSFOCUS CERT reported the release of Microsoft’s March Security Update, addressing 83 security vulnerabilities in products like Windows, Microsoft Office, Microsoft SQL Server, and Azure. The update includes eight critical vulnerabilities and 75 important ones, with risks such as privilege escalation and remote code execution. Key vulnerabilities include: - CVE-2026-26110: Microsoft Office Remote Code Execution Vulnerability (CVSS score: 8.4) - CVE-2026-26113: Microsoft Office Remote Code Execution Vulnerability (CVSS score: 8.4) - CVE-2026-26144: Microsoft Excel Information Disclosure Vulnerability (CVSS score: 7.5) - CVE-2026-23669: Windows Print Spooler Remote Code Execution Vulnerability (CVSS score: 8.8) - CVE-2026-24294: Windows SMB Server Privilege Escalation Vulnerability (CVSS score: 7.8) - CVE-2026-23668: Windows Graphics Component Privilege Escalation Vulnerability (CVSS score: 7.0) Affected product versions include various editions of Microsoft Office, Windows Server 2012 R2, Windows Server 2016, Windows 10, and Windows 11. Microsoft has released security patches for these vulnerabilities, and users are encouraged to install them promptly.

Winsage

January 5, 2026

Microsoft Bets on Windows as AI Agent Hub to Revive Dominance

Microsoft Corp. is redefining its Windows operating system as a central hub for artificial intelligence agents, aiming to create an ecosystem where AI can autonomously manage tasks and integrate into user workflows. This strategy, announced in 2025, seeks to attract developers by providing tools like Agent 365 for proactive task management. However, challenges related to privacy, security, and user trust persist, as AI agents require extensive access to personal data. Microsoft is embedding AI agents at the OS level, allowing third-party developers to deploy agents that interact with Windows features. The company’s ecosystem includes Azure AI Foundry and Copilot Studio, which support agent development. Despite having 1.4 billion devices, Microsoft faces competition from Apple and Google, and must navigate privacy concerns and regulatory scrutiny. The success of this initiative depends on developer adoption and user acceptance, with potential risks of job displacement and over-reliance on automation.

Winsage

December 7, 2025

Windows 11 will soon show Microsoft Store app download recommendations in the “open with” menu

Microsoft has released a new preview build of Windows 11 that improves the "open with" menu by suggesting recommended applications from the Microsoft Store for files without a default application or unrecognized file extensions. Users can access relevant apps directly through the Open With dialog box and can view more options in the Microsoft Store. Additionally, Microsoft has introduced the Unified Update Orchestrator Platform to help app developers use Windows Update for easier app updates.

Winsage

November 13, 2025

Windows Moves To Agentic OS As Backlash Erupts

Microsoft's Windows chief, Pavan Davuluri, introduced the concept of an "agentic" operating system, which aims to integrate applications, cloud services, and devices for a more autonomous user experience. This vision has generated skepticism among users, who fear it may lead to intrusive AI interactions. The term "agentic" refers to systems capable of performing multi-step tasks on behalf of users, potentially enhancing integration with file systems, notifications, and cloud services. However, past experiences with intrusive advertisements and privacy concerns have led to a trust deficit among users. The introduction of such systems raises privacy and security issues, prompting regulatory scrutiny and calls for explicit permissions, human confirmation for significant actions, and robust local processing. Hardware manufacturers are investing in AI PCs to support these developments, while developers will have access to new APIs for application integration. Microsoft faces a messaging challenge in promoting this vision, needing to demonstrate clear benefits and prioritize user agency to alleviate concerns.

Winsage

May 30, 2025

Microsoft unveils “centralized” software update tool for Windows

Microsoft is developing a Windows-native update orchestration platform to improve the software updating experience for IT administrators and end-users. This platform aims to streamline the management of updates across various applications and components within the Windows ecosystem, reducing confusion caused by independent updates for different products. Currently in private preview, developers can access the platform through Windows Runtime (WinRT) APIs and PowerShell commands by registering as update providers. The orchestrator will intelligently defer updates based on user activity and system performance, and it will automatically reschedule failed attempts. Additionally, Microsoft is introducing Windows Backup for Organizations to assist with the transition from Windows 10 to Windows 11. This feature simplifies the backup and restoration of settings for Windows 10 and 11 devices. To use this functionality, devices must be Microsoft Entra hybrid joined or Microsoft Entra joined and running a supported version of Windows. The restore feature is compatible only with Microsoft Entra joined devices running Windows 11, version 22H2 and later. The Windows Backup for Organizations feature is currently in a limited public preview for select members of the Microsoft Management Customer Connection Program.