AI agents Archives

Tech Optimizer

June 21, 2025

New OLTP: Postgres With Separate Compute and Storage

Reynold Xin, co-founder of Databricks, highlighted the outdated nature of online transaction processing (OLTP) databases, which have not evolved significantly since the 1990s and face issues like over-provisioning and performance challenges. Databricks is introducing Lakebase, a product that separates compute from storage to enhance the efficiency of transactional databases, particularly for AI applications. Lakebase allows for instantaneous branching of databases, significantly improving workflow efficiency. Built on open-source Postgres, it supports various open storage formats and offers a copy-on-write capability to reduce costs. The separation of compute and storage is essential as streaming data becomes more integral to enterprises, enabling scalability and timely insights. Databricks aims to manage the entire data lifecycle, ensuring data remains within its ecosystem for rapid reporting and analytics. The integration of Lakebase with existing infrastructure enhances developer experience and operational maturity. The architecture supports extensive experimentation at minimal cost, fostering innovation. As AI agents become more prevalent, the focus on data evaluation and reliability will grow, necessitating a deeper examination of model accuracy.

Tech Optimizer

June 17, 2025

Databricks Unveils Lakebase Database for AI Applications

Databricks acquired the serverless Postgres startup Neon for approximately billion and integrated this technology into its offerings, launching Databricks Lakebase, a new operational database designed for intelligent applications. Lakebase is a fully-managed Postgres database aimed at addressing the integration of operational and analytical data for AI workloads. It operates on PostgreSQL and allows developers to manage data applications without server infrastructure concerns. Databricks also introduced additional products, including Lakeflow Designer, a no-code ETL tool, Databricks One for easy access to data and AI capabilities, and Agent Bricks for automating the creation of customized AI agents.

Tech Optimizer

June 16, 2025

Databricks rolls out Lakebase Postgres and Agent Bricks for AI-era apps

Databricks has introduced the Lakebase Postgres database layer to enhance its lakehouse architecture, facilitating AI applications and analytics on operational data. The company also launched Agent Bricks to simplify the development of automated AI agents. During the Data + AI Summit, CEO Ali Ghodsi emphasized the importance of transitioning from outdated systems to modern solutions for AI. Lakebase, powered by Neon technology, is a fully managed, Postgres-compatible database that supports data loading from over 300 sources. Databricks aims to unify operational and analytical systems for real-time decision-making. The summit outlined a three-chapter framework: establishing the lakehouse, integrating AI, and introducing Lakebase. Agent Bricks enables business users to create AI agents without extensive technical knowledge, while Managed Iceberg Tables support external engines and promise performance optimizations. Databricks announced partnerships with Microsoft and Google Cloud for deeper integration and AI model usage. The company is investing 0 million in AI education and plans to release Lakeflow Designer for no-code ETL capabilities. Databricks anticipates reaching .7 billion in annualized revenue by July, with a growth rate of 50 percent and plans to hire 3,000 employees in 2025. Lakebase is currently in Public Preview.

Tech Optimizer

June 14, 2025

Striim Announces Neon Serverless Postgres Support with Databricks

The integration of real-time data for AI applications is crucial, but traditional ETL processes can introduce latency and complexity. Open-source Postgres is a popular choice for developers, and Neon has developed an AI-driven approach to database creation. Databricks has launched Lakebase, a managed Postgres database, after acquiring Neon. Striim has expanded its Postgres offerings to facilitate high-throughput ingestion from Neon into Databricks for real-time analytics and enables rapid data delivery from legacy systems into Neon. This allows for seamless data flow for AI applications, including support for real-time ingestion, Change Data Capture (CDC), and event streaming from Apache Kafka. Striim's platform supports operational data replication from various traditional systems and upholds data governance with AI-driven PII detection. This expansion enhances partnerships with Databricks and supports real-time SQL Server data access.

Tech Optimizer

June 12, 2025

Striim Announces Neon Serverless Postgres Support to Broaden Agentic AI Use Cases with Databricks

The demand for real-time data in artificial intelligence is increasing, but integrating data from legacy systems poses challenges due to traditional ETL pipelines that can introduce latency. Open-source Postgres is favored for operational needs, and Neon offers a new approach to database creation using AI agents. Databricks has launched Lakebase, a managed Postgres database for AI applications, after acquiring Neon. Striim has expanded its Postgres offerings to enable high-throughput data ingestion from Neon into Databricks for real-time analytics and supports rapid data delivery from legacy systems into Neon. Striim's platform allows real-time replication of operational data from various traditional systems to Neon, real-time ingestion into Databricks, and enhances generative AI applications with inline data enrichment. Alok Pareek from Striim highlighted the importance of this expansion for Postgres-native teams to build real-time AI architectures. Striim also supports Databricks Delta Lake and SQL2Fabric-X for real-time SQL Server data access. Striim's platform processes over 100 billion daily events with sub-second latency, aiding proactive decision-making.

Tech Optimizer

June 12, 2025

‘Postgres Has Won’

Databricks has launched Lakebase, a fully managed Postgres database, during the Data + AI Summit 2025. Lakebase is currently in public preview and integrates with Databricks' Data Intelligence Platform, targeting AI-driven application development. It introduces an operational layer to the lakehouse ecosystem, allowing developers to build AI applications on a multi-cloud platform. The database architecture, powered by Neon, separates compute from storage for independent scaling, ensuring low latency and high concurrency. Lakebase supports rapid deployment and a usage-based pricing model, and features include copy-on-write clones for development and testing. Databricks aims to create a new category in the database market with Lakebase, which is built on open-source Postgres and compatible with existing tools. The operational database market is valued at over 0 billion, and recent surveys indicate PostgreSQL's rising popularity among developers. The launch follows Snowflake's acquisition of Crunchy Data to enhance its Postgres offerings, indicating a trend towards PostgreSQL in the industry.

Tech Optimizer

June 12, 2025

Databricks launches Lakebase Postgres database for AI era

Databricks has launched Lakebase, a fully managed Postgres database designed for AI applications, currently in Public Preview. It integrates an operational database layer into Databricks' Data Intelligence Platform, facilitating the development of data applications and AI agents in a multi-cloud environment. Lakebase uses Neon technology within a lakehouse architecture, allowing for efficient real-time data processing and scalable operations. Key features include independent scaling of compute and storage, low latency under 10 milliseconds, high concurrency over 10,000 queries per second, rapid launch times under a second, and a consumption-based payment model. It also offers data synchronization with lakehouse tables, an online feature store for machine learning, and is managed entirely by Databricks with built-in security features. During its Private Preview, Lakebase attracted participation from hundreds of enterprises across various sectors. It is supported by a partner network including Accenture, Deloitte, and others, and will receive further enhancements in the coming months.

Tech Optimizer

June 11, 2025

Lakebase Is Databricks’ Fully-Managed Postgres Database for the AI Era

Databricks has launched Lakebase, a fully-managed serverless Postgres database, following its acquisition of Neon. Lakebase combines the extensibility of Postgres with a modern serverless architecture, facilitating a unified data experience for developing data-driven applications while reducing operational complexities. Its core feature is the separation of storage and compute, allowing it to use cost-effective object storage for scalability and high availability, with low-latency access and high-concurrency transactions. Lakebase is built on open standards, making it a versatile relational database that integrates with the Databricks Platform for enhanced observability, security, and governance. Prior to the acquisition, 80% of databases on Neon were created by AI agents, and Lakebase's features are designed to support AI agents in problem-solving. Lakebase is currently in public preview.

Tech Optimizer

June 11, 2025

Databricks Launches Lakebase: a New Class of Operational Database for AI Apps and Agents

Databricks has launched Lakebase, a fully-managed Postgres database that integrates operational and analytical systems for AI-driven applications. Lakebase is part of the Databricks Data Intelligence Platform and is currently in Public Preview. It utilizes Neon technology for continuous autoscaling, enabling low latency and high concurrency. Key features include separated compute and storage, an open-source foundation, AI optimization, lakehouse integration, and enterprise readiness. Early adopters are using Lakebase to enhance various business processes, and it is supported by a partner network for data integration and governance.

Tech Optimizer

June 10, 2025

Snowflake and Databricks bank PostgreSQL acquisitions

Databricks acquired Neon for billion, which specializes in serverless PostgreSQL services and claims that 80% of its databases are generated by AI. This acquisition aims to integrate Neon's architecture into the Databricks Data Intelligence Platform. Snowflake acquired Crunchy Data for [openai_gpt model="gpt-4o-mini" prompt="Summarize the content and extract only the fact described in the text bellow. The summary shall NOT include a title, introduction and conclusion. Text: In recent weeks, the landscape of database technology has witnessed significant shifts as both Snowflake and Databricks have strategically utilized their acquisition funds to enhance their offerings in the PostgreSQL domain. Databricks Acquires Neon In May, Databricks, known for its data lake solutions built around Apache Spark, made headlines by acquiring Neon for a reported billion in equity. Neon specializes in serverless PostgreSQL services and has made a remarkable claim that 80 percent of the databases it provisions are generated automatically by AI agents rather than human intervention. This acquisition is poised to integrate Neon's innovative architecture into the Databricks Data Intelligence Platform, enabling developers and enterprise teams to efficiently construct and deploy AI-driven systems. Snowflake's Purchase of Crunchy Data Following this, at the beginning of the month, Snowflake, a prominent player in the cloud data warehouse sector, announced its acquisition of Crunchy Data for 0 million. Crunchy Data is recognized for providing PostgreSQL clusters that support both transactional and analytical systems across various environments, including managed cloud services, Kubernetes deployments, and on-premises solutions. Snowflake plans to leverage this acquisition to develop "Snowflake Postgres," allowing users to run any Postgres-dependent application directly on its data and analytics platform. Strategic Insights from Industry Leaders Databricks CEO and co-founder Ali Ghodsi articulated the vision behind the Neon acquisition, emphasizing the intent to attract not only startups but also enterprise customers. He noted that approximately 70 percent of their clientele operates legacy databases that are costly and stagnant. Ghodsi highlighted the eagerness of enterprises to transition to modern solutions that align with the demands of the AI era, revealing that extensive discussions over the past six months confirmed strong interest in the acquisition. Henry Cook, a senior director analyst at Gartner, remarked on the implications of these acquisitions for both Snowflake and Databricks. He pointed out that their historical focus on analytical systems positions them well to penetrate the operational and transactional market over time. Cook noted a growing trend towards the integration of transactional and analytical systems, where transactional data feeds into analytical frameworks, allowing for real-time insights and feedback. This evolution could enable users to create applications that blend both analytical and transactional functionalities. Impact on the PostgreSQL Community For the PostgreSQL community, these developments signify a promising expansion of choices and support for the open-source database. Robin Schumacher, a senior research director and analyst at Gartner, highlighted the challenges faced by data warehouse and analytic vendors attempting to enter the operational database management system (DBMS) market. While companies like Teradata and Vertica have struggled, Snowflake's introduction of Unistore has seen limited traction. Schumacher believes that the trust associated with PostgreSQL could provide both Snowflake and Databricks a unique opportunity to succeed where others have faltered." max_tokens="3500" temperature="0.3" top_p="1.0" best_of="1" presence_penalty="0.1" frequency_penalty="frequency_penalty"] million, known for providing PostgreSQL clusters for various environments, to develop "Snowflake Postgres" for running Postgres-dependent applications on its platform. Databricks CEO Ali Ghodsi noted the intent to attract enterprise customers transitioning from legacy databases. Gartner's Henry Cook mentioned the potential for integrating transactional and analytical systems, while Robin Schumacher highlighted the opportunities for Snowflake and Databricks in the PostgreSQL community amidst challenges faced by other vendors.