Press Release

Informatica unveils new product innovations and enterprise-grade AI blueprint for Databricks

Mon 10 Jun 2024

Enterprise cloud data management firm, Informatica, has announced an expanded partnership with Databricks with new product capabilities and offerings.

Informatica aims to unite the full range of its artificial intelligence (AI) powered Intelligent Data Management Cloud (IDMC) platform capabilities within the Databricks Data Intelligence Platform. The expanded partnership intends to enable users to deploy enterprise-grade Generative AI (GenAI) applications at scale, based on a foundation of high-quality, trusted data, and metadata.

“Together, we can deliver an AI-powered foundation for data management and data intelligence in the cloud to accelerate our joint customers into the era of GenAI with truly transformative applications,” said Amit Walia, Chief Executive Officer at Informatica.

Informatica’s GenAI blueprint for Databricks provides a road map for users to develop Retrieval Augmented Generation (RAG)-based GenAI applications using Databricks DBRX.

Databricks DBRX is an open, general-purpose large language model (LLM) designed to enable users to develop enterprise-grade GenAI applications. The blueprint allows users to build RAG-based GenAI solutions, leveraging Informatica’s IDMC no-code/low-code interface and metadata-driven intelligence and Databricks Vector Database for embedding data, enabling access to trusted and actionable data insights at scale.

The blueprint grounds generative AI application inferencing and summaries with enterprise data, providing high-fidelity, trusted responses. It enriches prompts with comprehensive enterprise data and metadata, ensuring that prompts and responses are contextualised based on unique industry and organisational semantics.

“In the era of GenAI, access to trusted, high-quality data is becoming more essential than ever, especially for RAG implementations,” said Adam Conway, SVP of Products at Databricks.

By integrating data quality metrics to prioritise data set selection for grounding, the blueprint ensures Generative AI applications are based on trusted data.

Details of the Blueprint

The blueprint also supports no-code orchestration and definition of RAG chain and agent-based Generative AI applications, to allow users to rapidly develop, maintain, and scale their AI applications without extensive coding knowledge.

Informatica and Databricks said comprehensive data governance enforces data access and use policies, delivering enterprise-compliant applications and providing transparency and trust in Generative AI applications.

Native Databricks SQL ELT

Native SQL ELT enables users to perform in-database transformations with full push-down capabilities on Databricks SQL, the intelligent data warehouse. By leveraging native Databricks functions like the AI-powered Assistant and serverless compute, users can develop ETL pipelines optimised for AI performance, scalable data transformations, and integrations.

Informatica’s CDI-Free offering is now available via Databricks Partner Connect, providing users with quick and easy access to Informatica’s cloud data ingestion and transformation capabilities at no cost. CDI-Free via Partner Connect allows users to process up to 20 million rows of data or 10 ELT compute hours per month for free.

Full IDMC Support via Unity Catalog

The Informatica IDMC platform is validated with Databricks Unity Catalog, a unified governance layer for data and AI within the Databricks platform. This integration includes all critical IDMC services and aims to enhance Informatica’s ability to manage data lineage and governance on the IDMC Platform.

Join Tech Show London

12-13 March 2025, ExCeL London

Be a part of the latest tech conversations and discover pioneering innovations.

You won’t want to miss one of the most exciting technology events of the year.

Send us a correction Send us a news tip