Data Productivity Cloud Now Offering Stronger Integrations For Databricks Users

In February 2024, Matillion announced the launch of its support for Databricks on the Data Productivity Cloud. This strategic integration marked a significant step in empowering data teams built around Databricks to be more productive and efficient in their data engineering efforts.

Since the initial launch, Matillion has added even more functionality to the Data Productivity Cloud, specifically to strengthen the platform’s integration with Databricks. Let’s take a look at what’s available today.

Built for Databricks

One of the standout features is Delta By Default, which allows users to create, ingest into, and read from Databricks Delta Tables directly within Matillion pipelines. This seamless integration simplifies the process of working with ACID-compliant data workflows, ensuring data integrity and reliability.

Moreover, the Data Productivity Cloud is built to leverage the centralized access control, auditing, lineage, and data discovery capabilities of Unity Catalog across Databricks workspaces. This enables data teams to maintain a holistic view of their data landscape and ensure effective data governance.

Another key feature is the flexibility to extract and load data either directly into Databricks Delta or into an AWS S3 bucket or Azure Blob storage. This versatility allows data teams to choose the most appropriate storage solution based on their specific use cases and requirements.

Finally, Matillion's support for the Databricks Medallion architecture further enhances the data engineering experience. Data teams can now take their data from raw to cleansed and then aggregated for analysis, all within the Data Productivity Cloud.

Augmenting the Core of Data Productivity Cloud

These Databricks-specific features are an exciting part of the Data Productivity Cloud, and they are part of a broader range of capabilities that are exciting data teams using Matillion to increase their productivity.

• Pushdown ELT architecture allows data teams to leverage the full power and speed of the cloud
• Powerful data movement, a wide range of pre-built connectors, and the option to build custom connectors simplify data movement.
• Intuitive pipeline Designer with no-code and AI-assisted tools that accelerate the pipeline-building process, enabling data teams to be more productive. 
• Cutting-edge AI capabilities, such as the Prompt Component, automatically generated documentation, and Retrieval Augmented Generation (RAG) support, help data teams unlock new levels of efficiency and insights.

Databricks support in the Data Productivity Cloud will be an ongoing investment for Matillion as we continue to empower data teams to maximize their investment in Databricks and drive greater productivity and efficiency in their data engineering efforts. 

Want to learn more about how the Data Productivity Cloud can benefit your organization? Request a demo today!