Skip to main content

Matillion at Databricks Data + AI Summit

Published Date
Author Rob Callaghan

We had an amazing week at the Data + AI Summit in San Francisco last week. The Databricks team put on a fantastic conference with thousands of partners, customers, and tech evangelists to learn from and network with.

The partnership between our companies helps drive time to value and collaboration in enterprises — our platforms bring data science and analytics together on an open, integrated platform that allow organizations to streamline their data projects at scale. We were excited to attend our first ever Data + AI Summit to help showcase our native integrations for Delta Lake with the data science and engineering community in person!

 

Partner Party at the Press Club

We were excited to host a gathering with our friends at Sigma Computing and Koantek on the first day of the event. It was great to see so many familiar faces off of Zoom and in person at a notable wine bar in San Francisco. 

 

Diving into data integration on the lakehouse

It was great to meet customers in person and share ways to help them increase their time to value with data loading, transforming, and orchestrating in just a few clicks. We were excited to chat with customers face to face and demo our solution, helping them to understand the capabilities inside our platform that could help them drive value. 

In addition to our announcement about the availability of Matillion ETL for Partner Connect and Matillion Data Loader in public preview, we had Matillioners on stage highlighting cloud data integration for the data lakehouse architecture.

Paul Johnson, Director of Product Management, and Paul Lacey, Senior Director of Product Marketing, talked about change data capture (CDC) for Delta Lake. This approach extracts data changes in a source database and ingests those changes into cloud storage in near real-time, delivering insights without having to spend days learning new processes.  

Sarah Smith, Senior Product Manager, shared how Matillion ETL for Delta Lake on Databricks can increase the capacity of data teams using Matillion’s orchestrations to democratize data and allow teams to leverage multi-cloud environments within Matillion. She highlighted how to use components to push Spark SQL down to Delta Lake and use the power that Delta Lake provides to enable teams to work faster with data. 

 

Inspiring the next generation of data professionals

Diversity in tech is a subject near and dear to our hearts. Members of our team were thrilled to attend the Wednesday afternoon keynote with Dr Tarika Barrett, CEO of Girls Who Code. She delivered a thought-provoking talk on the lack of representation of women and minorities in the data ecosystem and explained the importance of getting girls into coding and data/development roles to increase diversity of thought and perspective. 

 

Looking forward to 2023!

A huge thank you to all the new and familiar friends we made at the Data + AI Summit this year. We had a great time with the Databricks team and can’t wait to do it all again next year!