Skip to main content

Empower your Data Governance Policy with Matillion ETL and OvalEdge

 

At Matillion, we love to highlight the ways in which our products integrate with other technologies in the modern enterprise data stack. This week, read how Matillion ETL and OvalEdge data catalog and governance solution help strengthen data governance across your organization. This article, written by John Bagnall, Matillion ETL Product Manager, originally appeared in the OvalEdge blog on May 27, 2022.

Data governance is a hot topic right now. For companies today, ensuring proper data asset management and curating a culture of accountability over user data is a high priority, and rightly so. 

 

Many organizations believe they have some form of data governance in place already. But on closer inspection, it becomes clear that there are missing components. Ultimately, these critical  components play a pivotal role in ensuring a robust policy. 

 

Without strong data governance , the quality of your data decreases across the board. 

 

Modern businesses have numerous tools in their data stack and it’s the connection between these platforms where cracks start to appear. This is why strong communication between integral tools is key to empowering your data governance strategy and enabling your organization to have access to the trustworthy data it needs. 

The relationship between ETL/ELT platforms and data governance

 

Matillion provides world-leading capabilities that enable you to transform your data and make it ready for analytics, AI/ML, and other use cases. The Matillion platform is easy to use, with a low-code/no-code solution to get your data into a state that  enables your organization to speed up decision making. 

 

However, because these procedures take place during the data ingestion phase, it is possible that your data engineers are not the right people design and to enforce data governance policy.

 

Data governance is just as important downstream as it is upstream. That’s where an  organization-wide governance culture comes into play.

 

Fostering a culture of governance

 

Data governance is a cross-functional effort and it requires collaboration across departments in order to be effective. At Matillion, we believe that it begins with a shared understanding that data governance is a strategic, enterprise-wide asset. Containing this asset within a framework that everyone follows  creates  accountability that’s essential to  a robust data governance policy.

 

With that in mind, here are some critical steps to establishing a solid data governance culture:

 

Clearly articulate the real value of data governance

 

Each organization is different, but many face a common challenge: Buy-in from the C-suite.  Why? Because ultimately it’s difficult to quantify the true value of governing your data assets beyond compliance requirements.

 

Yet data governance provides so much more value beyond regulatory compliance. For example, data governance can remove organizational bottlenecks that  prevent departments from accessing the data they need.

 

Just look at the time it takes from the moment a ticket is raised with a data/IT department, to generating a report, to it being delivered to the individual who requested it. These timelines often aren’t fast enough to start with; add to that the further impact of an incorrect report being submitted or even worse, incorrect data being used to make decisions, and delays and resulting negative impact compounds even more. These  scenarios are common in many organizations, so removing these problems with a structured policy is an easy sell.

 

Define a clear and actionable framework

 

If you get the C-suite on board, what’s next? It’s important to define a framework which provides structure and formalizes data management. This framework also ensures the right individuals are in place to facilitate your data governance strategy. For existing teams, this will take some change management.

 

Create your champions

 

Once your framework is defined, you’ll need to establish data champions that help build governance into your goals and outcomes and promote the notion of accountability. For new starters, build data-driven goals and culture into the onboarding process to  guarantee that data-driven culture is fostered at the grassroots level.

 

Putting the framework into action

 

As the user journey matures through the change and accountability for data assets is established within an organization, the benefits of data governance will soon become glaringly obvious.

 

  • Data is accessible to those who need it.
  • Data is high quality and trustworthy.
  • Data assets are secure and compliant.
  • Data classification helps the  organization of data assets
  • A business glossary for standardizing terms improves cross-department communication.

 

Obviously, initiating a framework isn’t something that happens overnight but data governance tools will empower this process.  OvalEdge’s program framework is a powerful guide for ensuring a structure is in place to make your governance journey a success.

 

Automate and accelerate your data governance with Matillion and OvalEdge 

 

Your data department is a crucial part of your data governance policy. Matillion is here to make sure that while we are a world-leading ETL solution, we are also hugely aware of the importance of our role in your governance framework. That’s why our partnership with OvalEdge is designed to ensure that making that connection between our two solutions is quick and simple.

 

Powered by Matillion’s  Metadata API, Matillion and OvalEdge can share source and target information from Orchestration and Transformation Jobs to be catalogued and available to view in OvalEdge’s intuitive interface. Once jobs have been run, OvalEdge will crawl the updated metadata and display end to end data lineage. 

 

You can  easily instigate this process in the OvalEdge UI, via the Matillion connector. First, securely provide OvalEdge with your Matillion login credentials then select the project you wish to crawl – a simple integration that takes about  30 seconds. Once the integration is complete, you can take advantage of the powerful features that OvalEdge provides.

 

Most importantly, this integration creates an automated step in your workflow, all the way from ingestion. The data catalog and technical lineage is updated automatically as new datasets are derived and transformed in Matillion. The process becomes part of your framework, and because it is automated,  it ensures that data engineers working in Matillion are part of  your organization’s data governance policy. 

This inclusion helps to promote accountability, from data being transformed to data being consumed all the way up the chain. Matillion enables  your framework and OvalEdge enforces it;  governance is present from the start and data quality is improved end-to-end. 

 

Ultimately, data is no longer siloed and untrustworthy. Instead, it  becomes  your most valuable asset because you can trust it to empower your decisions.

Learn more about OvalEdge

To learn more about the OvalEdge data catalog, visit www.ovaledge.com

See Matillion ETL for yourself

To see how Matillion ETL can enhance your data governance strategy with the Metadata API, get a demo.

Get a demo