Videos

Using the Multi Table Input component in Matillion ETL for Amazon Redshift

In our latest Matillion ETL for Amazon Redshift tutorial video, we take a look at the Multi Table input component, which allows users to load data from multiple source tables, with differing table names.

To find out more about the Multi Table input component in Matillion ETL for Amazon Redshift, watch this short tutorial video below.

You can also find out more about the Multi Table Input component by visiting our Redshift Support Center.

The challenge

We find it common with customers that when loading a target table, the data may need to come from multiple source tables where the schema is very similar, if not identical, but the table names are slightly different. For example, there may be some transaction data with a common table name, but with a date or timestamp on it.

E.g.
demo_flights_2010,
demo_flights_2011,
demo_flights_2012 etc.

Transforming data from these multiple table inputs would normally require a number of different steps, as explained in the video.

Multi Table Input component

The Multi Table Input component in Matillion ETL for Amazon Redshift aims to make this process easier by doing a lot of the hard work behind the scenes for you.

By choosing a pattern, you can use the Multi Table Input component to recognise the tables for you. The component looks at the Redshift system catalogue to reference this pattern against all of the tables in the schema you are connected to and bring them together to union.

For example you could use the pattern demo_flights_20% to pick up all tables in the sequence above.

 

multi-table-input-component-matillion-etl-redshift-pattern

 

There are a number of other features and configurations associated with this component, which are explained in the video tutorial.

As well as saving time, and reducing error, the Multi Table Input component automatically picks up new tables that match the designated pattern each time the job is run.

Find out more about Matillion ETL for Amazon Redshift

The Multi Table Input component is just one of many fantastic features in Matillion ETL for Amazon Redshift.

If you like what you see and would like to find our more please visit the product page for more information.

If you’d like to get hands-on and try the tool out for yourself, there is currently a 14 day free trial, available on the AWS Marketplace.

If you liked this video, you can find a whole library of informative video tutorials on the Matillion Youtube channel.

 

To find out more about the benefits of Amazon Redshift, and how to get the most out of it, download our free eBook below

redshift-best-practice-ebook