What's New & Latest Features | Matillion ETL for Snowflake

What’s New

  • 23-11-2017 [1.30] Improved Task Info Panel, Redesigned Scheduler, New Data Load Components and more
    • The Google BigQuery Query component now supports standard SQL.
    • New Intersect and Except transformation components
    • New S3 Load Generator can inspect S3 files and generate Create Table / S3 Load components.
    • Redesigned “Scheduler” user interface to simplify the management of scheduled orchestration jobs.
    • New “Task Info” panel and “Task” panel make it much easier to understand complex tasks both at run time and after job execution.
    • Matillion variables can be defined and scoped at job level making jobs much more reusable. Variables can now be passed to and returned from jobs.
    • New Quickbooks Online Query component to connect to the popular online accounting system.
    • New Square Query component to connect to the payment system.
    • New Google Custom Search component allows google search data to be ingested.
    • All data-staging components can append rows to an existing table as well as creating new tables.
  • 05-10-2017 [1.29] New Data Load Components, File Browser Enhancements, Advanced Connection Options and more
    • Matillion ETL for Snowflake Introduces the ability to configure Matillion ETL in a highly available topology with fully active-active cluster. This feature is only available on large and xlarge instance types.
      • Jobs run from SQS, the API or the built-in Scheduler will now fail-over in the event of an instance failure.
      • Scheduled runs missed because a server is offline will be run when it becomes available again
      • Once two or more members are in the cluster, a Cluster Info tab shows membership status and activity.
      • OAuth tokens, Database Drivers and RSD Profiles are replicated via the persistence database (postgres)
      • Logging from each node is sent to Cloudwatch
    • New Jira Query component loads data from Atlassian’s popular Software Development Platform.
    • New PayPal Query component can load payment and other data from Paypal Business accounts.
    • New ServiceNow Query component loads data from Servicenow’s IT Service Management (ITSM) platform.
    • New Stripe Query component loads data from Stripe’s payment platform
    • New Email Query component can query an IMAP based email system.
    • New YouTube Analytics component can query data from the YouTube Analytics API.
    • All query components now allow you to override the output table so you can specify an existing table to load or append to.
    • Excel Query can now load files from Google Cloud Storage, as well as Amazon S3
      • You only see S3 and/or GCS when you have credentials in the environment, otherwise they are hidden.
    • New option to drop a schema from the Environment Tree.
    • Specify a region in S3 Unload (to allow writing to buckets to other regions)
    • S3 / Google Cloud Storage file browser enhancements
    • Set advanced connection options during OAuth flow (e.g. to connect to a Salesforce Sandbox)
    • Warning: Manage Backups and View Audit haven’t been removed, they have been moved to the Admin menu
    • Map Values component
    • Additional support for ORC file types