Data Integration

Commonly referred to as ETL, data integration encompasses the following primary operations:

Extract

Exporting data from specified data sources.

Transform

Modifying the source data (as needed), using rules, merges, lookup tables or other conversion methods, to match the target.

Load

Importing the resulting transformed data into a target database.

More recent usage references the term ELT, emphasizing that the transformation part of the process does not necessarily need to be performed before loading, particularly in systems such as Snowflake that support transformation during or after loading.

In addition, the definition of data integration has expanded to include a wider range of operations, including:

  • Data preparation.

  • Data migration/movement and management.

  • Data warehouse automation.

Snowflake is known to inter-operate with the following data integration tools:

Solution

Version / Installation Requirements

Ab Initio

Ajilius

  • Ajilius: No requirements

  • Snowflake: No requirements

Alooma

Partner Connect

  • Alooma: No requirements

  • Snowflake: No requirements

Attunity Replicate

Datameer

  • Datameer: v7

  • Snowflake: No requirements

DataVirtuality

  • DataVirtuality: No requirements

  • Snowflake: No requirements

dbt

  • dbt: v0.13 (or higher)

  • Snowflake: No requirements

Denodo

  • Denodo: Denodo Platform 6.0 (or higher)

  • Snowflake: No requirements

Diyotta

  • Diyotta: No requirements

  • Snowflake: No requirements

Etlworks

  • Etlworks: No requirements

  • Snowflake: No requirements

Fivetran

Partner Connect

  • Fivetran: No requirements

  • Snowflake: No requirements

Heap

  • Heap: No requirements

  • Snowflake: No requirements

IBM InfoSphere DataStage

  • DataStage: InfoSphere Information Server 11.7.0

  • Snowflake: JDBC Driver — download from Maven

Informatica

  • Informatica Cloud (service):

    • Cloud Connector for Snowflake — available directly in the Informatica Cloud interface

    • Secure Agent — download and install from the Informatica Cloud interface

  • Informatica PowerCenter:

    • PowerCenter 10.2 (or higher)

    • PowerExchange for Snowflake

Apache Kafka

Keboola

  • Keboola: No requirements

  • Snowflake: No requirements

Matillion

Partner Connect

  • Matillion: No requirements

  • Snowflake: No requirements

Rivery

Partner Connect

  • Rivery: No requirements

  • Snowflake: No requirements

Segment

  • Segment: No requirements

  • Snowflake: No requirements

SnapLogic

Partner Connect

  • Snaplogic: 4.7.0 (or higher) with Snowflake Snap Pack

  • Snowflake: JDBC Driver — download from Maven

Snowplow

  • Snowplow: Snowflake Loader — download from GitHub

  • Snowflake: No requirements

Stitch

  • Stitch: No requirements

  • Snowflake: No requirements

StreamSets

  • StreamSets: No requirements

  • Snowflake: No requirements

Striim

  • Striim: No requirements

  • Snowflake: No requirements

Tableau

Talend

  • Talend 6.4 (or higher):

    • Talend: No requirements

    • Snowflake: No requirements

  • Talend 6.3 (or lower):

    • Talend: Snowflake component — contact Talend for more information

    • Snowflake: No requirements

TMMData

  • TMMData: No requirements

  • Snowflake: No requirements

Trifacta

  • Trifacta: No requirements

  • Snowflake: No requirements

Wherescape

  • Wherescape: No requirements

  • Snowflake: No requirements