Skip to main content

Create and configure an ETL integration

Overview

This guide covers creating and configuring an ETL integration. For concepts, see ETL overview and How ingestion works.

Create the Integration

  1. Go to Integrations in the left sidebar, then click Add Integration (top right).
  2. Choose a source: Search for the source type (e.g. Postgres, Salesforce, HubSpot). Connect a new asset (authenticate, configure, name, tags/owners, test, connect) or select an existing source. Click Next.
  3. Choose a destination: Search for the destination type (e.g. Snowflake, BigQuery). Connect new or select existing. Click Next.
  4. Configure: Set options that depend on your source-destination pair (see below). Save to create the integration.

After creation you land on the integration details page. Use the Schema tab to enable or disable tables and set sync modes; use the Settings tab to change configuration later.

Configure Step (Step 3)

In the Configure step you set:

  • Trigger type: Manual (sync only when you click Sync now or trigger a sync via API), By interval (e.g. every 10 minutes, 30 minutes, 6 hours, 24 hours; optional base time), or Cron (cron expression).
  • Schema changes: For connectors that support schema change detection:
    • Enable all schema changes automatically — add new schemas, tables, and columns from the source.
    • Enable new columns and column changes only — ignore new schemas and tables; add new columns only.
    • Ignore all schema changes — do not add new schemas, tables, or columns.
  • Post-run actions (run when a sync ends successfully): choose one or more of Webhook which sends sync metadata to a predefined URL or dbt Cloud trigger which triggers a dbt Cloud job.
  • Notifications: Configure notifications for failures and warnings.
  • Destination schema/database: Where data lands in the destination. Connector-specific options (e.g. Custom warehouse, Custom database for Snowflake) appear when applicable.

Tip
Schedule ETL to run before downstream dbt jobs so transformations always see fresh data. Use post-run actions to trigger dbt Cloud after each successful sync.

After Creation

  • Status tab: View sync history, emitted/committed records, and per-table details.
  • Schema tab: Enable/disable tables; set sync mode (full refresh, incremental, append only). See Configure incremental sync and Manage schema changes.
  • Settings tab: Edit trigger, schema change behavior, post-run actions, notifications; Resync all historical data or Delete the integration.
  • Changelog tab: Audit log of changes to the integration.

For field-level reference, see Sync modes and Sync logs and run history.

ON THIS PAGE

Need Help?

Get help and support on all things Matia.

Contact Us