Skip to main content

Prerequisites

  • A connected data warehouse on Matia.
  • A path to a bucket directory that contains two files: catalog.json and manifest.json. To generate them, run the following on your dbt Core instance: dbt docs generate

Step 1: Select Artifacts storage

  • Select from the dropdown the artifacts storage.

Connection Details for Google cloud storage

  1. Authorize access
    • Open the Google Cloud Storage Console.
    • In the bucket list, find the bucket containing your dbt artifacts and click on its name.
    • Select the Permissions tab near the top of the page.
    • Click the + Grant Access button.
    • In the New principals field, type the email that was provided by Matia.
    • In the Select a role dropdown, search for and select Storage Object Viewer.
  2. Enter the relevant bucket URI in Matia.

Connection Details for AWS S3

  1. Account Identifier
  • Click on Create ARN Role to start the creation of the required role. The files will be generated in the target/ folder of your dbt Core project.
  • Apply the following S3 bucket policy on your provided bucket:
	"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowListPrefix",
"Effect": "Allow",
"Principal": {
"AWS": "<PROVIDED_ROLE_ARN>"
},
"Action": "s3:ListBucket",
"Resource": "arn:aws:s3:::<BUCKET_NAME>",
"Condition": {
"StringLike": {
"s3:prefix": [
"<PREFIX>",
"<PREFIX>/*"
]
}
}
},
{
"Sid": "AllowReadObjectsInPrefix",
"Effect": "Allow",
"Principal": {
"AWS": "<PROVIDED_ROLE_ARN>"
},
"Action": "s3:GetObject",
"Resource": "arn:aws:s3:::<BUCKET_NAME>/<PREFIX>/*"
}
]
}
  1. Replace <BUCKET_NAME> with the bucket name.
  2. Replace <PROVIDED_ROLE_ARN> with the Role ARN we provide.
  3. Replace <PREFIX> with prefix to your objects.
  4. Confirm that the provided Role ARN can access the bucket and read the catalog.json and manifest.json files.

Step 2: Final Configuration in Matia

  1. Select the data warehouse which is defined as part of your dbt project.
  2. Enter a Name for the Asset.
  3. (Optional) Enter a Description for the Asset.
  4. Select the Owner of the Asset.
  5. (Optional) Verify that your dbt Core account is successfully connected by clicking on Test Connection.
  6. Click Connect.