Prerequisites
- A connected data warehouse on Matia.
- A path to a bucket directory that contains two files:
catalog.jsonandmanifest.json. To generate them, run the following on your dbt Core instance:dbt docs generate
Step 1: Select Artifacts storage
- Select from the dropdown the artifacts storage.
Connection Details for Google cloud storage
- Authorize access
- Open the Google Cloud Storage Console.
- In the bucket list, find the bucket containing your dbt artifacts and click on its name.
- Select the Permissions tab near the top of the page.
- Click the + Grant Access button.
- In the New principals field, type the email that was provided by Matia.
- In the Select a role dropdown, search for and select Storage Object Viewer.
- Enter the relevant bucket URI in Matia.
Connection Details for AWS S3
- Account Identifier
- Click on Create ARN Role to start the creation of the required role.
The files will be generated in the
target/folder of your dbt Core project. - Apply the following S3 bucket policy on your provided bucket:
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowListPrefix",
"Effect": "Allow",
"Principal": {
"AWS": "<PROVIDED_ROLE_ARN>"
},
"Action": "s3:ListBucket",
"Resource": "arn:aws:s3:::<BUCKET_NAME>",
"Condition": {
"StringLike": {
"s3:prefix": [
"<PREFIX>",
"<PREFIX>/*"
]
}
}
},
{
"Sid": "AllowReadObjectsInPrefix",
"Effect": "Allow",
"Principal": {
"AWS": "<PROVIDED_ROLE_ARN>"
},
"Action": "s3:GetObject",
"Resource": "arn:aws:s3:::<BUCKET_NAME>/<PREFIX>/*"
}
]
}
- Replace
<BUCKET_NAME>with the bucket name. - Replace
<PROVIDED_ROLE_ARN>with the Role ARN we provide. - Replace
<PREFIX>with prefix to your objects. - Confirm that the provided Role ARN can access the bucket and read the
catalog.jsonandmanifest.jsonfiles.
Step 2: Final Configuration in Matia
- Select the data warehouse which is defined as part of your dbt project.
- Enter a Name for the Asset.
- (Optional) Enter a Description for the Asset.
- Select the Owner of the Asset.
- (Optional) Verify that your dbt Core account is successfully connected by clicking on Test Connection.
- Click Connect.