BigQuery Setup Guide

Prerequisites

1. Follow Google's Create a service account key instructions to set up service account key authentication.

2. Grant the service account

2.1 Either an Admin account

ROLE	REASON
BigQuery Admin	To create queries, view the data, use Time travel and Storage Read API, create temporary tables

Or

2.2 The following permissions on the dataset:

ROLE	REASON
BigQuery Job User	To create queries
BigQuery Data Viewer	To view the data
BigQuery Data Editor	To use Time Travel for incremental syncs and to automatically clean up temp tables created during the sync

2.3 If you prefer not to provide BigQuery Data Editor, you will need to set a custom role.

ROLE	REASON
BigQuery Job User	To create queries
BigQuery Data Viewer	To view the data
Custom IAM role with the following permissions: bigquery.datasets.get, bigquery.tables.create, bigquery.tables.get, bigquery.tables.getData, bigquery.tables.list, bigquery.tables.update, bigquery.tables.updateData, bigquery.tables.delete	To use Time Travel for incremental syncs and to automatically clean up temp tables created during the sync

Setup Guide

1. Enter the Private Key from the service account that you created above.
2. Enter the Client Email from the service account that you created above.
3. Enter the Project Id your BigQuery project id.
4. Enter the Dataset Name your dataset name that contains the data you wants to move.
5. Enter a Location that your dataset located.

   Note: You cannot change the dataset location once the connector is created.

6. Enter a Name for the connector.
7. (Optional) Enter a Description for the connector.
8. Select the Owner of the connector.
9. (Optional) Verify that your BigQuery account is successfully connected by clicking on Test Connection.
10. Click Connect.

Supported Streams

All tables in the specified dataset are supported (Full Refresh)