Google Cloud Storage Setup Guide
Prerequisites
- Google Cloud Platform account with access to Google Cloud Storage
- A Google Cloud Storage bucket
- Admin access to manage bucket permissions
Setup Guide
Google Cloud Storage supports two authentication methods. Choose one:
Option 1: Service Account
- A service account has been automatically generated for your connector
- Navigate to Cloud Storage > Buckets in the Google Cloud Console
- Click on your target bucket → Permissions tab → Grant Access
- Add the service account email:
###@####.gserviceaccount.com - Assign the Storage Admin role → Save
Option 2: HMAC Keys
- Navigate to Cloud Storage > Settings > Interoperability tab
- Click Create a key for a service account
- Select a service account → Create Key
- Copy the Access Key and Secret (save them securely)
- Grant the service account Storage Admin role on your bucket (same as steps 2-5 above)
Configure the Connector
Common fields for both methods:
- Bucket Name: Your Google Cloud Storage bucket name
- Folder Path (optional): e.g.,
my-folder/sub-folder - File Format: JSON, JSONL, or CSV
Additional fields for HMAC Keys:
- Access Key ID: From the HMAC setup
- Secret Access Key: From the HMAC setup
Supported File Formats
- JSON: JavaScript Object Notation
- JSONL: JSON Lines (newline-delimited JSON)
- CSV: Comma-separated values
Permissions Required
For both authentication methods, the service account needs the following permissions on the Google Cloud Storage bucket:
storage.objects.createstorage.objects.deletestorage.objects.getstorage.objects.list
These are typically included in the Storage Admin role.