Skip to main content

Google Cloud Storage Setup Guide

Prerequisites

  • Google Cloud Platform account with access to Google Cloud Storage
  • A Google Cloud Storage bucket
  • Admin access to manage bucket permissions

Setup Guide

Google Cloud Storage supports two authentication methods. Choose one:

Option 1: Service Account

  1. A service account has been automatically generated for your connector
  2. Navigate to Cloud Storage > Buckets in the Google Cloud Console
  3. Click on your target bucket → Permissions tab → Grant Access
  4. Add the service account email: ###@####.gserviceaccount.com
  5. Assign the Storage Admin role → Save

Option 2: HMAC Keys

  1. Navigate to Cloud Storage > Settings > Interoperability tab
  2. Click Create a key for a service account
  3. Select a service account → Create Key
  4. Copy the Access Key and Secret (save them securely)
  5. Grant the service account Storage Admin role on your bucket (same as steps 2-5 above)

Configure the Connector

Common fields for both methods:

  • Bucket Name: Your Google Cloud Storage bucket name
  • Folder Path (optional): e.g., my-folder/sub-folder
  • File Format: JSON, JSONL, or CSV

Additional fields for HMAC Keys:

  • Access Key ID: From the HMAC setup
  • Secret Access Key: From the HMAC setup

Supported File Formats

  • JSON: JavaScript Object Notation
  • JSONL: JSON Lines (newline-delimited JSON)
  • CSV: Comma-separated values

Permissions Required

For both authentication methods, the service account needs the following permissions on the Google Cloud Storage bucket:

  • storage.objects.create
  • storage.objects.delete
  • storage.objects.get
  • storage.objects.list

These are typically included in the Storage Admin role.