Skip to main content

Google Cloud Storage Source Setup Guide

Prerequisites

  • Google Cloud Platform account with access to Google Cloud Storage
  • A Google Cloud Storage bucket
  • Admin access to manage bucket permissions

Setup Guide

  1. A service account has been automatically generated for your connector
  2. Navigate to Cloud Storage > Buckets in the Google Cloud Console
  3. Click on your target bucket → Permissions tab → Grant Access
  4. Add the service account email: ###@####.gserviceaccount.com
  5. Assign the Storage Admin role → Save

Configure the Connector

Common fields for both methods:

  • Bucket Name: Your Google Cloud Storage bucket name
  • Folder Path (optional): e.g., my-folder/sub-folder
  • File Format: JSON, JSONL, or CSV

Supported File Formats

  • JSON: JavaScript Object Notation
  • JSONL / NDJSON: JSON Lines (newline-delimited JSON)
  • CSV: Comma-separated values

Permissions Required

For both authentication methods, the service account needs the following permissions on the Google Cloud Storage bucket:

  • storage.objects.create
  • storage.objects.delete
  • storage.objects.get
  • storage.objects.list

These are typically included in the Storage Admin role.