Skip to main content

Kafka Setup Guide

Prerequisites

Before starting, make sure you have the following information:

  • Bootstrap Server (e.g. broker1:9092) and API credentials
  • Topic(s) you want to replicate

Note: If you are using authentication via PLAINTEXT or have a self-managed Kafka service, skip to Step 2.

Setup Guide

Step 1 (Optional): Obtain API Key and Secret from Confluent Cloud

  1. Sign in to your Confluent Cloud.
  2. Navigate to the main menu by clicking on its icon on the top right and go to API Keys -> Add API Key.
  3. Select My Account and click Next.
  4. Select your Kafka cluster.
  5. Copy the generated API Key & API Secret - you will need it to configure your connection.

Step 2: Configure Kafka Details in Matia

  1. Enter your Bootstrap Server in the form of <hostname>:<port>.
  2. (For using SASL) Choose your SASL Mechanism.
  3. (For using SASL) Enter the generated API Key and API Secret.
  4. Select your message type: JSON or Avro.
    • If you choose JSON, select a sync type: Packed or Unpacked.
    • If you choose Avro, enter the following schema registry credentials: Schema Registry URL, Schema Registry Key, Schema Registry Secret.
  5. Enter your preferred Consumer Group name unique to this integration.

Step 3: Complete Asset Configuration

  1. Enter an Asset Name.
  2. (Optional) Enter a Description.
  3. (Optional) Assign Tags.
  4. Select an Owner.
  5. Verify that your Kafka is successfully connected by clicking on Test Connection.
  6. Click Connect.