Kafka Setup Guide
Prerequisites
Before starting, make sure you have the following information:
- Bootstrap Server (e.g. broker1:9092) and API credentials
- Topic(s) you want to replicate
Note: If you are using authentication via PLAINTEXT or have a self-managed Kafka service, skip to Step 2.
Setup Guide
Step 1 (Optional): Obtain API Key and Secret from Confluent Cloud
- Sign in to your Confluent Cloud.
- Navigate to the main menu by clicking on its icon on the top right and go to API Keys -> Add API Key.
- Select My Account and click Next.
- Select your Kafka cluster.
- Copy the generated API Key & API Secret - you will need it to configure your connection.
Step 2: Configure Kafka Details in Matia
- Enter your Bootstrap Server in the form of
<hostname>:<port>. - (For using SASL) Choose your SASL Mechanism.
- (For using SASL) Enter the generated API Key and API Secret.
- Select your message type: JSON or Avro.
- If you choose JSON, select a sync type: Packed or Unpacked.
- If you choose Avro, enter the following schema registry credentials: Schema Registry URL, Schema Registry Key, Schema Registry Secret.
- Enter your preferred Consumer Group name unique to this integration.
Step 3: Complete Asset Configuration
- Enter an Asset Name.
- (Optional) Enter a Description.
- (Optional) Assign Tags.
- Select an Owner.
- Verify that your Kafka is successfully connected by clicking on Test Connection.
- Click Connect.