1.6.7 • Published 2 years ago
@astradot/kafka-schema-sync v1.6.7
kafka-schema-sync
This tool was designed at Astradot to keep our Kafka topics in sync across staging and prod environments.
Read blog post for details.
You describe your Kakfa topics and their configuration in a separate Yaml File. This tool will then take that file and generate those topics with their config in your kafka cluster. It will even update the configs of existing topics if they already exist.
The tool never deletes any existing topics.
Install
npm install --global @astradot/kafka-schema-sync
Usage
kafka-schema-sync --config topic-config.yml
Sample Config
bootstrapServers: "localhost:9092,localhost:9091"
replication: 3
defaultCompression: zstd
topics:
- name: server-metrics
retentionHours: 12
- name: user-events
retentionHours: 48
compression: gzip