nodeafka v0.1.1

NODEAFKA

A collection of scripts to run components of Apache Kafka. I wrote this to automate some processes while learning the Kafka API.

REQUISITES

Apache Kafka 0.10.2.0 release.

Set your kafka installation as your KAFKA_PATH environment variable.

All custom config files should be placed in your project's ./config/kafka folder.

USAGE

Run zookeeper:

nodeafka zookeeper

Run a kafka server (default config is the KAFKA_PATH/config/server.properties file):

nodeafka serve

Run a server with a custom config file (e.g. ./config/kafka/your-server-name.properties):

nodeafka serve --server your-server-name

Create a topic:

nodeafka create --topic your-topic-name

Create a topic with a replication factor of 3:

nodeafka create --topic --replication-factor 3

Describe a topic:

nodeafka describe --topic your-topic-name

Create and/or run a producer:

nodeafka producer --topic your-topic-name

Create and/or run a consumer:

nodeafka consumer --topic your-topic-name

*Notes:

• When testing fault-tolerance in Chapter 6, make sure you create a producer and consumer first. Consumers only see data from the moment of creation. So if your producer sends a message, and you kill the leader, starting up a consumer won't reveal the new message unless the consumer had previously been created. See the FAQ.
• Kafka Connect source only triggers a message transmission when there's a newline. So, when editing a 'test.txt' file in Chapter 7 of the Quick Start guide, enter a newline before saving to see the change in 'test.sink.txt'.

TODOS

More succint api for running the scripts.