hb_dpl_kafka v1.0.0

dpl-kafka

A wrapper for communication with Kafka repository, to easily create consumers with optional producers.

The consumer is controlled by

Environment variables (.env):

NEED_PRODUCER: boolean. does the consumer generate data into Kafka topics

PRODUCER_TOPICS: comma separated list of output topics (in case a producer is required)

CONSUMER_NAME: name of .js specific consumer implementation file (e.g iterable_consumption).

CONSUMER_TOPICS: comma separated list of topics to subscribe to

KAFKA_CONFIG: string represetation of Kafka connection parameters e.g. '{"server": "uri:port of kafka host", "username": "xxx", "password": "password", "security_protocol": "SASL_SSL", "sasl_mechanism": "PLAIN"}'