@gridql/kafka-event-consumer

Kafka Event Consumer

The grid is made up of multiple event stores. We have two primary ways of those events being generated:

• user action
  • HTTP Request via the REST API
• system reaction
  • Taking events from a queue

This modules focuses on the latter.

In principle all we have to do is:

• Take event from queue
• Discriminate based on operation type
• Forward to RestAPI

TODO

Features

• Basic happy path
  • CREATE
  • DELETE
  • UPDATE
• Work with any field as "ID"
• Split message out of envelope
• Bulk changes
• Default to picking up where the group left off
• Sad path
  • Dead letter queue
  • validation of message
  • Handling network outages

NFRs

• Performance tests
• Integration test