logging-system v0.0.7

This package helps you log zillions of events {cheaply,efficiently,reliably}.

EventBucket

An EventBucket is a set of events.

Event

* no non-integer numbers, no nested structures, no \u0000 ** Keys must be distinct so the server can be idempotent.

Stuff

APIs

{LoggingServer,EventServer} API

EventServer API

Servers

LoggingServer

• Logs all data of all incoming HTTP requests in batches
• HTTP requests are not parsed. Not even a little. // TEMP: requiring UTF-8 for now
• Batches are POSTed to S3
• One batch every 10 sec implies 2.6 USD/month for POST requests

EventServer

Datastore usage

Formats

JSON event

JSON events

eventbuf-v3 event

eventbuf-v3 events

LoggingServer S3 Objects

Key

Batch format, V2

Concatenated HTTP events, each of which is:

HTTP events

Notes

S3 Pricing