1.5.0 • Published 1 year ago

bunyan-elasticsearch-stream v1.5.0

Weekly downloads
-
License
MIT
Repository
github
Last release
1 year ago

bunyan-elasticsearch-stream

  • A Bunyan stream for saving logs into Elasticsearch.
  • Buffers logs in memory instead of sending them to the Elasticsearch server one by one.
  • The logs are accumulated in memory until a certain number of logs reached or a certain amount of time passed without sending any logs.
  • The goal is to save resources on both your application and Elastic Search server (ex: lowering costs in AWS).
  • Written in Typescript.

Based on bunyan-elasticsearch-bulk

Requirements

Installation

npm i bunyan-elasticsearch-stream

Usage with Node

import bunyan from "bunyan";
import { BunyanESStream } from "bunyan-elasticsearch-stream";

const config = {
  name: 'Application Name',
  streams: [{
    level: 'debug',
    stream: new BunyanESStream({
      clientOptions: { node: "http://localhost:9200" },
    })
  }]
}

const log = bunyan.createLogger(config)

// From here, you can log things according to the best practices of Bunyan.
// Please familiarize yourself with it here: https://github.com/trentm/node-bunyan

log.info('Log this message!')
log.info({ otherInfo: 'What else do you need to log here?' }, 'Log this message!')

List of Configuration Parameters

FieldDefaultDescription
indexNameapp-logIndex name for the Elasticsearch data stream
limit100How many logs to collect before submitting them to ES
interval5000Time in milliseconds before submitting logs even if their count has not reached the limit
clientOptions{}Elasticsearch client options
clientClient(options.clientOptions)If you don't want to use the included version of the client v7.x, you can configure the one you want and pass it here

Emitted Events

Check server.ts for example usages:

EventFires when ..
log_receivedwe receive a log
log_submittedwe bulk-submit logs to ES server. With a reason limit_exceeded or timeout
erroran error happens in the whole bulk submission or when saving an individual message fails

License

MIT

1.5.0

1 year ago

1.4.0

1 year ago

1.3.1

3 years ago

1.3.0

3 years ago

1.2.0

3 years ago

1.1.0

3 years ago

1.0.0

3 years ago