1.2.15 • Published 4 years ago
elastictractor v1.2.15
Elastic Tractor
This is a tool to extract, transform and load data based on Grok Patterns.
Firstly it was designed to run as a AWS Lambda, but with some efforts you could use with any serverless platform.
Currently we are supporting events from:
- Source: Kinesis, S3, Cloudwatch Logs and ECS Events.
- Destination: Kinesis, Kinesis Firehose and ElasticSearch.
Current Status
Stable, but under constant development.
Installation
npm install elastictractor
Features
- Listen events from Kinesis, S3, CloudWatch Logs and ECS Events;
- Extract information based on Grok Patterns;
- Apply some pre-defined transformations like, parseInt, parseJson, add and delete fields;
- Load data into Kinesis, Kinesis Firehose or ElasticSearch.
Introduction
It is a simple example to use with AWS Lambda:
var elasticTractor = require('elastictractor')
var processor = new elasticTractor({
elkHost: "http://localhost:9200"
});
exports.handler = function(event, context, callback) {
processor.handler(event, context, callback);
};
It is a basic authentication example to use with AWS Lambda:
var elasticTractor = require('elastictractor')
var processor = new elasticTractor({
elkHost: "http://localhost:9200",
username: "test",
password: "123"
});
exports.handler = function(event, context, callback) {
processor.handler(event, context, callback);
};
It is a cloud example to use with AWS Lambda:
var elasticTractor = require('elastictractor')
var processor = new elasticTractor({
cloudId: "name:SJHSJSHJSHHDIhb23331=",
username: "test",
password: "123"
});
exports.handler = function(event, context, callback) {
processor.handler(event, context, callback);
};
1.2.15
4 years ago
1.2.14
4 years ago
1.2.13
5 years ago
1.2.12
5 years ago
1.2.11
5 years ago
1.2.10
5 years ago
1.2.9
5 years ago
1.2.8
5 years ago
1.2.7
5 years ago
1.2.6
5 years ago
1.2.5
5 years ago
1.2.4
5 years ago
1.2.3
5 years ago
1.2.2
5 years ago
1.2.1
5 years ago
1.2.0
5 years ago
1.1.2
5 years ago
1.1.1
5 years ago
1.1.0
5 years ago
1.0.7
5 years ago
1.0.6
5 years ago
1.0.5
5 years ago
1.0.4
5 years ago
1.0.3
5 years ago
1.0.2
5 years ago
1.0.1
5 years ago
1.0.0
5 years ago