0.0.31 • Published 5 years ago
moonset v0.0.31
Moonset
Moonset is a data processing framework on top of AWS. It provides both batch processing and stream processing. Try command:
npx moonset --help
For example, to run some hive tasks on AWS EMR. Try to following command.
# config the credentials
npx moonset config
# run a job
npx moonset deploy --job '{
"input": [
{"glue": { "dbName": "foo", "tableName": "apple"}}
],
"task": [
{"hive": {"sqlFile": "s3://foo/hive.sql"}}
],
"output": [
{"glue": { "dbName": "foo", "tableName": "orange"}}
]
}'
All resources is managed by AWS CDK so there is minimum effort for infrastructure setup. You can run it in a brand new account.
0.0.31
5 years ago
0.0.30
5 years ago
0.0.29
5 years ago
0.0.25
5 years ago
0.0.24
5 years ago
0.0.23
5 years ago
0.0.22
5 years ago
0.0.20
5 years ago
0.0.18
5 years ago
0.0.19
5 years ago
0.0.17
5 years ago
0.0.16
5 years ago
0.0.15
5 years ago
0.0.14
5 years ago
0.0.13
5 years ago
0.0.12
5 years ago
0.0.11
5 years ago
0.0.10
5 years ago
0.0.9
5 years ago
0.0.8
5 years ago
0.0.7
5 years ago
0.0.0
5 years ago