0.0.31 • Published 5 years ago

moonset v0.0.31

Weekly downloads
1
License
MIT
Repository
github
Last release
5 years ago

Moonset

Moonset is a data processing framework on top of AWS. It provides both batch processing and stream processing. Try command:

npx moonset --help

For example, to run some hive tasks on AWS EMR. Try to following command.

# config the credentials
npx moonset config

# run a job
npx moonset deploy --job '{
    "input": [
      {"glue": { "dbName": "foo", "tableName": "apple"}}
    ],
    "task": [
      {"hive": {"sqlFile": "s3://foo/hive.sql"}}
    ],
    "output": [
      {"glue": { "dbName": "foo", "tableName": "orange"}}
    ]
}' 

All resources is managed by AWS CDK so there is minimum effort for infrastructure setup. You can run it in a brand new account.

0.0.31

5 years ago

0.0.30

5 years ago

0.0.29

5 years ago

0.0.25

5 years ago

0.0.24

5 years ago

0.0.23

5 years ago

0.0.22

5 years ago

0.0.20

5 years ago

0.0.18

5 years ago

0.0.19

5 years ago

0.0.17

5 years ago

0.0.16

5 years ago

0.0.15

5 years ago

0.0.14

5 years ago

0.0.13

5 years ago

0.0.12

5 years ago

0.0.11

5 years ago

0.0.10

5 years ago

0.0.9

5 years ago

0.0.8

5 years ago

0.0.7

5 years ago

0.0.0

5 years ago