@cumulus/ingest NPM | npm.io

19.1.0 • Published 8 months ago

Install

Weekly downloads

201

License

Apache-2.0

Repository

Last release

8 months ago

@cumulus/ingest

@cumulus/ingest is a collection of modules for discovering and ingesting data.

About Cumulus

Cumulus is a cloud-based data ingest, archive, distribution and management prototype for NASA's future Earth science data streams.

Cumulus Documentation

Installation

npm install @cumulus/ingest

Testing

Running tests locally requires localstack.

With localstack running, you can run tests using:

LOCALSTACK_HOST=localhost npm test

Modules

All modules are accessible using require: require('@cumulus/ingest/<MODULE_NAME>') or import: import <MODULE_NAME> from '@cumulus/ingest/<MODULE_NAME>'.

consumer - consumer for SQS messages
crypto - provides encryption and decryption methods with a consistent API but differing mechanisms for dealing with encryption keys
ftp - for accessing FTP servers
granule - discovers and ingests granules
http - for accessing data via HTTP and HTTPS
lock - creates locks for S3 data
log - stringifies JS object logs for ElasticSearch indexing
parse-pdr - tools for validating PDRs and generating PDRD and PAN messages
pdr - discovers and ingests pdrs
queue - creates queues for ingesting data
recursion - handles recursion of a FTP/SFTP list operation
sftp - for accessing SFTP servers

Contributing

To make a contribution, please see our contributing guidelines.

GIBS CUMULUS NASA

@cumulus/aws-client @cumulus/common @cumulus/db @cumulus/errors @cumulus/logger @cumulus/message @cumulus/sftp-client cksum encodeurl fs-extra is-ip is-valid-hostname jsftp lodash mime-types moment simplecrawler tough-cookie

@infinitebrahmanuniverse/nolb-_cum @everything-registry/sub-chunk-209 @cumulus-ce/api @cumulus/api @cumulus/discover-granules @cumulus/discover-pdrs @cumulus/discover-s3-granules @cumulus/move-granules @cumulus/parse-pdr @cumulus/queue-granules @cumulus/queue-pdrs @cumulus/queue-workflow @cumulus/sync-granule @flamingbear/api

8 months ago

8 months ago

9 months ago

9 months ago

10 months ago

10 months ago

1 year ago

10 months ago

11 months ago

11 months ago

12 months ago

1 year ago

1 year ago

1 year ago

1 year ago

1 year ago

1 year ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

2 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

3 years ago

4 years ago

3 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

4 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

5 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

6 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

1.0.0-beta.17.2.0

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

1.0.0-1.0.0-beta.9.1

7 years ago

1.0.0-1.0.0-beta.9.0

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

7 years ago

1.0.0-beta.581d31f6

7 years ago

7 years ago

7 years ago

1.0.0-beta.4610474d

7 years ago

1.0.0-beta.581d31f4

7 years ago

1.2.0-alpha.95df4cc6

7 years ago

1.4.0-alpha.95df4cc6

7 years ago

1.3.0-alpha.c0ebdcd8

7 years ago

1.2.0-alpha.c0ebdcd8

7 years ago

1.1.0-alpha.c0ebdcd8

7 years ago

1.0.0-beta.259fee54

7 years ago