18.2.0 • Published 2 days ago

@cumulus/ingest v18.2.0

Weekly downloads
201
License
Apache-2.0
Repository
github
Last release
2 days ago

@cumulus/ingest

CircleCI

@cumulus/ingest is a collection of modules for discovering and ingesting data.

What is Cumulus?

Cumulus is a cloud-based data ingest, archive, distribution and management prototype for NASA's future Earth science data streams.

Cumulus Documentation

Installation

npm install @cumulus/ingest

Testing

Running tests locally requires localstack.

With localstack running, you can run tests using:

LOCALSTACK_HOST=localhost npm test

Modules

All modules are accessible using require: require('@cumulus/ingest/<MODULE_NAME>') or import: import <MODULE_NAME> from '@cumulus/ingest/<MODULE_NAME>'.

  • consumer - comsumer for SQS messages
  • crypto - provides encryption and decryption methods with a consistent API but differing mechanisms for dealing with encryption keys
  • ftp - for accessing FTP servers
  • granule - discovers and ingests granules
  • http - for accessing data via HTTP and HTTPS
  • lock - creates locks for S3 data
  • log - stringifies JS object logs for ElasticSearch indexing
  • parse-pdr - tools for validating PDRs and generating PDRD and PAN messages
  • pdr - discovers and ingests pdrs
  • queue - creates queues for ingesting data
  • recursion - handles recursion of a FTP/SFTP list operation
  • sftp - for accessing SFTP servers

Contributing

See Cumulus README

GIBSCUMULUSNASA
@cumulus/aws-client@cumulus/common@cumulus/db@cumulus/errors@cumulus/logger@cumulus/message@cumulus/sftp-clientaws-sdkcksumencodeurlfs-extragotis-ipis-valid-hostnamejsftplodashmime-typesmomentsimplecrawlertough-cookie
@infinitebrahmanuniverse/nolb-_cum@everything-registry/sub-chunk-209@cumulus/move-granules@cumulus/parse-pdr@cumulus/queue-granules@cumulus/queue-pdrs@cumulus/queue-workflow@cumulus/sync-granule@cumulus/discover-granules@cumulus/discover-pdrs@cumulus/discover-s3-granules@cumulus/api@cumulus-ce/api@flamingbear/api
16.1.4

2 days ago

18.2.0

3 months ago

16.1.3

4 months ago

18.2.0-alpha.0

5 months ago

18.1.0

6 months ago

18.0.0

8 months ago

16.1.1

9 months ago

16.1.2

6 months ago

17.0.0

9 months ago

16.0.3-alpha.0

10 months ago

16.0.0

10 months ago

15.0.4

10 months ago

16.0.1-alpha.0

11 months ago

16.0.2-alpha.0

11 months ago

15.0.2

1 year ago

15.0.3

1 year ago

15.0.1

1 year ago

14.1.0

1 year ago

15.0.0

1 year ago

13.4.0

2 years ago

11.1.8

1 year ago

13.3.3-alpha.0

1 year ago

14.0.0

1 year ago

13.3.3-alpha.1

1 year ago

13.3.2

2 years ago

12.0.3

2 years ago

13.3.1

2 years ago

11.1.6

2 years ago

11.1.7

2 years ago

13.3.0

2 years ago

13.0.1-alpha.1

2 years ago

12.0.1

2 years ago

12.0.2

2 years ago

13.0.0

2 years ago

13.0.1

2 years ago

11.1.5

2 years ago

11.1.3

2 years ago

11.1.4

2 years ago

11.1.2

2 years ago

13.1.0

2 years ago

10.1.3

2 years ago

13.2.0

2 years ago

13.2.1

2 years ago

12.0.0

2 years ago

10.0.2

2 years ago

11.1.1

2 years ago

11.1.0

2 years ago

9.9.4

2 years ago

11.0.0

2 years ago

10.1.2

2 years ago

9.4.2

2 years ago

10.1.1

2 years ago

9.4.1

2 years ago

10.0.0

2 years ago

10.0.1

2 years ago

9.9.1

2 years ago

9.9.2

2 years ago

9.9.3

2 years ago

9.7.1

2 years ago

10.1.0

2 years ago

9.2.4

2 years ago

9.2.3

2 years ago

10.0.0-beta.0

2 years ago

9.9.0

2 years ago

9.8.0

3 years ago

9.8.0-alpha.0

3 years ago

9.7.0

3 years ago

9.6.0

3 years ago

9.5.0

3 years ago

9.4.0

3 years ago

9.2.2

3 years ago

8.1.2

3 years ago

9.2.1

3 years ago

9.3.0

3 years ago

9.2.0

3 years ago

8.1.1

3 years ago

9.1.0

3 years ago

8.1.0

3 years ago

9.0.1

3 years ago

9.0.0

3 years ago

8.0.0

3 years ago

6.0.1

3 years ago

7.2.0

3 years ago

7.1.0

3 years ago

7.0.0

3 years ago

6.0.0

3 years ago

5.0.1

3 years ago

5.0.0

3 years ago

4.0.0

3 years ago

3.0.1

4 years ago

2.0.8

4 years ago

3.0.0

4 years ago

2.0.7

4 years ago

2.0.6

4 years ago

2.0.5

4 years ago

2.0.4

4 years ago

2.0.3

4 years ago

2.0.2

4 years ago

2.0.1

4 years ago

2.0.0

4 years ago

1.24.0

4 years ago

1.23.2

4 years ago

1.23.1

4 years ago

1.23.0

4 years ago

1.22.1

4 years ago

1.22.0

4 years ago

1.21.0

4 years ago

1.20.0

4 years ago

1.19.0

4 years ago

1.18.0

4 years ago

1.14.5

4 years ago

1.17.0

4 years ago

1.16.1

4 years ago

1.16.0

4 years ago

1.15.0

4 years ago

1.13.6

4 years ago

1.14.4

5 years ago

1.14.3

5 years ago

1.14.2

5 years ago

1.14.1

5 years ago

1.13.5

5 years ago

1.14.0

5 years ago

1.13.4

5 years ago

1.13.3

5 years ago

1.13.2

5 years ago

1.13.1

5 years ago

1.13.0

5 years ago

1.12.1

5 years ago

1.12.0

5 years ago

1.11.3

5 years ago

1.11.2

5 years ago

1.11.1

5 years ago

1.11.0

5 years ago

1.10.4

5 years ago

1.10.1-1

5 years ago

1.10.3

6 years ago

1.10.2

6 years ago

1.10.1

6 years ago

1.10.0

6 years ago

1.9.1

6 years ago

1.8.4

6 years ago

1.8.3

6 years ago

1.8.2

6 years ago

1.9.0

6 years ago

1.8.1

6 years ago

1.7.1

6 years ago

1.8.0

6 years ago

1.7.0

6 years ago

1.6.0

6 years ago

1.5.5

6 years ago

1.5.4

6 years ago

1.5.3

6 years ago

1.5.2

6 years ago

1.5.1

6 years ago

1.5.0

6 years ago

1.4.2-beta.0

6 years ago

1.4.1

6 years ago

1.4.0

6 years ago

1.2.1-alpha.1

6 years ago

1.3.0

6 years ago

1.2.0

6 years ago

1.1.4

6 years ago

1.1.3

6 years ago

1.1.2

6 years ago

1.1.1

6 years ago

1.1.0

6 years ago

1.0.1

6 years ago

1.0.0

6 years ago

1.0.0-beta.20

6 years ago

1.0.0-beta.19

6 years ago

1.0.0-beta.18

6 years ago

1.0.0-beta.17.2.0

6 years ago

1.0.0-beta.17

6 years ago

1.0.0-beta.16

6 years ago

1.0.0-beta.15

6 years ago

1.0.0-beta.14

6 years ago

1.0.0-beta.13

6 years ago

1.0.0-beta.12

6 years ago

1.0.0-beta.11

6 years ago

1.0.0-beta.10

6 years ago

1.0.0-1.0.0-beta.9.1

6 years ago

1.0.0-1.0.0-beta.9.0

6 years ago

1.0.0-beta.8.3

6 years ago

1.0.0-beta.8

6 years ago

1.0.0-beta.7

6 years ago

1.0.0-beta.6

6 years ago

1.0.0-beta.4

6 years ago

1.0.0-beta.3

6 years ago

1.0.0-beta.2

6 years ago

1.0.0-beta.581d31f6

6 years ago

1.0.0-beta.222

6 years ago

1.0.0-beta.111

6 years ago

1.0.0-beta.4610474d

6 years ago

1.0.0-beta.581d31f4

6 years ago

1.2.0-alpha.95df4cc6

6 years ago

1.4.0-alpha.95df4cc6

6 years ago

1.3.0-alpha.c0ebdcd8

6 years ago

1.2.0-alpha.c0ebdcd8

6 years ago

1.1.0-alpha.c0ebdcd8

6 years ago

1.0.0-beta.259fee54

6 years ago