@cumulus/integration-tests v19.1.0

@cumulus/integration-tests

This package provides a CLI and functions for testing Cumulus.

⚠️ The documented API of this package will not change without a deprecation warning being provided in earlier releases. Code in this package that is not documented in this README may change without warning, and is not considered part of the package's public API.

About Cumulus

Cumulus is a cloud-based data ingest, archive, distribution and management prototype for NASA's future Earth science data streams.

Cumulus Documentation

Installation

$ npm install @cumulus/integration-tests

API

Modules

Collections

Example

const Collections = require('@cumulus/integration-test/Collections');

• Collections
  • createCollection(prefix, [overrides]) ⇒ Promise.<Object> ⏏
    • ~addCustomUrlPathToCollectionFiles(collection, customFilePath) ⇒ Array.<Object>
    • ~buildCollection(params) ⇒ Object
    • ~collectionExists(stackName, collection) ⇒ boolean
    • ~addCollection(stackName, collection) ⇒ Promise.<undefined>
    • ~addCollections(stackName, bucketName, dataDirectory, [postfix], [customFilePath], [duplicateHandling]) ⇒ Promise.<Array.<Object>>

createCollection(prefix, overrides) ⇒ Promise.<Object> ⏏

Create a randomized collection using the Cumulus API.

The default collection is very simple. It expects that, for any discovered file, the granule ID is everything in the filename before the extension. For example, a file named gran-1.txt would have a granuleId of gran-1. Filenames can only contain a single . character.

Collection defaults:

• name: random string starting with collection-name-
• version: random string starting with collection-version-
• reportToEms: false
• granuleId: '^[^.]+$'
• granuleIdExtraction: '^([^.]+)\..+$'
• sampleFileName: 'asdf.jpg'
• files:

  [
    {
      bucket: 'protected',
      regex: '^[^.]+\..+$',
      sampleFileName: 'asdf.jpg'
    }
  ]

Kind: Exported function
Returns: Promise.<Object> - the generated collection

createCollection~addCustomUrlPathToCollectionFiles(collection, customFilePath) ⇒ Array.<Object>

Given a Cumulus collection configuration, return a list of the filetype configs with their url_paths updated.

Kind: inner method of createCollection
Returns: Array.<Object> - a list of collection filetype configs

createCollection~buildCollection(params) ⇒ Object

Update a collection with a custom file path, duplicate handling, and name updated with the postfix.

Kind: inner method of createCollection
Returns: Object - an updated collection

createCollection~collectionExists(stackName, collection) ⇒ boolean

Returns true if collection exists. False otherwise.

Kind: inner method of createCollection

createCollection~addCollection(stackName, collection) ⇒ Promise.<undefined>

Add a new collection to Cumulus

Kind: inner method of createCollection

createCollection~addCollections(stackName, bucketName, dataDirectory, postfix, customFilePath, duplicateHandling) ⇒ Promise.<Array.<Object>>

Add collections to database

Kind: inner method of createCollection
Returns: Promise.<Array.<Object>> - - collections that were added

Executions

Example

const Executions = require('@cumulus/integration-test/Executions');

• Executions
  • findExecutionArn(prefix, matcher, [queryParameters], [options]) ⇒ Promise.<string> ⏏
  • getExecutionWithStatus(params) ⇒ Promise.<Object> ⏏

findExecutionArn(prefix, matcher, queryParameters, options) ⇒ Promise.<string> ⏏

Find the execution ARN matching the matcher function

Kind: Exported function
Returns: Promise.<string> - the ARN of the matching execution

getExecutionWithStatus(params) ⇒ Promise.<Object> ⏏

Wait for an execution to have an expected status and return the execution

Kind: Exported function
Returns: Promise.<Object> - the execution as returned by the GET /executions/<execution-arn> endpoint

Granules

Example

const Granules = require('@cumulus/integration-test/Granules');

• Granules
  • getGranuleWithStatus(params) ⇒ Promise.<Object> ⏏
    • ~waitForListGranulesResult(params) ⇒ Promise.<Object>

getGranuleWithStatus(params) ⇒ Promise.<Object> ⏏

Wait for a granule to have an expected status and return the granule

Kind: Exported function
Returns: Promise.<Object> - the granule as returned by the GET /granules/<granule-id> endpoint

getGranuleWithStatus~waitForListGranulesResult(params) ⇒ Promise.<Object>

Wait for listGranules to return at least a single value before returning an empty result

Kind: inner method of getGranuleWithStatus
Returns: Promise.<Object> - - results of a successful listGranules

Providers

Example

const Providers = require('@cumulus/integration-test/Providers');

createProvider(prefix, overrides) ⇒ Promise.<Object> ⏏

Create a provider using the Cumulus API

Provider defaults:

• id: random string starting with provider-
• protocol: s3
• globalConnectionLimit: 10

Kind: Exported function
Returns: Promise.<Object> - the generated provider

Rules

Example

const Rules = require('@cumulus/integration-test/Rules');

createOneTimeRule(prefix, overrides) ⇒ Promise.<Object> ⏏

Create a onetime rule using the Cumulus API

Rule defaults:

• name: random string starting with rule_
• rule: { type: 'onetime' }

Kind: Exported function
Returns: Promise.<Object> - the generated rule

CLI Usage

Usage: cumulus-test TYPE COMMAND [options]


  Options:

    -V, --version                   output the version number
    -s, --stack-name <stackName>    AWS Cloud Formation stack name (default: null)
    -b, --bucket-name <bucketName>  AWS S3 internal bucket name (default: null)
    -w, --workflow <workflow>       Workflow name (default: null)
    -i, --input-file <inputFile>    Workflow input JSON file (default: null)
    -h, --help                      output usage information


  Commands:

    workflow  Execute a workflow and determine if the workflow completes successfully

For example, to test the HelloWorld workflow:

cumulus-test workflow --stack-name helloworld-cumulus --bucket-name cumulus-bucket-internal --workflow HelloWorldWorkflow --input-file ./helloWorldInput.json

Contributing

To make a contribution, please see our contributing guidelines.

Generated automatically using npm run build-docs