4.3.0 • Published 5 months ago

sqs-bulk-loader v4.3.0

Weekly downloads
228
License
ISC
Repository
github
Last release
5 months ago

AWS SQS Bulk Loader

A set of functions to help sending bulk messages in sequence or parallel to AWS SQS.

Migration steps from Version 3 to Version 4

  • Add @aws-sdk/client-sqs as peer dependency instead of aws-sdk
  • Rest of the code should work as it is. The response structure has changed slightly. More information can be found here

Known Vulnerabilities Coverage Status Build Status

NPM

How to install

npm install sqs-bulk-loader

@aws-sdk/client-sqs is peer dependency for this package. Make sure it is installed.

To use aws-sdk version 2, please use version 3 of this package.

npm install sqs-bulk-loader@3

Running the tests

npm test

Getting started

Basic syntax is:

const {sendBatchedMessages, sendBatchedMessagesInParallel} = require("sqs-bulk-loader")();

const messages = [
  {
    "Id": "1",
    "MessageBody": '{"key1": "value1"}'
  },
  {
    "Id": "2",
    "MessageBody": '{"key2": "value2"}'
  }
];

// this needs to be in async function
const response = await sendBatchedMessages("someQueueUrl", messages);
console.log(response)

// OR you can use normal promise style as well.
sendBatchedMessages("someQueueUrl", messages)
  .then(response => console.log(response));

In case you need to inject the @aws-sdk/client-sqs with custom settings. It can be done like this

const {SQSClient} = require("@aws-sdk/client-sqs");
const sqsClient = new SQSClient({"region": "eu-west-2"});
const {sendBatchedMessages, sendBatchedMessagesInParallel} = require("sqs-bulk-loader")(sqsClient);

API

sendBatchedMessages

sendBatchedMessages(queueUrl, messages) ⇒ Promise

Function - Sends the messages passed in batch of 10 sequentially

Returns: Promise - - promise which resolves on success and rejects on error

ParamTypeDefaultDescription
queueUrlStringSQS queue url
messagesArrayArray of messages as per sendMessageBatch's params

More details - https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-sqs/interfaces/sendmessagebatchcommandinput.html

sendBatchedMessagesInParallel

sendBatchedMessagesInParallel(queueUrl, messages) ⇒ Promise

Function - Sends the messages passed in batch of 10 parallely

Returns: Promise - - promise which resolves on success and rejects on error

ParamTypeDefaultDescription
queueUrlStringSQS queue url
messagesArrayArray of messages as per sendMessageBatch's params
optionsObject{"batchSize": 10}Optional object containing extra properties which will be passed to function. Currently it supports batchSize integer to control how many parallel requests to spawn. Default is 10

More details - https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/clients/client-sqs/interfaces/sendmessagebatchcommandinput.html

4.3.0

5 months ago

4.2.0

9 months ago

4.1.0

12 months ago

4.0.0

1 year ago

3.5.0

2 years ago

3.4.0

2 years ago

3.3.0

2 years ago

3.2.0

2 years ago

3.1.0

2 years ago

2.31.0

2 years ago

3.0.0

2 years ago

2.30.0

3 years ago

2.29.0

3 years ago

2.28.0

3 years ago

2.27.0

3 years ago

2.26.0

3 years ago

2.25.0

3 years ago

2.24.0

3 years ago

2.19.0

3 years ago

2.18.0

3 years ago

2.21.0

3 years ago

2.23.0

3 years ago

2.20.0

3 years ago

2.22.0

3 years ago

2.17.0

3 years ago

2.15.0

3 years ago

2.13.0

3 years ago

2.12.0

3 years ago

2.11.0

3 years ago

2.10.0

3 years ago

2.9.0

3 years ago

2.8.0

4 years ago

2.7.0

4 years ago

2.6.0

4 years ago

2.5.0

4 years ago

2.4.0

4 years ago

2.3.0

4 years ago

2.2.0

4 years ago

2.1.0

4 years ago

2.0.0

4 years ago

1.1.0

4 years ago

1.0.1

4 years ago

1.0.0

4 years ago

0.2.0

4 years ago

0.1.0

4 years ago