0.5.6 • Published 19 days ago

stargate-mongoose v0.5.6

Weekly downloads
-
License
Apache-2.0
Repository
github
Last release
19 days ago

stargate-mongoose ci-tests

stargate-mongoose is a Mongoose driver for Data API which runs on top of Apache Cassandra / DataStax Enterprise.

  1. Quickstart
  2. Architecture
  3. Version compatibility
  4. Connecting to AstraDB
  5. Sample Applications
  6. Features
  7. NodeJS MongoDB Driver Overriding (experimental)
  8. API Reference
  9. Developer Guide

Quickstart

Prerequisites: node (>=14.0.0), npm/yarn, Docker (for testing the sample app locally using docker compose)

  • Start Docker on your local machine.
  • Clone this repository
git clone https://github.com/stargate/stargate-mongoose.git
cd stargate-mongoose
  • Execute below script and wait for it to complete, which starts a simple Data API on local with a DSE 6.8 (DataStax Enterprise) as database backend.

For macOS/Linux

bin/start_data_api.sh

For Windows

bin\start_data_api.cmd
  • Create a sample project called 'sample-app'
mkdir sample-app
cd sample-app
  • Initialize and add required dependencies
npm init -y && npm install express mongoose stargate-mongoose --engine-strict

OR

yarn init -y && yarn add express mongoose stargate-mongoose
  • Create a file called index.js under the 'sample-app' directory and copy below code into the file.
//imports
const express = require('express');
const mongoose = require('mongoose');
const stargate_mongoose = require('stargate-mongoose');
const Schema = mongoose.Schema;
const driver = stargate_mongoose.driver;

//override the default native driver
mongoose.setDriver(driver);

//Set up mongoose & end points definition
const Product = mongoose.model('Product', new Schema({ name: String, price: Number }));
mongoose.connect('http://localhost:8181/v1/inventory', {
    username: 'cassandra',
    password: 'cassandra',
    authUrl: 'http://localhost:8081/v1/auth'
});
Object.values(mongoose.connection.models).map(Model => Model.init());
const app = express();
app.get('/addproduct', (req, res) => {
    const newProduct = new Product(
        {
            name: 'product' + Math.floor(Math.random() * 99 + 1),
            price: '' + Math.floor(Math.random() * 900 + 100)
        });
    newProduct.save();
    res.send('Added a product!');
});
app.get('/getproducts', (req, res) => {
    Product.find()
        .then(products => res.json(products));
});

//Start server
const HOST = '0.0.0.0';
const PORT = 8097;
app.listen(PORT, HOST, () => {
    console.log(`Running on http://${HOST}:${PORT}`);
    console.log('http://localhost:' + PORT + '/addproduct');
    console.log('http://localhost:' + PORT + '/getproducts');
});
  • Execute below to run the app & navigate to the urls listed on the console
node index.js
  • Stop the Data API once the test is complete
docker compose -f bin/docker-compose.yml down -v

Architecture

High level architecture

Components

  • Cassandra Cluster - Apache Cassandra / DataStax Enterprise Cluster as backend database.
  • Stargate Coordinator Nodes - Stargate is an open source Data API Gateway for Cassandra. Coordinator is one of the primary components of Stargate which connects the API layer to the backend database. More details can be found here.
  • Stargate Data API - Data API is an open source Data API that runs on top of Stargate's coordinator.
  • JavaScript Clients that use Mongoose - Mongoose is an elegant mongodb object modeling library for node.js applications. By implementing a driver required by the Mongoose interface to connect to the Data API instead of native mongodb access layer, now a JavaScript client can store/retrieve documents on an Apache Cassandra/DSE backend.

The current implementation of the Data API uses DataStax Enterprise (DSE) as the backend database.

Version compatibility

Component/Library NameVersion
Mongoose^7.5.0 || ^8.0.0
data-api1.x
DataStax Enterprise6.8.x

CI tests are run using the Stargate and Data API versions specified in the api-compatibility.versions file.

Connecting to AstraDB

Here's a quick way to connect to AstraDB using stargate-mongoose driver.

const mongoose = require("mongoose");
const { driver, createAstraUri } = require("stargate-mongoose");

const uri = createAstraUri(
  process.env.ASTRA_DB_API_ENDPOINT,
  process.env.ASTRA_DB_APPLICATION_TOKEN,
  process.env.ASTRA_DB_NAMESPACE // optional
);

mongoose.setDriver(driver);

await mongoose.connect(uri, {
  isAstra: true,
});

And the step-by-step instructions with a sample application can be found here in below guide.

https://docs.datastax.com/en/astra/astra-db-vector/api-reference/data-api-with-mongoosejs.html

Sample Applications

Sample applications developed using stargate-mongoose driver are available in below repository.

https://github.com/stargate/stargate-mongoose-sample-apps

Features

Connection APIs

Operation NameDescription
createDatabaseWhen flag createNamespaceOnConnect is set to true the keyspace passed on to the mongoose.connect function via the URL, is created automatically
dropDatabaseDrops the database
createCollectionmongoose.model('ModelName',modelSchema) creates a collection as required
dropCollectionmodel.dropCollection() drops the collection

Collection APIs

Operation NameDescription
countDocumentsModel.countDocuments(filter) returns the count of documents
deleteManyModel.deleteMany(filter). This API will throw an error when more than 20 records are found to be deleted.
deleteOneModel.deleteOne(filter, options) options - sort
findModel.find(filter, projection, options) options - limit, pageState, skip, sort (skip works only with sorting)
findOneModel.findOne(filter, options) options - sort Example: findOne({}, { sort: { username: -1 } })
findOneAndDeleteModel.findOneAndDelete(filter, options) options - sort
findOneAndReplaceModel.findOneAndReplace(filter, replacement, options)optionsupsert: (default false)true - if a document is not found for the given filter, a new document will be inserted with the values in the filter (eq condition) and the values in the $set and $setOnInsertoperators.false - new document will not be inserted when no match is found for the given filter--------returnDocument: (default before)before - Return the document before the changes were appliedafter - Return the document after the changes are applied
findOneAndUpdateModel.findOneAndUpdate(filter, update, options)optionsupsert: (default false)true - if a document is not found for the given filter, a new document will be inserted with the values in the filter (eq condition) and the values in the $set and $setOnInsertoperators.false - new document will not be inserted when no match is found for the given filter--------returnDocument: (default before)before - Return the document before the changes were appliedafter - Return the document after the changes are applied
insertManyModel.insertMany([{docs}], options) In a single call, only 20 records can be inserted. options - ordered
insertOneModel.insertOne({doc})
updateManyModel.updateMany(filter, update, options)optionsupsert: (default false)true - if a document is not found for the given filter, a new document will be inserted with the values in the filter (eq condition) and the values in the $set and $setOnInsertoperators.false - new document will not be inserted when no match is found for the given filter** This API will throw an error when more than 20 records are found to be updated.
updateOneModel.updateOne(filter, update, options)optionsupsert: (default false)true - if a document is not found for the given filter, a new document will be inserted with the values in the filter (eq condition) and the values in the $set and $setOnInsertoperators.false - new document will not be inserted when no match is found for the given filter--------returnDocument: (default before)before - Return the document before the changes were appliedafter - Return the document after the changes are applied

Filter Clause

OperatorDescription
literal comparisonEqual to. Example: { 'first_name' : 'jim' }
$eqExample: { 'first_name' : { '$eq' : 'jim' } }
$gtNot supported. Example (age > 25): { 'age' : { '$gt' : 25 } }
$gteNot supported. Example (age >= 25): { 'age' : { '$gte' : 25 } }
$ltNot supported. Example (age < 25): { 'age' : { '$lt' : 25 } }
$lteNot supported. Example (age <= 25): { 'age' : { '$lte' : 25 } }
$neNot supported. Not Equal to. Example: { 'first_name' : { '$ne' : 'jim' } }
$inExample: { '_id' : { '$in' : ['nyc', 'la'] } } $in is not supported in non _id columns at the moment
$ninNot supported. Example: { 'address.city' : { '$nin' : ['nyc', 'la'] } }
$notNot supported. Example: { 'first_name' : { '$not' : { '$eq' : 'jim' }}}
$existsExample: { 'address.city' : { '$exists' : true} }
$allArray operation. Matches if all the elements of an array matches the given values. Example: { 'tags' : { '$all' : [ 'home', 'school' ] } }
$elemMatchNot supported. Matches if the elements of an array in a document matches the given conditions. Example: {'goals': { '$elemMatch': { '$gte': 2, '$lt': 10 }}}
$sizeArray Operation. Example: { 'tags' : { '$size' : 1 } }
$and (implicit)Logical expression. Example : { '$and' : [ {first_name : 'jim'}, {'age' : {'$gt' : 25 } } ] }
$and (explicit)Not supported. Example : { '$and' : [ {first_name : 'jim'}, {'age' : {'$gt' : 25 } } ] }
$orNot supported

Projection Clause

OperatorDescription
$elemMatch (projection)Not supported
$sliceArray related operation. Example: { 'tags' : { '$slice': 1 }} returns only the first element from the array field called tags.
$ (projection)Example: Model.find({}, { username : 1, _id : 0}) - This returns username in the response and the _id field

Sort Clause

OperatorDescription
Single Field SortSupported
Multi Field SortNot supported

Update Clause

OperatorDescription
$incExample: { '$inc': { 'points' : 5 } }
$minExample: { 'col': { '$min' : 5 } } if the columns value is greater than 5, it will be updated with 5
$maxExample: { 'col': { '$max' : 50 } } if the columns value is lesser than 50, it will be updated with 50
$renameExample: { $rename: { '$max' : 50 } } if the columns value is lesser than 50, it will be updated with 50
$setExample: {'update' : {'$set': {'location': 'New York'} }}
$setOnInsertExample: {'update' : {'$set': {'location': 'New York'}, '$setOnInsert': {'country': 'USA'} }}
$unsetExample: {'update' : {'$unset': [address.location] }}
$addToSetExample: {'$addToSet' : {'points': 10}}. This will add 10 to an array called points in the documents, without duplicates (i.e. ll skip if 10 is already present in the array)
$popExample: {'$pop' : {'points': 1 }}. This removes the last 1 item from an array called points. -1 will remove the first 1 item.
$pullNot supported
$pushExample. '$push': {'tags': 'work'}. This pushes an element called work to the array tags
$pullAllNot supported

Index Operations

Index operations are not supported. There is one caveat for ttl indexes: When adding a document, you can add a ttl option (determined in seconds) that will behave in the similar way to a ttl index. For example, with the collection's client:

import { Client } from 'stargate-mongoose';
// connect to Data API
const client = await Client.connect(process.env.DATA_API_URI);
// get a collection
const collection = client.db().collection('docs');
// insert and expire this document in 10 seconds
await collection.insertOne({ hello: 'world' }, { ttl: 10 });

Aggregation Operations

Aggregation operations are not supported.

Transaction Operations

Transaction operations are not supported.

NodeJS MongoDB Driver Overriding (experimental)

If you have an application that uses the NodeJS MongoDB driver, or a dependency that uses the NodeJS MongoDB driver, it is possible to override its use with the collections package of stargate-mongoose. This makes your application use Data API documents instead of MongoDB documents. Doing so requires code changes in your application that address the features section of this README, and a change in how you set up your client connection.

If your application uses mongodb you can override its usage like so:

In your app's mongodb package.json entry:

"mongodb": "stargate-mongoose@0.2.0-ALPHA-3",

Then, re-install your dependencies

npm i

Finally, modify your connection so that your driver connects to Data API

import { MongoClient } from 'stargate-mongoose';

// connect to Data API
const client = await MongoClient.connect(process.env.DATA_API_URI);

If you have an application dependency that uses mongodb, you can override its usage like so (this example uses mongoose):

Add an override to your app's package.json (requires NPM 8.3+), also, add `stargate-mongoose as a dependency:

"dependencies": {
    "stargate-mongoose": "^0.2.0-ALPHA-3"
},
"overrides": {
    "mongoose": {
        "mongodb":  "stargate-mongoose@0.2.0-ALPHA-3"
    }
},

Then, re-install your dependencies

npm i

Finally, modify your dependencies connection so that your driver connects to Data API

import mongoose from 'mongoose';

// connect to Data API
await mongoose.connect(process.env.DATA_API_URI);
0.5.6

19 days ago

0.5.5

28 days ago

0.5.4

1 month ago

0.5.3

2 months ago

0.5.2

2 months ago

0.5.1

2 months ago

0.5.0

3 months ago

0.4.3

4 months ago

0.4.1

4 months ago

0.3.2

4 months ago

0.4.2

4 months ago

0.3.1

4 months ago

0.3.0

6 months ago

0.2.0-ALPHA-7

7 months ago

0.2.0-ALPHA-6

7 months ago

0.2.0-ALPHA-8

7 months ago

0.2.0-ALPHA-5

9 months ago

0.2.0-ALPHA-4

9 months ago

0.2.0-ALPHA-3

12 months ago

0.2.0-ALPHA-2

1 year ago

0.2.0-ALPHA-1

1 year ago

0.2.0-ALPHA

1 year ago

0.1.0

2 years ago

0.1.1

1 year ago

0.1.2-alpha

1 year ago

0.0.1

2 years ago