0.0.1 • Published 9 months ago
@mindlearn/tokenizer v0.0.1
MindScript Tokenizer
This is a simple mindscript tokenizer to make your chatbot better understand user questions.
How to Use
- Install the dependencies:
npm install @mindlearn/tokenizer
- Use the tokenizer in your code:
const tokenizer = require("@mindlearn/tokenizer");
const word = "Hello World, here is a basic mindscript tokenizer example.";
console.log(tokenizer(word));
0.0.1
9 months ago