Token-counter NPM

install

npm

npm install token-counter

yarn

yarn add token-counter

Feature

Count the number of tokens from the text
Calculate the price based on the number of tokens
Price calculation according to the model in use
Support for LangChain Callback
Calculation of amounts in each country's currency
Obtaining usage details
OnChange event handler when adding
Avoid counting in mock use option

Usage

Count tokens from text

import { TokenCounter } from "token-counter";

const tokenCounter = new TokenCounter();

const prompt = "example text";

tokenCounter.addGpt3_4kInputText(prompt);

// Tapping the API of Gpt-3.5-turbo (4k model)

tokenCounter.addGpt3_4kOutputText(prompt);

Use for LangChain Callback

import { TokenCounter } from "token-counter";
import { TokenCounter3_4kCallback } from "token-counter/langchain";

const tokenCounter = new TokenCounter();

new ChatOpenAI({
  modelName: "gpt-3.5-turbo-0613",
  temperature: 0,
  callbacks: [new TokenCounter3_4kCallback(tokenCounter)],
});

Get prices in your country's currency

console.log(tokenCounter.jpyPrice);

Obtain a statement of use

// True must be passed as the first argument when initializing tokenCounter
const tokenCounter = new TokenCounter(true);

tokenCounter.addGpt3_4kInputText(prompt);

// Obtain a statement of use
console.log(tokenCounter.receipt);