Token-counter
Install
npm
npm install token-counter
yarn
yarn add token-counter
Feature
- Count the number of tokens from the text
- Calculate the price based on the number of tokens
- Price calculation according to the model in use
- Support for LangChain Callback
- Calculation of amounts in each country's currency
- Obtaining usage details
- OnChange event handler when adding
- Avoid counting in mock use option
Usage
Count tokens from text
import { TokenCounter } from "token-counter";
const tokenCounter = new TokenCounter();
const prompt = "example text";
tokenCounter.addGpt3_4kInputText(prompt);
// Tapping the API of Gpt-3.5-turbo (4k model)
tokenCounter.addGpt3_4kOutputText(prompt);
Use for LangChain Callback
import { TokenCounter } from "token-counter";
import { TokenCounter3_4kCallback } from "token-counter/langchain";
const tokenCounter = new TokenCounter();
new ChatOpenAI({
modelName: "gpt-3.5-turbo-0613",
temperature: 0,
callbacks: [new TokenCounter3_4kCallback(tokenCounter)],
});
Get prices in your country's currency
console.log(tokenCounter.jpyPrice);
Obtain a statement of use
// True must be passed as the first argument when initializing tokenCounter
const tokenCounter = new TokenCounter(true);
tokenCounter.addGpt3_4kInputText(prompt);
// Obtain a statement of use
console.log(tokenCounter.receipt);
Available Methods
Counting based on text
- addGpt3_4kInputText
- addGpt3_4kOutputText
- addGpt3_16kInputText
- addGpt3_16kOutputText
- addGpt4_8kInputText
- addGpt4_8kOutputText
- addGpt4_32kInputText
- addGpt4_32kOutputText
- addAda_v2Text
Counting based on tokens
- addGpt3_4kInputTokenCount
- addGpt3_4kOutputTokenCount
- addGpt3_16kInputTokenCount
- addGpt3_16kOutputTokenCount
- addGpt4_8kInputTokenCount
- addGpt4_8kOutputTokenCount
- addGpt4_32kInputTokenCount
- addGpt4_32kOutputTokenCount
- addAda_v2TokenCount
LangChain Callback
- TokenCounter3_4kCallback
- TokenCounter3_16kCallback
- TokenCounter4_8kCallback
- TokenCounter4_32kCallback
Available Properties
Get number of tokens
Get price in USD
Retrieve usage statements
Supported Currency Properties
Contributing
- Fork it!
- Create your feature branch:
git checkout -b my-new-feature
- Add your changes:
git add .
- Commit your changes:
git commit -am 'Add some feature'
- Push to the branch:
git push origin my-new-feature
- Submit a pull request 😎
Contact us
Twitter:moons_dev
Discord:moons14
Authors
moons14 - moons-14
Download Details:
Author: moons-14
Source Code: https://github.com/moons-14/token-counter
License: MIT License
#gpt #token