Important: This documentation covers Yarn 1 (Classic).

For Yarn 2+ docs and migration guide, see yarnpkg.com.

keywords: tiktoken

found 25 packages in 3ms

tokenx266.2kMIT1.1.0

Fast and lightweight token estimation for any LLM without requiring a full tokenizer

johannschopplich4 months agoai, llm, token, tokenizer

gpt-tokens87.4kMIT1.3.14

Calculate the token consumption and amount of openai gpt message

Cainier8 months agogpt, chatGPT, openai, tiktoken

openai-tokens591MIT2.3.6

A service for calculating, managing, truncating openai prompt tokens

mrsteele12 months agoopenai, gpt, chatGPT, token

tiktokend231MIT1.0.2

High-level binding to tiktoken-rs for Node.js and browsers

twliteabout 2 months agoopenai, tokenizer, tiktoken-rs, tiktoken

tiktokend-freebsd-x64222MIT1.0.2

High-level binding to tiktoken-rs for Node.js and browsers

twliteabout 2 months agoopenai, tokenizer, tiktoken-rs, tiktoken

Packages

Lightweight debugging utility for Node.js and the browser

debug, log, debugger

Lodash modular utilities.

modules, stdlib, util

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

querystring, qs, query, url

Higher-order functions and common patterns for asynchronous code

async, callback, module, utility

babel babel-core

Babel compiler core.

6to5, babel, classes, const