@anysphere/tiktoken-node
TypeScript icon, indicating that this package has built-in type declarations

0.1.27 • Public • Published

@anysphere/tiktoken-node

We use our own fork for now because we are making changes that may not be useful to everyone. For example, we add support for special tokens, and we also add support for running tokenization asynchronously with the computation happening on a different thread.

Readme

Keywords

none

Package Sidebar

Install

npm i @anysphere/tiktoken-node

Weekly Downloads

9

Version

0.1.27

License

none

Unpacked Size

28.5 kB

Total Files

11

Last publish

Collaborators

  • anysphere