❤

npm

nai-js-tokenizer

1.0.1 • Public • Published a year ago

The BPE tokenizer used for NovelAI frontend.

Readme

Keywords

Package Sidebar

Install

npm i nai-js-tokenizer

Repository

github.com/NovelAI/nai-js-tokenizer

Homepage

github.com/NovelAI/nai-js-tokenizer

Weekly Downloads

38

Version

1.0.1

License

MIT

Unpacked Size

17.3 kB

Total Files

4

Last publish

a year ago

Collaborators

Try on RunKit

Report malware