@bardeenai/tokenizers-wasm v0.1.6

tokenizers-wasm

WASM Module for HuggingFace Tokenizers

Building

wasm-pack build --scope bardeenai --out-name index

Publishing

wasm-pack publish --access public if publishing to NPM. For GitHub Packages, ./pre-publish && wasm-pack publish.