0.1.0 • Published 2 years ago
huggingface-tokenizers-bindings v0.1.0
tokenizers-js
js-like interface on top of tokenizers-wasm.
The main inconvenience of binding rust to wasm is that rust traits can't be converted to js class inheritance. So this is a wrapper around the wasm bindings to get a more js-like API.
0.1.0
2 years ago