Chinese-tokenizer | npm.io

Tokenizes utterances that contain a mix of English and Chinese words.

tokenizer chinese english language tokenize nltk nlp natural-language-processing chinese-tokenizer contains-chinese

1.1.0 • Published 7 years ago