Unclaimed project
Are you a maintainer of sentencepiece? Claim this project to take control of your public changelog and roadmap.
Changelog
Unsupervised text tokenizer for Neural Network-based text generation.
-DSPM_DISABLE_EMBEDDED_DATA=ON). This reduces the runtime size by approximately 1-2 MB. This mode is enabled to build python wheels. The rules are loaded as the data package.