New
v0.1.99
Major changes
N/A
New features
N/A
Bug fixes & minor changes
- [ALL] Fixes the NaN issues in unigram model training: https://github.com/google/sentencepiece/issues/851
- [ALL] Fixes the bug in unigram loss computation: https://github.com/google/sentencepiece/issues/628
- [ALL] Fixes the minor bug in BPE token extraction algorithm: https://github.com/google/sentencepiece/issues/318
- [ALL] Increase the number of maximum threads from 128 to 1024. https://github.com/google/sentencepiece/issues/857