New
Add dropout support
-
Add support of dropout in encoding
-
Add support of IDs ignoring for decoding
-
Fix unhandled exception on unknown
--output_type
Unclaimed project
Are you a maintainer of YouTokenToMe? Claim this project to take control of your public changelog and roadmap.
Changelog
Unsupervised text tokenizer focused on computational efficiency
Add support of dropout in encoding
Add support of IDs ignoring for decoding
Fix unhandled exception on unknown --output_type