v1.1.1
v1.1.1
Improvements
- Multi-language tokenizer with Unicode & Regex support (#284) — significantly improves CJK and non-Latin script handling
Fixes
- Gemini Batch API now correctly passes project parameter to Vertex AI (#286)
What's New
Improvements
- Multi-language tokenizer support with Unicode & Regex (#284)
- Significantly improves support for CJK (Chinese, Japanese, Korean) languages
- Better handling of non-Latin scripts
Bug Fixes
- Fix Gemini Batch API project parameter passing (#286)
- Resolves "Required parameter: project" error when using Vertex AI
Full Changelog: https://github.com/google/langextract/compare/v1.1.0...v1.1.1