tiktoken-go

What's Changed

• feat: support for gpt-4.1 and gpt-4.5 models by @kuzminT in https://github.com/pkoukk/tiktoken-go/pull/61
• Removes deprecated methods by @kuzminT in https://github.com/pkoukk/tiktoken-go/pull/62
• use rlock when getEncoding by @justadogistaken in https://github.com/pkoukk/tiktoken-go/pull/59

New Contributors

• @kuzminT made their first contribution in https://github....

What's Changed

• feat: add support for latest embedding models by @matthiasthomas in https://github.com/pkoukk/tiktoken-go/pull/43
• feat: support o200k_base (gpt-4o) by @WqyJh in https://github.com/pkoukk/tiktoken-go/pull/47

New Contributors

• @matthiasthomas made their first contribution in https://github.com/pkoukk/tiktoken-go/pull/43
• @WqyJh made their first contribution in https...

add custom constructor

Fix the issue of excessive memory consumption when initializing Encoding with multiple goroutines.

Allow set bpe loader