2.3.4
What's Changed
Small fix for KV cache management, which cause some issues with hybrid and recurrence models
- if KV rm fails, we should clear the whole cache by @ngxson in https://github.com/ngxson/wllama/pull/188
Full Changelog: https://github.com/ngxson/wllama/compare/2.3.3...2.3.4