New
v1.5
What's Changed
- Groupwise quantisation by @HenryNdubuaku
- Speech-To-Text streaming by @jakmro
- KV Quntisation by @HenryNdubuaku
- Evals by @justinl66 @ParkiratS
- INT4 support by @HenryNdubuaku
- Rust bindings by @mrsarac
Bindings: Please check Cactus FFIs again @jakmro @mrsarac @mhayes853