v1.8.2
🔧 Fixed Intel MKL Support
Since Text Embeddings Inference (TEI) v1.7.0, Intel MKL support had been broken due to changes in the candle dependency. Neither static-linking nor dynamic-linking worked correctly, which caused models using Intel MKL on CPU to fail with errors such as: "Intel oneMKL ERROR: Parameter 13 was incorrect on entry to SGEMM".
Starting with v1.8.2, this issue has been resolved by fixing how the intel-mkl-src dependency is defined. Both features, static-linking and dynamic-linking (the default), now work correctly, ensuring that Intel MKL libraries are properly linked.
This issue occurred in the following scenarios:
- Users installing
text-embeddings-routerviacargowith the--feature mklflag. Althoughdynamic-linkingshould have been used, it was not working as intended. - Users relying on the CPU
Dockerfilewhen running models without ONNX weights. In these cases, Safetensors weights were used withcandleas backend (with MKL optimizations), instead of .