Unclaimed project
Are you a maintainer of text-embeddings-inference? Claim this project to take control of your public changelog and roadmap.
Changelog
A blazing fast inference solution for text embeddings models
max_input_length is bigger than max-batch-tokens by @kozistr in https://github.com/huggingface/text-embeddings-inference/pull/725modules.json for Dense modules in local models by @alvarobartt...Since Text Embeddings Inference (TEI) v1.7.0, Intel MKL support had been broken due to changes in the candle dependency. Neither static-linking nor dynamic-linking worked correctly, which caused models using Intel MKL on CPU to fail with errors such as: "Intel oneMKL ERROR: Parameter 13 was incorrect on entry to SGEMM".
Starting with v1.8.2, this issue ha...
Today, Google releases EmbeddingGemma, a state-of-the-art multilingual embedding model perfect for on-device use cases. Designed for speed and efficiency, the model features a compact size of 308M parameters and a 2K co...
Qwen3 was not working fine on CPU / MPS when sending batched requests on FP16 precision, due to the FP32 minimum value downcast (now manually set to FP16 minimum value instead) leading to null values, as well as a missing to_dtype call on the attention_bias when working with batches.