torus

🔥 BM25 Full-Text Search is now available via the new Torus.bm25/5 macro

BM25 is a modern ranking algorithm that generally provides superior relevance scoring compared to traditional TF-IDF (used by full_text/5). This integration uses the pg_textsearch extension by Timescale.

**See it in act...

Fixes

• Torus.Embeddings.OpenAI now correctly parses updated response structure from OpenAI API.
• exla nx backend is now correctly supported in Torus.Embeddings.LocalNxServing.

New 🔥

• New demo page where you can explore different search types and their options. It also includes semantic search, so if you're hesitant - go check it out!
• Other documentation improvements

Fixes

• Correctly handles order: :none in Torus.semantic/5 search.
• Updates Torus.Embeddings.HuggingFace to point to the updated feature extraction endpoi...

• Adds Torus.Embeddings.Gemini to support Gemini embeddings.
• Extends semantic search docs on how to stack embedders
• Adds :distance_key option to Torus.semantic/5 to allow selecting distance key to the result map. Later on we'll rely on this to support hybrid search.
• Correctly swaps > and < operators for pre-filtering when changing order in Torus.semantic/5 search.

• Similarity search type now defaults to :word_similarity instead of similarity.
• Possible similarity/5 search types are updated to be prefixed with similarity to replicate 1-1 these in pg_trgm extension.

Torus.similarity(query, [p], [p.title], "hoggwarrds", type: :word_similarity)

• Now all Torus functions have a section for optimization