AnythingLLM v1.8.5 is live

Notable Changes

Mobile support

Now, currently under Experimental features, you can connect the AnythingLLM Mobile App - Android Beta to your instance to seamlessly blend an on-device and off-device experience. Leverage your instance Agent Skills and flows all within a single unified interface!

Chat with documents has been overhauled

https://github.com/user-attachments/assets/0e4ab18d-fb58-480a-94f5-907664dd8f3f

When we first built AnythingLLM, the average context window was 4K - hardly anything to fit a full document. So we decided to always be RAG first. This has its drawbacks since RAG is semantically dependent on asking questions about content in the document. This leads to poor results for "Summarize this document," only to be told by the document, "what are you talking about".

Well, now we have the best of both worlds. Documents are scoped to a workspace thread & user and we will attempt to use the full document text when possible and your model can support it. If you overflow this amount, we can then ask you to embed the document so you can unlock that long-term memory.

You can also easily manage and see your context window to remove files that are no longer relevant, but retain the conversation history.

You can also still embed files directly in the workspace file manager too :)

What's Changed

• Add model field parameter for generic OpenAI TTS by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4171
• Clear cached docs on text splitter changes by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4163
• Update BARE_METAL.md by @buraktopalyn in https://github.com/Mintplex-Labs/anything-llm/pull/4175
• run jest by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4177
• Moonshot AI LLM & agent provider by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4178
• Fix multimodal chats via openai compat api by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4135
• Native Embedder model selection (incl: Multilingual support) by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/3835
• fix: correct some typos and grammatical errors in translation strings and index.jsx by @antonharder in https://github.com/Mintplex-Labs/anything-llm/pull/4195
• Modify the PostgreSQL SQL connector to support querying tables from schemas other than the default public schema. by @romanwu10 in https://github.com/Mintplex-Labs/anything-llm/pull/4202
• Fix app version metrics endpoint by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4209
• Update writeToServerDocuments to take config object by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4213
• [Chore]: sendCommand non positional call signature by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4218
• Update check for validFuncCall to only check required args and for undefined options by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4214
• fix: API export-chats endpoint function import error by @naaa760 in https://github.com/Mintplex-Labs/anything-llm/pull/4220
• STT append spoken text by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4216
• Mobile sync support by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4173
• Add custom JWT TTL by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4234
• Fix password hint text by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4235
• Update common.js Hebrew language update by @start-life in https://github.com/Mintplex-Labs/anything-llm/pull/4241
• docs(i18n): Complete missing Spanish translations by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4263
• feat: add Romanian translation by @dpvue in https://github.com/Mintplex-Labs/anything-llm/pull/4247
• Workspace Chat with documents overhaul by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4261
• feat: Add Exa as a Search Provider by @naaa760 in https://github.com/Mintplex-Labs/anything-llm/pull/4258
• Update common.js by @dpvue in https://github.com/Mintplex-Labs/anything-llm/pull/4278
• Chroma Cloud vector db provider by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4273
• Update Security UI to match all other Settings by @AshikaAnand12 in https://github.com/Mintplex-Labs/anything-llm/pull/4274

New Contributors

• @buraktopalyn made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4175
• @antonharder made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4195
• @romanwu10 made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4202
• @naaa760 made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4220
• @start-life made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4241
• @dpvue made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4247
• @AshikaAnand12 made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4274

Full Changelog: https://github.com/Mintplex-Labs/anything-llm/compare/v1.8.4...v1.8.5