@agent Overhaul & streaming ⚡️️

When anythingllm first launched, the word "agent" was not in the vocabulary of the LLM world. Agents are quickly becoming the standard for building AI applications and also the core experience for interacting with LLMs.

For too long, due to the complexity of building agents, spotty tool call support, models that can't even use tools and more nerd stuff, we often had to settle an experience that was not really fun to use since 99% of the time you were just looking at loading spinners waiting for the response.

The new agent experience is now here

Streams tool calls and responses in real time (all providers, all models) Agents can now real-time download and ingest files from the web (eg: link to PDF, excel, csv). Anything you would use a document can be read in real time by the agent from the web.

Upcoming:

• Agent real-time API calling without agent flows
• Agent image understanding
• Agent system prompt passthrough + user context awareness
• Realtime file searching cross-platform default skill

Notable Improvements: 🚀

• All models and providers now support agentic streaming
• Microsoft Foundry Local integration
• Ephemerally scrape/download any web-resource via agent or uploader

What's Changed

• Allow default users to reorder workspaces by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4292
• Export image support for JSON and JSONL by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4359
• Fix: missing edit icon for prompts by @17ColinMiPerry in https://github.com/Mintplex-Labs/anything-llm/pull/4344
• feat(i18n): add missing Portuguese (Brazil) translations by @beckeryuri in https://github.com/Mintplex-Labs/anything-llm/pull/4328
• feat: Implement CometAPI integration for chat completions and model m… by @TensorNull in https://github.com/Mintplex-Labs/anything-llm/pull/4379
• Resize chat textarea on paste by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4369
• update save file agent text by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4389
• Added metadata parameter to document/upload, document/upload/{folderName}, and document/upload-link by @jstawski in https://github.com/Mintplex-Labs/anything-llm/pull/4342
• Add support for SIMPLE_SSO_NO_LOGIN_REDIRECT config setting by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4394
• patch folder name GET request response by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4395
• Add User-Agent header on the requests sent by Generic OpenAI providers. by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/4393
• Report sources in API responses on finalized chunk by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4396
• Allow user to specify args for chromium process so they dont need SYS_ADMIN on container. by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4397
• API request delay for Generic OpenAI embedding engine by @chaserhkj in https://github.com/Mintplex-Labs/anything-llm/pull/4317
• Enhanced Chat Embed History View by @MateKristof in https://github.com/Mintplex-Labs/anything-llm/pull/4281
• Ignore hasOwnProperty linting errors by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4406
• Migrate OpenAI LLM provider to use Responses API by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4404
• Update the timeout value on all stream-timeout providers: by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/4412
• [BUGFIX] Update Dell Pro AI Studio Default URL by @spencerbull in https://github.com/Mintplex-Labs/anything-llm/pull/4433
• Add PostgreSQL vector extension in createTableIfNotExists function by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/4430
• fix: resolve Firefox search icon overlapping placeholder text by @naaa760 in https://github.com/Mintplex-Labs/anything-llm/pull/4390

New Contributors

• @beckeryuri made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4328
• @TensorNull made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4379
• @jstawski made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4342
• @angelplusultra made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4393
• @chaserhkj made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4317
• @MateKristof made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4281
• @spencerbull made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4433
• @AoiYamada made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4442
• @vansh2408 made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4461
• @sculley made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4484
• @jaynedoezy-web made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4507
• @Guru6163 made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/4511

Full Changelog: https://github.com/Mintplex-Labs/anything-llm/compare/v1.8.5...v1.9.0