v3.10.1

Fixes

• Reasoning detection now works on reasoning/instruct models without explicit thinking tags
• Runtime tracing can be enabled on first request (trace buffer initialization fix)
• LTX-2 video generation: fixed API calls and added GGUF support

Features

• OpenResponses now supports reasoning blocks
• Automatic thinking/reasoning capability detection from backend (no manual c...

🎉 LocalAI 3.10.0 Release! 🚀

LocalAI 3.10.0 is big on agent capabilities, multi-modal support, and cross-platform reliability.

We've added native Anthropic API support, launched a new **Video Generation UI...

Xmas-release :santa: LocalAI 3.9.0! 🚀

LocalAI 3.9.0 is focused on stability, resource efficiency, and smarter agent workflows. We've addressed critical issues with model loading, improved system resource m...

Welcome to LocalAI 3.8.0 !

LocalAI 3.8.0 focuses on smoothing out the user experience and exposing more power to the user without requiring restarts or complex configuration files. This release introduces a new onboardin...

Welcome to LocalAI 3.7.0 :wave:

This release introduces Agentic MCP support with full WebUI integration, a brand-new neutts TTS backend, fuzzy model search, long-form TTS chunking for chatterbox, and a c...

What's Changed

Bug fixes :bug:

• fix: reranking models limited to 512 tokens in llama.cpp backend by @jongames in https://github.com/mudler/LocalAI/pull/6344

Exciting New Features 🎉

• feat(kokoro): add support for l4t devices by @mudler in https://github.com/mudler/LocalAI/pull/6322
• feat(cha...

What's Changed

Bug fixes :bug:

• fix(python): make option check uniform across backends by @mudler in https://github.com/mudler/LocalAI/pull/6314

Other Changes

• chore: :arrow_up: Update ggml-org/whisper.cpp to 44fa2f647cf2a6953493b21ab83b50d5f5dbc483 by @localai-bot in https://github.com/mudl...

What's Changed

Bug fixes :bug:

• fix(diffusers): fix float detection by @mudler in https://github.com/mudler/LocalAI/pull/6313

🧠 Models

• chore(model gallery): add mistralai_magistral-small-2509 by @mudler in https://github.com/mudler/LocalAI/pull/6309
• chore(model gallery): add impish_qwen_1...

What's Changed

👒 Dependencies

• Revert "feat(nvidia-gpu): bump images to cuda 12.8" by @mudler in https://github.com/mudler/LocalAI/pull/6303

Other Changes

• docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/6305
• chore: :arrow_up: U...

What's Changed

Bug fixes :bug:

• fix: make sure to turn down all processes on exit by @mudler in https://github.com/mudler/LocalAI/pull/6200
• fix(p2p): automatically install llama-cpp for p2p workers by @mudler in https://github.com/mudler/LocalAI/pull/6199
• Point to LocalAI-examples repo for llav...