This release addresses several issues when working with multiple prompts simultaneously and introduces comprehensive documentation!
What's New:
Official Documentation: Our new documentation is now available!
Bug Fixes:
UI Responsiveness: Fixed an issue where the interface would become unresponsive when sending multiple prompts
UI Configuration: Configuration changes now apply immediately without requiring application restart
Smarter Rate Limiting: Implemented centralized rate limiting that applies individually to each provider, creating a smoother experience when sending multiple prompts to different models simultaneously
These improvements should make your workflow more efficient and reliable when working with multiple prompts across different models. Enjoy!
What's Changed
refactor: Move Cellm.Models to shared project by @kaspermarstal in https://github.com/getcellm/cellm/pull/111
docs: Improve README by @kaspermarstal in https://github.com/getcellm/cellm/pull/112
feat: Add retry mechanism to Ollama and OpenAiCompatible providers by @kaspermarstal in https://github.com/getcellm/cellm/pull/114
fix: Prompt not cached because cache key length sometimes too long by @kaspermarstal in https://github.com/getcellm/cellm/pull/115
refactor: Add IChatClient with transient lifetime for all providers by @kaspermarstal in https://github.com/getcellm/cellm/pull/116
docs: Add documentation by @kaspermarstal in https://github.com/getcellm/cellm/pull/117
docs: Tighten up README, link to docs by @kaspermarstal in https://github.com/getcellm/cellm/pull/118
docs: Update R2 domain by @zachasme in https://github.com/getcellm/cellm/pull/119
fix: Unblock UI thread when sending many prompts by @kaspermarstal in https://github.com/getcellm/cellm/pull/120
refactor: Apply rate limit across providers by @kaspermarstal in https://github.com/getcellm/cellm/pull/121
fix: Increase default rate limit by @kaspermarstal in https://github.com/getcellm/cellm/pull/125
New Contributors
@zachasme made their first contribution in https://github.com/getcellm/cellm/pull/119
Full Changelog: https://github.com/getcellm/cellm/compare/v0.1.1...v0.2.0