tensorzero

[!WARNING] Planned Deprecations

• Anthropic's structured output feature is out of beta, so the TensorZero configuration field beta_structured_outputs is now ignored and deprecated. It'll be removed in a future release.

Bug Fixes

• Fix a regression in the aws_bedrock provider that affected long-term bearer API keys.
• Fix a horizontal overflow issue for tool calls and...

Bug Fixes

• Fix a race condition in the TensorZero Autopilot UI that could disable the chat input.
• Increase timeouts for slow tool calls triggered by TensorZero Autopilot (e.g. evaluations).

& multiple under-the-hood and UI improvements!

New Features

• [Preview] TensorZero Autopilot — an automated AI engineer that analyzes LLM observability data, optimizes prompts and models, sets up evals, and runs A/B tests. Learn more → Join the waitlist →
• Support multi-turn reasoning for xAI (reasoning_content only).

_& multiple under-the-h...

[!CAUTION] Breaking Changes

• Moving forward, TensorZero will use the OpenAI API's error format ({"error": {"message": "Bad!"}) instead of TensorZero's error format ({"error": "Bad!"}) in the OpenAI-compatible endpoints.

[!WARNING] Planned Deprecations

• When using unstable_error_json with the OpenAI-compatible inference endpoint, use tensorzero_error_json...

[!CAUTION] Breaking Changes

• TensorZero will normalize the reported usage from different model providers. Moving forward, input_tokens and output_tokens include all token variations (provider prompt caching, reasoning, etc.), just like OpenAI. Tokens cached by TensorZero remain excluded. You can still access the raw usage reported by providers with include_raw_usage.

[...