v2.13.0

Implemented Tool Calling and Enhanced Feature Validation

Sree
SreeAuthor

This release significantly expands the API's capabilities by adding support for tool calling (function calling), allowing models to interact with external tools and functions. We've also hardened our validation to ensure requests align with the features of the selected model.

New Features

2
  • Implemented full support for the tools and tool_choice parameters in the Chat Completions API endpoint for providers that support function calling.
  • Added a new validation layer to check if a model supports specific features (e.g., vision, function_calling) before processing a request, returning a clear error if there is a mismatch.

Improvements

3
  • API schemas have been updated to include tool_calls and tool_call_id attributes, aligning our structure with industry standards for function calling.
  • Added new, specific error messages for scenarios where a user attempts to use vision or tools with a model that does not support those features.
  • Provider adapters for chat and streaming responses have been enhanced to correctly process and return tool_calls in the API response.