v6.0.0

Tool Calling & Advanced Feature Support

Sree
SreeAuthor

This update significantly expands the API's capabilities by adding support for tool calling (function calling), allowing models to interact with external tools and functions while enhancing platform reliability and feature validation.

New Features

3
  • Tool Calling Support: Implemented full support for tools and tool_choice parameters in the Chat Completions API endpoint for providers that support function calling.
  • Advanced Feature Validation: Added comprehensive validation layer to check if models support specific features (vision, function_calling) before processing requests.
  • Enhanced API Schema: Updated API schemas to include tool_calls and tool_call_id attributes, aligning with industry standards for function calling.

Tool Calling Capabilities

3
  • Function Execution: Models can now execute external functions and tools based on user requests.
  • Tool Selection: Users can specify tool preferences and automatic tool selection strategies.
  • Response Integration: Tool execution results are seamlessly integrated into model responses.

Provider Support

4
  • Provider 1: Full tool calling support with comprehensive function execution capabilities.
  • Provider 3: Enhanced tool calling with improved parameter handling and response formatting.
  • Provider 5: Advanced tool integration with specialized function libraries.
  • Provider 6: Native tool calling support with reasoning-enhanced function execution.

Platform Enhancements

4
  • Feature Validation: Enhanced validation prevents unsupported feature usage with clear error messages.
  • Streaming Reliability: Improved streaming response handling with better error recovery mechanisms.
  • Error Messages: Added specific error messages for feature compatibility issues.
  • API Documentation: Updated comprehensive documentation for tool calling capabilities and usage patterns.

Model Catalog Expansion

3
  • Specialized Models: Added models with enhanced tool calling and function execution capabilities.
  • Vision Models: Expanded vision-enabled model catalog with improved multimodal processing.
  • Reasoning Models: Enhanced reasoning capabilities for complex problem-solving scenarios.

Bug Fixes

2
  • Streaming Issues: Resolved intermittent streaming disconnections and incomplete tool responses.
  • Parameter Validation: Fixed validation issues with complex tool parameter structures.

Developer Experience

2
  • Clear Documentation: Comprehensive examples and usage patterns for tool calling implementation.
  • Error Handling: Improved error messages and debugging information for tool execution failures.