v2.10.0•
Model Performance Metrics API
SreeAuthor
New Features
1
- Added
performance_metrics(latency, uptime, throughput) to the/v1/modelsAPI endpoint, providing users with valuable data for model selection.
Improvements
1
- Refactored a key backend provider to correctly handle both chat and image generation models, routing requests to the appropriate endpoints.