Read the speed and the reliability of each model
GET/api/me/requests/performance
Returns, for a window and for each model, the answered share, the p50, p90, p95 and p99 time of the answered calls, the p50 and p95 time to the first token, the speed in tokens per second, the cost in cost_usd and in cost_millicents, and total, which is how many models the answer holds. answered is the number of answered calls and cost_usd is the cost in United States dollars, one hundred thousandth of which is one millicent. A time to the first token and a speed are null when no answered call was streamed, and speed_calls says how many calls they cover.
Responses
- 200
- 401
The report of each model, with total.
The session of the person or the virtual key is missing, or it is not valid.