Endpoint latency
Stored provider latency from the endpoint file, in milliseconds. Bar length is that number against the highest stored latency on this page. A longer bar is a higher latency. This is not throughput, not time to first token, and not the BFCL mean latency. A missing number stays off the chart.
Loading scores.