OpenAI: GPT-3.5 Turbo (batch)
openai/gpt-3.5-turbo:batch
GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.
Modalities
In / Out Price
$0.25 / $0.75 per 1M
Context
16K
Released
May 28, 2023
Knowledge Cutoff
Sep 2021
Providers
Different carriers host the same model. Reroute routes each request to the best one on price and uptime, and fails over to the next if a carrier goes down.
| Provider | Context | Input /M | Output /M | Cache read /M | Latency | Throughput | Uptime |
|---|---|---|---|---|---|---|---|
| OpenAI | 16K | $0.25 | $0.75 | — | — | — | — |