NVIDIA Nemotron 3.5 Lightning is an open mixture-of-experts model from NVIDIA, with 3B active parameters out of 30B total. It is suited for high-throughput agentic workloads and specialized tasks that...
Different carriers host the same model. Reroute routes each request to the best one on price and uptime, and fails over to the next if a carrier goes down.
| Provider | Context | Input /M | Output /M | Cache read /M | Latency | Throughput | Uptime |
|---|---|---|---|---|---|---|---|
| 262K | $0.039 | $0.18 | $0.0195 | — | — | 100.00% | |
| 262K | $0.049 | $0.14 | $0.0245 | — | — | 100.00% | |
| 262K | $0.06 | $0.16 | $0.03 | — | — | 100.00% | |
| 262K | $0.07 | $0.20 | $0.04 | — | — | 100.00% | |
| 262K | $0.07 | $0.20 | $0.04 | — | — | 100.00% |