Models & Capabilities
Available Models
| Model Name | Context Window | Input Cost (1M) | Output Cost (1M) | Capabilities | |
|---|---|---|---|---|---|
IBM Granite 4.0 H Microgranite | 128,000 | $0.017 | $0.11 | text | |
BGE Small EN v1.5bge | 128,000 | $0.02 | $0.00 | text | |
BGE Large EN v1.5bge | 128,000 | $0.20 | $0.00 | text | |
BGE Reranker Basebge | 128,000 | $0.0031 | $0.00 | text | |
BGE M3bge | 128,000 | $0.012 | $0.00 | text | |
BGE Base EN v1.5bge | 128,000 | $0.067 | $0.00 | text | |
PLaMo Embedding 1Bplamo | 128,000 | $0.019 | $0.00 | text | |
DeepSeek R1 Distill Qwen 32Bdeepseek-thinking | 128,000 | $0.50 | $4.88 | text | |
BART Large CNNbart | 128,000 | $0.00 | $0.00 | text | |
Mistral 7B Instruct v0.1mistral | 128,000 | $0.11 | $0.19 | text | |
MyShell MeloTTSmelotts | 128,000 | $0.00 | $0.00 | text | |
Pipecat Smart Turn v2smart-turn | 128,000 | $0.00 | $0.00 | text | |
Gemma 3 12B ITgemma | 128,000 | $0.35 | $0.56 | text | |
QwQ 32Bqwen | 128,000 | $0.66 | $1.00 | text | |
Qwen3 30B A3B FP8qwen | 128,000 | $0.051 | $0.34 | text | |
Qwen 2.5 Coder 32B Instructqwen | 128,000 | $0.66 | $1.00 | text | |
Qwen3 Embedding 0.6Bqwen | 128,000 | $0.012 | $0.00 | text | |
Llama 3.1 8B Instruct FP8llama | 128,000 | $0.15 | $0.29 | text | |
Llama 3 8B Instruct AWQllama | 128,000 | $0.12 | $0.27 | text | |
Llama 3.1 8B Instruct AWQllama | 128,000 | $0.12 | $0.27 | text | |
Llama 4 Scout 17B 16E Instructllama | 128,000 | $0.27 | $0.85 | text | |
Llama 3.2 11B Vision Instructllama | 128,000 | $0.049 | $0.68 | text | |
Llama 3.2 3B Instructllama | 128,000 | $0.051 | $0.34 | text | |
Llama Guard 3 8Bllama | 128,000 | $0.48 | $0.03 | text | |
Llama 3.2 1B Instructllama | 128,000 | $0.027 | $0.20 | text | |
Llama 3.3 70B Instruct FP8 Fastllama | 128,000 | $0.29 | $2.25 | text | |
Llama 3.1 8B Instructllama | 128,000 | $0.28 | $0.83 | text | |
M2M100 1.2Bm2m | 128,000 | $0.34 | $0.34 | text | |
Llama 2 7B Chat FP16llama | 128,000 | $0.56 | $6.67 | text | |
Llama 3 8B Instructllama | 128,000 | $0.28 | $0.83 | text | |
Mistral Small 3.1 24B Instructmistral-small | 128,000 | $0.35 | $0.56 | text | |
Deepgram Aura 2 (ES)aura | 128,000 | $0.00 | $0.00 | text | |
Deepgram Nova 3nova | 128,000 | $0.00 | $0.00 | text | |
Deepgram Aura 2 (EN)aura | 128,000 | $0.00 | $0.00 | text | |
GPT OSS 120B | 128,000 | $0.35 | $0.75 | text | |
GPT OSS 20B | 128,000 | $0.20 | $0.30 | text | |
IndicTrans2 EN-Indic 1Bindictrans | 128,000 | $0.34 | $0.34 | text | |
DistilBERT SST-2 INT8distilbert | 128,000 | $0.026 | $0.00 | text | |
Gemma SEA-LION v4 27B ITgemma | 128,000 | $0.35 | $0.56 | text |
Uptime History
System Status
100% Uptime
116ms Avg. Latency
30 minutes agoNow
Cost Estimator
Estimated Monthly Cost$0.072
1,000,000@ $0.017 / 1M
010M
500,000@ $0.11 / 1M
05M