Llama 3.1 8B Pricing — $0.05/M input, $0.05/M output
NVIDIA NIM / April 2026
Input $0.05/M tokens
Output $0.05/M tokens
Context Window 128K tokens
Low-latency small model on NVIDIA NIM
Typical use cases
General-purpose inference, chat, extraction, structured output
Estimated monthly cost at scale
Assumes 50/50 input/output token split at stated daily volume.
| Daily Volume | Monthly Tokens | Estimated Monthly Cost |
|---|---|---|
| 1M tokens/day | 30M tokens | $1.50 |
| 5M tokens/day | 150M tokens | $7.50 |
| 10M tokens/day | 300M tokens | $15.00 |
vs. other NVIDIA NIM models
| Model | Input ($/M) | Output ($/M) | Context |
|---|---|---|---|
| Llama 3.1 70B | $0.35 | $0.40 | 128K |
| Mistral 7B Instruct | $0.04 | $0.04 | 32K |
Not sure if Llama 3.1 8B is the right fit for your workload? Clawback tests cheaper alternatives against your actual prompts and tells you exactly where you're overpaying.
Test if a cheaper model matches Llama 3.1 8B quality →