Meta · OPT
OPT 125M
Verified by Badgr · ServeOPT 125M is a 0.125B chat and text-generation model available through supported Badgr execution routes.
Last validated or meaningfully updated: 2026-10-10
✓ Verified by Badgr · vLLM · Serve
Last verified 2026-10-10
badgr serve facebook/opt-125m --max-cost 1 --vllm-arg --max-model-len=512- GPU
- NVIDIA GeForce RTX 4090Reported by the provider, not confirmed inside the container
- Time to verified
- 221s
- Deployment
- dep-486ba72eef
- ✓ vLLM started
- ✓ 1-token /v1/completions request returned HTTP 200
- ✓ final_state = VERIFIED
- ✓ teardown completed
Reproduction target for vllm#60875. On this endpoint a /v1/completions request with use_beam_search + echo + logprobs returned HTTP 500, while beam search alone and echo + logprobs alone each returned 200. Badgr's response check marks that 500 as not verified (see the receipt).
GitHub issue this run was for: vllm-project/vllm#60875
Raw evidence
final_state=VERIFIED failure_class=None providers_tried=1/10 teardown_confirmed=False spend_usd=0.0236
Run from Badgr's local development environment. Documents that this deployment path works end-to-end for this model.
Availability
Not yet Badgr AI API
Not currently validated
✓ Dedicated endpoint
Available through Badgr
✓ Custom GPU deployment
Available through Badgr
Deployment profile
- Architecture
- OPTForCausalLM
- Licence
- Other (OPT license)
- Minimum VRAM
- ~5GB
- Context
- 2K tokens
Recommended: RTX 4090 24GB. VRAM is an estimate and increases with context, cache, concurrency, and runtime overhead.
Model identity
- Languages
- en
- Updated
- 3 years ago
- HuggingFace revision
- 27dcfa74d3
Popularity and trust
Downloads (last month)
6.0M
Likes
324
Spaces using this model
100
Files and formats
Weight formats
PyTorch bin
Repository files
12
Tokenizer
BPE
Chat template
Available
GPU deployment scenarios
Estimated from parameter count and quantisation. This model's one verified real run was reported by the provider as NVIDIA GeForce RTX 4090, which isn't one of the tiers below.
Testing
RTX 4090 24GB
Short context, low concurrency
Small production
L40S 48GB
8K context, 1-4 concurrent requests
Higher throughput
A100 80GB
32K context, continuous batching
Large production
RTX 4090 24GB
Higher concurrency
Estimated — multimodal inputs, long context, and concurrency all increase real VRAM use beyond this estimate.
Also runs well on L40S 48GB, A100 40GB. Available in United States, Europe.
Serving compatibility
| Runtime | Status | Notes |
|---|---|---|
| vLLM | Verified by Badgr | Confirmed by a real badgr serve run (deployment dep-486ba72eef) |
| Transformers | Declared by source | Basic fallback |
| llama.cpp | Requires GGUF conversion | No GGUF weights found in repo |
| SGLang | Unknown | Not evaluated |
| Ollama | Unknown | Not evaluated |
| Diffusers | Unknown | Not evaluated |
| PyTorch | Unknown | Not evaluated |
| TensorRT-LLM | Unknown | Conversion may be required |
| TGI | Unknown | Not evaluated |
Ready-to-run Badgr configurations
Quick test
badgr serve facebook/opt-125m --max-cost 2Validated dedicated endpoint command
badgr serve facebook/opt-125m --gpu RTX 4090 --max-cost 10Advanced configuration (defaults to automatic)
- Runtime
- Quantisation
- GPU and GPU count
- Context length
- Maximum concurrency
- Region
- Maximum hourly spend
- Persistent or capped runtime
Estimated pricing
Provider estimate: cold start
2–5 min
Provider estimate: endpoint cost
$0.44 – $0.45/hr
Idle cost
$0 when stopped
Per-token throughput cost is not shown here: Badgr has not benchmarked this model yet, and this page does not display figures it cannot back with real data.
Recommended Badgr routes
RTX 4090 24GB · United States
Availablefrom $0.44/hr
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: just now
RTX 4090 24GB · United States
Estimatedstarting from $0.45/hr
Badgr estimated starting price
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: Live marketplace price not available yet
RTX 4090 24GB · United States
Estimatedstarting from $0.45/hr
Badgr estimated starting price
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: Live marketplace price not available yet
RTX 4090 24GB · Europe
Estimatedstarting from $0.45/hr
Badgr estimated starting price
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: Live marketplace price not available yet
RTX 4090 24GB · Europe
Estimatedstarting from $0.45/hr
Badgr estimated starting price
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: Live marketplace price not available yet
RTX 4090 24GB · Europe
Estimatedstarting from $0.45/hr
Badgr estimated starting price
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: Live marketplace price not available yet
Known limitations
- Memory use increases with context length and concurrency.