Qwen · Qwen 2.5 Coder

Qwen 2.5 Coder 3B Instruct

Qwen 2.5 Coder 3B Instruct is a 3B code-generation and chat model available through supported Badgr execution routes.

Last validated or meaningfully updated: 2026-07-27

ChatCodingLong contextEdge-capableFine-tunable

✓ Verified by Badgr

Last verified 2026-09-30

badgr serve Qwen/Qwen2.5-Coder-3B-Instruct --max-cost 1
Provider
RunPod
GPU
NVIDIA GeForce RTX 3090
Time to verified
163.2s
Deployment
dep-3d0ef1b04f
  • ✓ vLLM started
  • ✓ 1-token /v1/completions request returned HTTP 200
  • ✓ final_state = VERIFIED
  • ✓ teardown completed
Raw evidence
verify_command model=Qwen/Qwen2.5-Coder-3B-Instruct ok=True
final_state=VERIFIED failure_class=None provider=runpod providers_tried=1 spend_usd=0.0000 elapsed=163.2s

Run from Badgr's local development environment. Documents that this deployment path works end-to-end for this model.

Availability

✓ Badgr AI API

Available through Badgr

✓ Dedicated endpoint

Available through Badgr

✓ Custom GPU deployment

Available through Badgr

Deployment profile

Architecture
Qwen2ForCausalLM
Licence
Qwen Research License
Minimum VRAM
~10GB
Context
32K tokens

Recommended: RTX 4090 24GB. VRAM is an estimate and increases with context, cache, concurrency, and runtime overhead.

Model identity

Base model
Qwen/Qwen2.5-Coder-3B
Languages
en
Updated
1 years ago
HuggingFace revision
488639f1ff

Popularity and trust

Downloads (last month)

560.3K

Likes

130

Spaces using this model

100

Files and formats

Weight formats

Safetensors

Repository files

12

Tokenizer

BPE

Chat template

Available

GPU deployment scenarios

Estimated from parameter count and quantisation. This model's one verified real run used NVIDIA GeForce RTX 3090, which isn't one of the tiers below.

Testing

RTX 4090 24GB

Short context, low concurrency

Small production

L40S 48GB

8K context, 1-4 concurrent requests

Higher throughput

A100 80GB

32K context, continuous batching

Large production

RTX 4090 24GB

Higher concurrency

Estimated — multimodal inputs, long context, and concurrency all increase real VRAM use beyond this estimate.

Also runs well on L40S 48GB, A100 40GB. Available in United States, Europe.

Serving compatibility

RuntimeStatusNotes
vLLMVerified by BadgrConfirmed by a real badgr serve run (deployment dep-3d0ef1b04f)
TransformersDeclared by sourceBasic fallback
llama.cppRequires GGUF conversionNo GGUF weights found in repo
SGLangUnknownNot evaluated
TensorRT-LLMUnknownConversion may be required
TGIUnknownNot evaluated

Call this model through Badgr

curl https://aibadgr.com/v1/chat/completions \
  -H "Authorization: Bearer $BADGR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"Qwen/Qwen2.5-Coder-3B-Instruct","messages":[{"role":"user","content":"Hello"}]}'

Ready-to-run Badgr configurations

Quick test

badgr serve Qwen/Qwen2.5-Coder-3B-Instruct --max-cost 2

Validated dedicated endpoint command

badgr serve Qwen/Qwen2.5-Coder-3B-Instruct --gpu RTX 4090 --max-cost 10

Advanced configuration (defaults to automatic)

  • Runtime
  • Quantisation
  • GPU and GPU count
  • Context length
  • Maximum concurrency
  • Region
  • Maximum hourly spend
  • Persistent or capped runtime

Estimated pricing

Provider estimate: cold start

2–5 min

Provider estimate: endpoint cost

$0.44 – $0.45/hr

Idle cost

$0 when stopped

Per-token throughput cost is not shown here: Badgr has not benchmarked this model yet, and this page does not display figures it cannot back with real data.

Recommended Badgr routes

RTX 4090 24GB · United States

Available

from $0.44/hr

24GB VRAM/GPU

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: just now

RTX 4090 24GB · United States

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

RTX 4090 24GB · United States

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

Known limitations

  • Memory use increases with context length and concurrency.

Related troubleshooting