DeepSeek · DeepSeek R1

DeepSeek R1 Distill Qwen 32B AWQ

Name: Serve DeepSeek R1 Distill Qwen 32B AWQ on Badgr
Brand: Badgr
Availability: InStock

Unverified · community-discovered, not yet reviewed

DeepSeek R1 Distill Qwen 32B is a 32B reasoning and chat model available through supported Badgr execution routes.

Last validated or meaningfully updated: 2026-07-27

ChatReasoningLong context

Availability

Not yet Badgr AI API

Not currently validated

Not yet Dedicated endpoint

Not currently validated

Not yet Custom GPU deployment

Not currently validated

Deployment profile

Architecture: Qwen2ForCausalLM
Licence: MIT
Minimum VRAM: ~27GB
Context: 128K tokens

Recommended: L40S 48GB. VRAM is an estimate and increases with context, cache, concurrency, and runtime overhead.

GPU deployment scenarios

Estimated from parameter count and quantisation. Will switch to “Verified by Badgr” once a real run backs a tier.

Testing

L40S 48GB

Short context, low concurrency

Small production

A100 80GB

8K context, 1-4 concurrent requests

Higher throughput

H100 80GB

32K context, continuous batching

Large production

L40S 48GB

Higher concurrency

Estimated — multimodal inputs, long context, and concurrency all increase real VRAM use beyond this estimate.

Also runs well on A100 80GB, H100 80GB. Available in United States, Europe, Asia Pacific.

Serving compatibility

Runtime	Status	Notes
vLLM	Estimated	Used for Badgr dedicated endpoints
Transformers	Unknown	Basic fallback
llama.cpp	Requires GGUF conversion	No GGUF weights found in repo
SGLang	Unknown	Not evaluated
TensorRT-LLM	Unknown	Conversion may be required
TGI	Unknown	Not evaluated

Estimated pricing

Provider estimate: cold start

3–6 min

Provider estimate: endpoint cost

$0.75 – $0.86/hr

Idle cost

$0 when stopped

Per-token throughput cost is not shown here: Badgr has not benchmarked this model yet, and this page does not display figures it cannot back with real data.