Mistral AI · Mistral Small

Mistral Small 24B Instruct

Name: Serve Mistral Small 24B Instruct on Badgr
Brand: Badgr
Availability: InStock

Mistral Small 24B Instruct is a 24B chat and text-generation model available through supported Badgr execution routes.

Last validated or meaningfully updated: 2026-07-27

ChatLong contextMultilingual

Serve Mistral Small 24B Instruct now Get help running this

Availability

✓ Badgr AI API

Available through Badgr

✓ Dedicated endpoint

Available through Badgr

✓ Custom GPU deployment

Available through Badgr

Deployment profile

Architecture: MistralForCausalLM
Licence: Apache-2.0
Minimum VRAM: ~52GB
Context: 32K tokens

Recommended: A100 80GB. VRAM is an estimate and increases with context, cache, concurrency, and runtime overhead.

Model identity

Base model: mistralai/Mistral-Small-24B-Base-2501
Languages: en, fr, de, es, it, pt, zh, ja, ru, ko
Updated: 1 years ago
HuggingFace revision: 9527884be6

Popularity and trust

Downloads (last month)

55.6K

Likes

964

Spaces using this model

100

Files and formats

Weight formats

Safetensors

Repository files

Chat template

Available

GPU deployment scenarios

Estimated from parameter count and quantisation. Will switch to “Verified by Badgr” once a real run backs a tier.

Testing

A100 80GB

Short context, low concurrency

Small production

H100 80GB

8K context, 1-4 concurrent requests

Higher throughput

H200 141GB

32K context, continuous batching

Large production

A100 80GB

Higher concurrency

Estimated — multimodal inputs, long context, and concurrency all increase real VRAM use beyond this estimate.

Also runs well on H100 80GB, H200 141GB. Available in United States, Europe, Asia Pacific.

Serving compatibility

Runtime	Status	Notes
vLLM	Declared by source	Used for Badgr dedicated endpoints
Transformers	Unknown	Basic fallback
llama.cpp	Requires GGUF conversion	No GGUF weights found in repo
SGLang	Unknown	Not evaluated
TensorRT-LLM	Unknown	Conversion may be required
TGI	Unknown	Not evaluated

Call this model through Badgr

curl https://api.aibadgr.com/v1/chat/completions \
  -H "Authorization: Bearer $BADGR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"mistralai/Mistral-Small-24B-Instruct-2501","messages":[{"role":"user","content":"Hello"}]}'

Ready-to-run Badgr configurations

Quick test

badgr serve mistralai/Mistral-Small-24B-Instruct-2501 --max-cost 2

Validated dedicated endpoint command

badgr serve mistralai/Mistral-Small-24B-Instruct-2501 --gpu A100 80GB --max-cost 10

Advanced configuration (defaults to automatic)

Runtime
Quantisation
GPU and GPU count
Context length
Maximum concurrency
Region
Maximum hourly spend
Persistent or capped runtime

Estimated pricing

Provider estimate: cold start

3–8 min

Provider estimate: endpoint cost

$1.25 – $1.35/hr

Idle cost

$0 when stopped

Per-token throughput cost is not shown here: Badgr has not benchmarked this model yet, and this page does not display figures it cannot back with real data.