TII · Falcon-H1

Falcon-H1 0.5B Instruct

Verified by Badgr · Serve

Falcon-H1 0.5B Instruct is a 0.5B chat and text-generation model available through supported Badgr execution routes.

Last validated or meaningfully updated: 2026-10-08

ChatEdge-capableFine-tunable
Serve Falcon-H1 0.5B Instruct nowGet help running this

✓ Verified by Badgr · SGLang · Serve

Last verified 2026-10-08

badgr serve --image lmsysorg/sglang:nightly-dev-20261005-f70e8c68 --gpu H100 --port 30000 --health-path /health --max-cost 2 --cmd 'python3 -m sglang.launch_server --model-path tiiuae/Falcon-H1-0.5B-Instruct --host 0.0.0.0 --port 30000 --cuda-graph-backend-prefill=disabled'
GPU
NVIDIA H100 80GB HBM3Reported by the provider, not confirmed inside the container
Time to verified
516.3s
Deployment
dep-29aa293b66
  • ✓ SGLang server started
  • ✓ /health returned HTTP 200
  • ✓ Chat completion returned the expected reply
  • ✓ final_state = VERIFIED
  • ✓ Teardown completed

Needs --cuda-graph-backend-prefill=disabled on this SGLang build: with the default CUDA-graph setting the scheduler crashed with an illegal memory access on the same image and GPU (sgl-project/sglang#42774).

GitHub issue this run was for: sgl-project/sglang#42774

Raw evidence
final_state=VERIFIED failure_class=None providers_tried=1 spend_usd=0.3719 elapsed=516.3s

Run from Badgr's local development environment. Documents that this deployment path works end-to-end for this model.

Availability

Not yet Badgr AI API

Not currently validated

✓ Dedicated endpoint

Available through Badgr

✓ Custom GPU deployment

Available through Badgr

Deployment profile

Architecture
FalconH1ForCausalLM
Licence
Falcon-LLM License
Minimum VRAM
~5GB
Context
16K tokens

Recommended: RTX 4090 24GB. VRAM is an estimate and increases with context, cache, concurrency, and runtime overhead.

Model identity

Base model
tiiuae/Falcon-H1-0.5B-Base
Updated
1 years ago
HuggingFace revision
8f2587ca06

Popularity and trust

Downloads (last month)

7.8K

Likes

35

Spaces using this model

5

Files and formats

Weight formats

Safetensors

Repository files

9

Chat template

Available

GPU deployment scenarios

Estimated from parameter count and quantisation. Will switch to “Verified by Badgr” once a real run backs a tier.

Testing

RTX 4090 24GB

Short context, low concurrency

Small production

L40S 48GB

8K context, 1-4 concurrent requests

Higher throughput

A100 80GB

32K context, continuous batching

Large production

RTX 4090 24GB

Higher concurrency

Estimated — multimodal inputs, long context, and concurrency all increase real VRAM use beyond this estimate.

Also runs well on L40S 48GB, A100 40GB. Available in United States, Europe.

Serving compatibility

RuntimeStatusNotes
vLLMEstimatedUsed for Badgr dedicated endpoints
TransformersDeclared by sourceBasic fallback
llama.cppRequires GGUF conversionNo GGUF weights found in repo
SGLangVerified by BadgrConfirmed by a real badgr serve run (deployment dep-29aa293b66)
OllamaUnknownNot evaluated
DiffusersUnknownNot evaluated
PyTorchUnknownNot evaluated
TensorRT-LLMUnknownConversion may be required
TGIUnknownNot evaluated

Ready-to-run Badgr configurations

Quick test

badgr serve tiiuae/Falcon-H1-0.5B-Instruct --max-cost 2

Validated dedicated endpoint command

badgr serve tiiuae/Falcon-H1-0.5B-Instruct --gpu RTX 4090 --max-cost 10

Advanced configuration (defaults to automatic)

  • Runtime
  • Quantisation
  • GPU and GPU count
  • Context length
  • Maximum concurrency
  • Region
  • Maximum hourly spend
  • Persistent or capped runtime

Estimated pricing

Provider estimate: cold start

2–5 min

Provider estimate: endpoint cost

$0.23 – $0.51/hr

Idle cost

$0 when stopped

Per-token throughput cost is not shown here: Badgr has not benchmarked this model yet, and this page does not display figures it cannot back with real data.

Recommended Badgr routes

RTX 4090 24GB · United States

Available

from $0.23/hr

24GB VRAM/GPU16GB RAM1408.9GB storage0.02Gbps networkCUDA 13.2

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: just now

Check live route
View details →

RTX 4090 24GB · United States

Available

from $0.44/hr

24GB VRAM/GPU

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: just now

Check live route
View details →

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

Check live route
View details →

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

Check live route
View details →

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

Check live route
View details →

RTX 4090 24GB · United States

Available

from $0.51/hr

24GB VRAM/GPU6 vCPU31.3GB RAM337GB storage0.26Gbps networkCUDA 13.0

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: just now

Check live route
View details →

Known limitations

  • Memory use increases with context length and concurrency.

Related troubleshooting