StartLux · StartLux Decision
StartLux Decision 0.8B Q8_0 GGUF
Verified by Badgr · ServeStartLux Decision 0.8B Q8_0 GGUF is a 0.8B chat and text-generation model available through supported Badgr execution routes.
Last validated or meaningfully updated: 2026-10-08
✓ Verified by Badgr · llama.cpp · Serve
Last verified 2026-10-08
badgr serve --runtime llama.cpp --hf-repo startlux-models/StartLux-Decision-0.8B-Q8_0-GGUF --hf-file StartLux-Decision-0.8B-Q8_0.gguf --gpu RTX_4090 --max-cost 1- GPU
- NVIDIA GeForce RTX 4090Reported by the provider, not confirmed inside the container
- Time to verified
- 55.4s
- Deployment
- dep-5a7e9d60e2
- ✓ llama-server started
- ✓ /health returned HTTP 200
- ✓ final_state = VERIFIED
- ✓ Teardown completed
Serves the raw model weights through llama-server's OpenAI-compatible API. StartLux's typed decision API (/v1/systemone) needs the vendor's separate decision server, which Badgr's llama.cpp runtime does not run; asking llama-server for a decision is what returns the 501 in ggml-org/llama.cpp#30144.
GitHub issue this run was for: ggml-org/llama.cpp#30144
Raw evidence
final_state=VERIFIED failure_class=None providers_tried=1 spend_usd=0.0027 elapsed=55.4s
Run from Badgr's local development environment. Documents that this deployment path works end-to-end for this model.
Availability
Not yet Badgr AI API
Not currently validated
✓ Dedicated endpoint
Available through Badgr
✓ Custom GPU deployment
Available through Badgr
Deployment profile
- Architecture
- Qwen3_5ForConditionalGeneration
- Licence
- CC-BY-NC-4.0
- Minimum VRAM
- ~6GB
- Context
- 256K tokens
Recommended: RTX 4090 24GB. VRAM is an estimate and increases with context, cache, concurrency, and runtime overhead.
Model identity
- Base model
- startlux-models/StartLux-Decision-v1-0.8B
- Updated
- today
- HuggingFace revision
- e933115a2d
Popularity and trust
Downloads (last month)
1.5K
Likes
1
Spaces using this model
0
Files and formats
Weight formats
GGUF
Repository files
18
Tokenizer
BPE
Chat template
Available
GPU deployment scenarios
Estimated from parameter count and quantisation. Will switch to “Verified by Badgr” once a real run backs a tier.
Testing
RTX 4090 24GB
Short context, low concurrency
Small production
L40S 48GB
8K context, 1-4 concurrent requests
Higher throughput
A100 80GB
32K context, continuous batching
Large production
RTX 4090 24GB
Higher concurrency
Estimated — multimodal inputs, long context, and concurrency all increase real VRAM use beyond this estimate.
Also runs well on L40S 48GB, A100 40GB. Available in United States, Europe.
Serving compatibility
| Runtime | Status | Notes |
|---|---|---|
| vLLM | Estimated | Used for Badgr dedicated endpoints |
| Transformers | Unknown | Basic fallback |
| llama.cpp | Verified by Badgr | Confirmed by a real badgr serve run (deployment dep-5a7e9d60e2) |
| SGLang | Unknown | Not evaluated |
| Ollama | Unknown | Not evaluated |
| Diffusers | Unknown | Not evaluated |
| PyTorch | Unknown | Not evaluated |
| TensorRT-LLM | Unknown | Conversion may be required |
| TGI | Unknown | Not evaluated |
Ready-to-run Badgr configurations
Quick test
badgr serve startlux-models/StartLux-Decision-0.8B-Q8_0-GGUF --max-cost 2Validated dedicated endpoint command
badgr serve startlux-models/StartLux-Decision-0.8B-Q8_0-GGUF --gpu RTX 4090 --max-cost 10Advanced configuration (defaults to automatic)
- Runtime
- Quantisation
- GPU and GPU count
- Context length
- Maximum concurrency
- Region
- Maximum hourly spend
- Persistent or capped runtime
Estimated pricing
Provider estimate: cold start
2–5 min
Provider estimate: endpoint cost
$0.18 – $0.45/hr
Idle cost
$0 when stopped
Per-token throughput cost is not shown here: Badgr has not benchmarked this model yet, and this page does not display figures it cannot back with real data.
Recommended Badgr routes
RTX 4090 24GB · United States
Availablefrom $0.18/hr
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: just now
RTX 4090 24GB · United States
Availablefrom $0.42/hr
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: just now
RTX 4090 24GB · United States
Availablefrom $0.44/hr
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: just now
RTX 4090 24GB · United States
Availablefrom $0.44/hr
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: just now
RTX 4090 24GB · United States
Availablefrom $0.44/hr
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: just now
RTX 4090 24GB · Europe
Estimatedstarting from $0.45/hr
Badgr estimated starting price
Best for
ComfyUI, Batch Inference, Qwen 2.5 7B Instruct
Startup: 2–5 min
Reliability: Standard
Last checked: Live marketplace price not available yet
Known limitations
- Memory use increases with context length and concurrency.