CMSManhattan · JiRackUltra

JiRackUltra_7b

Unverified · community-discovered, not yet reviewed

JiRackUltra_7b is a discovered model from public model catalogues. Badgr builds a GPU serving profile from source metadata, estimated VRAM, context length, and available execution routes.

Last validated or meaningfully updated: Dynamic source discovery

ChatMultilingual

Availability

Not yet Badgr AI API

Not currently validated

Dedicated endpoint

Available through Badgr

Custom GPU deployment

Available through Badgr

Deployment profile

Architecture
Source metadata pending
Minimum VRAM
~18GB
Context
Source dependent

Recommended: RTX 4090 24GB. VRAM is an estimate and increases with context, cache, concurrency, and runtime overhead.

Model identity

Languages
en, zh, ja, ko, fr, es, pt, de, it, ru, ar, vi, th
Updated
today
HuggingFace revision
a9165b085b

Popularity and trust

Downloads (last month)

60.1K

Likes

2

Spaces using this model

0

Files and formats

Weight formats

Safetensors, GGUF

Repository files

30

Chat template

Available

GPU deployment scenarios

Estimated from parameter count and quantisation. Will switch to “Verified by Badgr” once a real run backs a tier.

Testing

RTX 4090 24GB

Short context, low concurrency

Small production

L40S 48GB

8K context, 1-4 concurrent requests

Higher throughput

A100 80GB

32K context, continuous batching

Large production

RTX 4090 24GB

Higher concurrency

Estimated — multimodal inputs, long context, and concurrency all increase real VRAM use beyond this estimate.

Also runs well on L40S 48GB, A100 40GB. Available in United States, Europe.

Serving compatibility

RuntimeStatusNotes
vLLMEstimatedUsed for Badgr dedicated endpoints
TransformersUnknownBasic fallback
llama.cppDeclared by sourceGGUF weights available in repo
SGLangUnknownNot evaluated
TensorRT-LLMUnknownConversion may be required
TGIUnknownNot evaluated

Ready-to-run Badgr configurations

Quick test

badgr serve CMSManhattan/JiRackUltra_7b --max-cost 2

Dedicated endpoint command

badgr serve CMSManhattan/JiRackUltra_7b --gpu RTX 4090 --max-cost 10

Advanced configuration (defaults to automatic)

  • Runtime
  • Quantisation
  • GPU and GPU count
  • Context length
  • Maximum concurrency
  • Region
  • Maximum hourly spend
  • Persistent or capped runtime

Estimated pricing

Provider estimate: cold start

2–5 min

Provider estimate: endpoint cost

$0.18 – $0.45/hr

Idle cost

$0 when stopped

Per-token throughput cost is not shown here: Badgr has not benchmarked this model yet, and this page does not display figures it cannot back with real data.

Recommended Badgr routes

RTX 4090 24GB · United States

Available

from $0.18/hr

24GB VRAM/GPU32 vCPU16GB RAM1440.9GB storage0.02Gbps networkCUDA 13.2

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: just now

RTX 4090 24GB · United States

Available

from $0.38/hr

22.5GB VRAM/GPU128 vCPU125.9GB RAM1385GB storage0.83Gbps networkCUDA 13.0

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: just now

RTX 4090 24GB · United States

Available

from $0.44/hr

24GB VRAM/GPU

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: just now

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

RTX 4090 24GB · Europe

Estimated

starting from $0.45/hr

Badgr estimated starting price

Best for

ComfyUI, Batch Inference, Qwen 2.5 7B Instruct

Startup: 2–5 min

Reliability: Standard

Last checked: Live marketplace price not available yet

Known limitations

  • Source-discovered pages use best-effort metadata from an automated publication gate, not manual review.
  • Licence, gated access, runner compatibility, and exact memory use should be checked before production deployment.

Related troubleshooting