Integrations / AIBrix
DeployExperimental
AIBrix and Badgr: where each one fits
AIBrix is a Kubernetes layer for scaling vLLM. This page explains the boundary with Badgr. It is not a one-click setup.
A setup guide only. Badgr has not tested this path, so expect to adjust it.
Why use Badgr for AIBrix
- Badgr interface
- Serve
- Where AIBrix fits
- Kubernetes integration
- Why Badgr
- Kubernetes serving: guide only, not offered
- If you need one served model, Badgr's vLLM service is simpler than Kubernetes and has a spending cap.
- If you need autoscaling across many replicas, AIBrix in your own cluster is the right tool and Badgr does not replace it.
- Badgr does not run AIBrix, which is stated up front so you can choose before you build.
What you can do
- Decide whether you need a Kubernetes layer or a single served model
- Use Badgr for a single vLLM service while you evaluate AIBrix
- Understand what Badgr does not manage for you
Quickstart: Choosing between the two
- If you need one model served with a spending cap, use badgr serve (see the vLLM page). No Kubernetes is needed.
- If you need autoscaling, routing and cache sharing across many vLLM replicas in your own Kubernetes cluster, run AIBrix there, following its own documentation.
- Badgr does not install or operate AIBrix, and there is no tested way to run it on Badgr.
How it works
- 1.You decide what scale you need
- 2.For a single service, Badgr starts vLLM for you
- 3.For cluster scale, AIBrix runs in your Kubernetes environment
- 4.The two are separate and do not share state
What you get
- A clear decision, not a deployment
Requirements
- A Kubernetes cluster, if you want to run AIBrix itself
- Knowledge of your scaling needs
What it costs
- Nothing on this page starts compute, so nothing here bills.
- If you serve a model with Badgr, see the vLLM page for how billing works.
See pricing for how billing works.
Proof
No tested run is recorded for this integration yet. A receipt and example output will be added here after a real run, not before.
Troubleshooting
Looking for a one-click AIBrix install
Badgr does not offer one. Use AIBrix's own installation guide on your cluster.
Need autoscaling but not Kubernetes
Badgr serves one service per command. Many replicas and autoscaling are not provided.
Developer reference
Ready to start with AIBrix?
Every run or service has a spending limit you set before it starts.