Integrations / AIBrix

DeployExperimental

AIBrix and Badgr: where each one fits

AIBrix is a Kubernetes layer for scaling vLLM. This page explains the boundary with Badgr. It is not a one-click setup.

A setup guide only. Badgr has not tested this path, so expect to adjust it.

Why use Badgr for AIBrix

Badgr interface
Serve
Where AIBrix fits
Kubernetes integration
Why Badgr
Kubernetes serving: guide only, not offered
  • If you need one served model, Badgr's vLLM service is simpler than Kubernetes and has a spending cap.
  • If you need autoscaling across many replicas, AIBrix in your own cluster is the right tool and Badgr does not replace it.
  • Badgr does not run AIBrix, which is stated up front so you can choose before you build.

What you can do

  • Decide whether you need a Kubernetes layer or a single served model
  • Use Badgr for a single vLLM service while you evaluate AIBrix
  • Understand what Badgr does not manage for you

Quickstart: Choosing between the two

  1. If you need one model served with a spending cap, use badgr serve (see the vLLM page). No Kubernetes is needed.
  2. If you need autoscaling, routing and cache sharing across many vLLM replicas in your own Kubernetes cluster, run AIBrix there, following its own documentation.
  3. Badgr does not install or operate AIBrix, and there is no tested way to run it on Badgr.

How it works

  1. 1.You decide what scale you need
  2. 2.For a single service, Badgr starts vLLM for you
  3. 3.For cluster scale, AIBrix runs in your Kubernetes environment
  4. 4.The two are separate and do not share state

What you get

  • A clear decision, not a deployment

Requirements

  • A Kubernetes cluster, if you want to run AIBrix itself
  • Knowledge of your scaling needs

What it costs

  • Nothing on this page starts compute, so nothing here bills.
  • If you serve a model with Badgr, see the vLLM page for how billing works.

See pricing for how billing works.

Proof

No tested run is recorded for this integration yet. A receipt and example output will be added here after a real run, not before.

Troubleshooting

  • Looking for a one-click AIBrix install

    Badgr does not offer one. Use AIBrix's own installation guide on your cluster.

  • Need autoscaling but not Kubernetes

    Badgr serves one service per command. Many replicas and autoscaling are not provided.

Developer reference

Ready to start with AIBrix?

Every run or service has a spending limit you set before it starts.