AI API receipt · vllm-project/vllm

glm47 streaming parser silently swallows the real tool call after a stray <tool_call> in prose

vllm-project/vllm#60703 · upstream bug as reported in the issue (not re-run)

✓ Badgr rejects this response

The model made a real tool call; the parser returned only the prose and no tool call.

Outcome contract verdict: required tool call is missing. The attempt is recorded as failed (invalid_outcome) instead of a verified success, so it is not billed as a good answer and can fall back to another route.

What the upstream returned (replayed)

The output the bug produces, taken from the issue’s reproduction and fed to Badgr’s validators. Not a live provider call.

text: "Fetching the page. I will issue a "
tool_calls: none
tools: ["read_page"]
tool_choice: "required"

Badgr receipt

Written by Badgr’s receipt ledger and read back from GET /v1/receipts/replay-vllm-60703-swallowed-tool-call.

{
  "request_id": "replay-vllm-60703-swallowed-tool-call",
  "status": "failed",
  "endpoint": "/v1/chat/completions",
  "stream": false,
  "failure_stage": "outcome_contract",
  "error_code": "invalid_outcome",
  "error_message": "Response did not satisfy the outcome contract: required tool call is missing",
  "retryable": true,
  "provider_mode": "replay",
  "routing_decision": "replayed_upstream_output",
  "created_at": "2026-10-09T02:14:36Z"
}

Recorded 2026-10-09 in Badgr’s local development environment. Replay cases and verdicts are pinned by backend/test_ai_api_replay_cases.py.

← All AI API receipts