Skip to content

fix(profiles): withdraw amd-gcn's CPU alt route - no model runs on CPU - #482

Merged
dmmdea merged 1 commit into
mainfrom
fix/amd-gcn-drop-cpu-route
Sep 24, 2026
Merged

dmmdea merged 1 commit into
mainfrom
fix/amd-gcn-drop-cpu-route

Conversation

@dmmdea

@dmmdea dmmdea commented Sep 24, 2026

Copy link
Copy Markdown
Owner

Intent: operator order 2026-09-24 - no model runs on CPU. Remove the CPU seat family from the one tier that declared it, so a re-render cannot bring it back.

What changed

  • setup/templates/profiles.json: amd-gcn drops alt_backends: ["cpu"]; its notes and the field description say why and when. install render --llama-bin-cpu now refuses on this tier by name (ADR 0054's "flag without the declaration is an error").
  • ADR 0054 amended (not superseded): the declare/render/advertise mechanism is unchanged and stays for a non-CPU alternate. ADR index, OPERATOR-GUIDE tier row, FLEET-NODE note updated.
  • docs/tiers/amd-gcn.md regenerated with go run ./cmd/gentiers (only that page changed).
  • CHANGELOG entry under Unreleased.

The live node was edited to match before this PR: the two *-cpu entries, the ldcpu macro and their matrix vars removed from its llama-swap config (backed up first), alt_backends dropped from installed.json, fleet node restarted; /fleet/health now reports backends: ["vulkan"] and no *-cpu id is served.

How tested: go build ./..., go vet ./..., go test ./... all green locally (90 packages ok). The altcpu renderer tests build their params directly, so they still cover the mechanism.

Risk: low - one tier-table field plus docs; no code path changes.

🤖 Generated with Claude Code

Operator order 2026-09-24. amd-gcn no longer declares alt_backends ["cpu"],
so `install render --llama-bin-cpu` refuses on it by name and a re-render
cannot bring offload-e4b-cpu / gemma4-e2b-cpu back. The node that carried the
family was edited live to match (entries, ldcpu macro and matrix vars removed,
alt_backends dropped from its manifest; /fleet/health reports ["vulkan"]).

ADR 0054 is amended, not superseded: the declare/render/advertise mechanism is
unchanged and stays available for a non-CPU alternate. Tier docs regenerated
with cmd/gentiers.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@dmmdea
dmmdea merged commit 1f87729 into main Sep 24, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant