Skip to content

chore: ⬆️ Update mudler/vllm.cpp to 4880c5715f36445a30bd39d3349a06dc96085a11 - #11515

Merged
mudler merged 4 commits into
mudler:masterfrom
ci-forks:update/VLLM_CPP_VERSION
Aug 16, 2026
Merged

chore: ⬆️ Update mudler/vllm.cpp to 4880c5715f36445a30bd39d3349a06dc96085a11#11515
mudler merged 4 commits into
mudler:masterfrom
ci-forks:update/VLLM_CPP_VERSION

Conversation

@localai-bot

@localai-bot localai-bot commented Aug 13, 2026

Copy link
Copy Markdown
Collaborator

@localai-bot
localai-bot force-pushed the update/VLLM_CPP_VERSION branch from 3db635c to 7da4d64 Compare August 13, 2026 23:06
@localai-bot localai-bot changed the title chore: ⬆️ Update mudler/vllm.cpp to a3aa02e197ec200e92058ac686f1874afb381225 chore: ⬆️ Update mudler/vllm.cpp to 51e0cb5b15fef9dd76c9aa1727b4dbc9e59cdff2 Aug 14, 2026
@localai-bot
localai-bot force-pushed the update/VLLM_CPP_VERSION branch 2 times, most recently from 109bd24 to 4fee5c9 Compare August 15, 2026 20:06
@localai-bot localai-bot changed the title chore: ⬆️ Update mudler/vllm.cpp to 51e0cb5b15fef9dd76c9aa1727b4dbc9e59cdff2 chore: ⬆️ Update mudler/vllm.cpp to 4880c5715f36445a30bd39d3349a06dc96085a11 Aug 15, 2026
@mudler

mudler commented Aug 16, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot fix CI

mudler and others added 3 commits August 16, 2026 07:20
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
The dependency bump advances the engine ABI from v17 to v20. The old
binding stops every backend build at the ABI guard and undersizes
structures used at runtime.

Mirror the appended model and video fields so every platform uses the
pinned engine layout.

Assisted-by: Codex:gpt-5
The new engine pin captures a namespace-scope help string in a lambda. Apple Clang rejects the redundant capture because upstream enables -Werror.

Carry the one-line source patch until the engine pin includes the fix.

Assisted-by: Codex:gpt-5
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Pushed the Darwin Apple Clang fix on current master. The pin-scoped patch applies cleanly to vllm.cpp 4880c571, ABI v20 matches, and the vllm-cpp unit suite passes (71 passed, 13 model-dependent specs skipped). The bot-assisted commits intentionally have no Signed-off-by; a human must satisfy DCO per repository policy.

The Apple Clang patch used context from another source revision.
Source preparation rejected it before every backend build.

Align the patch with the pinned engine revision.

Assisted-by: Codex:gpt-5 [monitoring-prs]
@mudler
mudler merged commit 869b30d into mudler:master Aug 16, 2026
59 of 60 checks passed
@mudler

mudler commented Aug 16, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot upstream the patch so we don't have to carry it here

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Upstreamed the Apple Clang fix in mudler/vllm.cpp#1054: mudler/vllm.cpp#1054. The upstream repository checks pass locally; its platform build matrix is queued.

mudler pushed a commit to mudler/vllm.cpp that referenced this pull request Aug 16, 2026
## Summary

- remove the redundant namespace-scope `kRequired` lambda capture
- keep the refusal messages and runtime behavior unchanged
- record Apple Clang build portability and the benchmark-not-applicable
disposition

LocalAI currently carries this as a pin-scoped patch in [LocalAI
#11515](mudler/LocalAI#11515). Upstreaming it
lets LocalAI remove that carry patch after the next vllm.cpp pin update.

## Verification

- source regression assertion rejects `const auto refuse = [&kRequired]`
and finds `const auto refuse = []`
- `python3 scripts/check-doc-checkpoint.py --commit HEAD`
- `python3 tests/scripts/test_doc_checkpoint.py` (27 tests)
- `python3 scripts/check-agent-record.py`
- `python3 tests/scripts/test_agent_record.py` (74 tests)
- `git diff upstream/main...HEAD --check`

This Linux host has neither CMake nor Clang installed, so it cannot
reproduce the Apple Clang compilation locally. The binding regression
gate is the Darwin Apple Clang CI build.

Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants