Skip to content

Upgrade llama.cpp from b10092 to b10107 - #363

Merged
bernardladenthin merged 1 commit into
mainfrom
claude/update-b10107-l68sgp
Jul 26, 2026
Merged

Upgrade llama.cpp from b10092 to b10107#363
bernardladenthin merged 1 commit into
mainfrom
claude/update-b10107-l68sgp

Conversation

@bernardladenthin

Copy link
Copy Markdown
Owner

Summary

  • Upgrade pinned llama.cpp version from b10092 to b10107 across all configuration files and documentation
  • Adapt C++ training code to llama.cpp's API change: replace deprecated use_mmap boolean with new load_mode enum (LLAMA_LOAD_MODE_NONE)
  • Update version strings in Java constant, CMake, README, and internal documentation

Details

This upgrade addresses an upstream API change in llama.cpp b10107 where the model loading configuration was refactored. The params.use_mmap, params.use_mlock, and params.use_direct_io booleans were consolidated into a single params.load_mode enum. The training engine's requirement for writable weight pointers (incompatible with mmap) is now satisfied by setting load_mode = LLAMA_LOAD_MODE_NONE.

All six existing patches (00010003, 00060008) apply cleanly to b10107 without modification, as verified in the breaking-changes documentation.

Test plan

  • CI is green on this branch
  • All six patches apply cleanly to b10107 checkout
  • Docs / version strings updated consistently across Java, CMake, README, and CLAUDE.md

Related issues / PRs

Follows the "Upgrading/Downgrading llama.cpp Version" checklist in CLAUDE.md.

Checklist

  • I have read CONTRIBUTING.md and CODE_OF_CONDUCT.md
  • My commits follow Conventional Commits
  • No security-sensitive changes

https://claude.ai/code/session_017DYEzEhYiZb9M9jQQrfzQm

Bumps the pinned llama.cpp release (b10092 -> b10107). Updates the four pin
sites (llama/CMakeLists.txt GIT_TAG + LLAMA_TAG, README badge/link, CLAUDE.md,
LlamaCppVersion.LLAMA_CPP_VERSION) and appends the history rows.

This range carries a real public-API break: upstream PR ggml-org/llama.cpp#20834
removed the use_mmap/use_mlock/use_direct_io booleans from common_params and
llama_model_params, replacing them with a single `enum llama_load_mode load_mode`.
train_engine.cpp is updated accordingly (params.use_mmap = false ->
params.load_mode = LLAMA_LOAD_MODE_NONE, mirroring upstream finetune.cpp). The
Java layer is unaffected (ModelFlag.MLOCK/NO_MMAP emit --mlock/--no-mmap, still
accepted by common/arg.cpp, now deprecated aliases that set load_mode).

All six patches (0001-0003, 0006-0008) apply unchanged; the OuteTTS generator
anchors hold (tools/tts/tts.cpp unchanged). Verified locally: cmake configure
+ full native build green, 485/485 C++ ctests pass, NativeLibraryLoadSmokeTest
(2/2) confirms the linked binary reports b10107 matching the version constant.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_017DYEzEhYiZb9M9jQQrfzQm
@bernardladenthin
bernardladenthin merged commit 5f81d92 into main Jul 26, 2026
8 of 14 checks passed
@bernardladenthin
bernardladenthin deleted the claude/update-b10107-l68sgp branch July 26, 2026 20:25
@sonarqubecloud

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants