Hi, first of all – huge thanks for maintaining this project! Really appreciate your work.
I noticed that the current ROCm version here is still 6.4.1, but the official Docker image already has 7.14.0-full (link: https://hub.docker.com/r/rocm/dev-ubuntu-26.04).
I tried to pull and use the newer image myself, but ran into quite a few errors, so I’m not sure if it’s straightforward to upgrade.
Just wanted to ask:
Do you have any plan to officially bump ROCm to 7.14?
And more importantly, would 7.14 actually give us better performance compared to 6.4.1? (e.g. faster inference, lower memory usage, etc.)
I also noticed that the llamacpp-rocm repo (https://github.com/lemonade-sdk/llamacpp-rocm) seems to track the latest ROCm all the time, which makes me curious if there's a real benefit.
No pressure at all – just curious. Thanks again!
Hi, first of all – huge thanks for maintaining this project! Really appreciate your work.
I noticed that the current ROCm version here is still 6.4.1, but the official Docker image already has 7.14.0-full (link: https://hub.docker.com/r/rocm/dev-ubuntu-26.04).
I tried to pull and use the newer image myself, but ran into quite a few errors, so I’m not sure if it’s straightforward to upgrade.
Just wanted to ask:
Do you have any plan to officially bump ROCm to 7.14?
And more importantly, would 7.14 actually give us better performance compared to 6.4.1? (e.g. faster inference, lower memory usage, etc.)
I also noticed that the llamacpp-rocm repo (https://github.com/lemonade-sdk/llamacpp-rocm) seems to track the latest ROCm all the time, which makes me curious if there's a real benefit.
No pressure at all – just curious. Thanks again!