Skip to content

MINOR: [C++][CI] Bump ccache max size - #51259

Merged
pitrou merged 1 commit into
apache:mainfrom
pitrou:minor-ccache-size
Sep 10, 2026
Merged

MINOR: [C++][CI] Bump ccache max size#51259
pitrou merged 1 commit into
apache:mainfrom
pitrou:minor-ccache-size

Conversation

@pitrou

@pitrou pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member

Rationale for this change

When trying to analyze the compilation caching behavior on #51255, I realized that our maximum ccache size of 1GB had become too small for some builds. The result is that a single build cannot be cached in its entirety, making identical rebuilds costlier than they should be.

What changes are included in this PR?

Bump ccache max size to 1.5 GB.

Are these changes tested?

Yes, by existing builds.

Are there any user-facing changes?

No.

@github-actions github-actions Bot added the awaiting review Awaiting review label Sep 9, 2026
When trying to analyze the compilation caching behavior on apache#51255, I realized that our maximum ccache size of 1GB had become too small for some builds. The result is that a single build cannot be cached in its entirety, making identical rebuilds costlier than they should be.
@pitrou pitrou added the CI: Extra: C++ Run extra C++ CI label Sep 9, 2026
@pitrou
pitrou marked this pull request as ready for review September 9, 2026 13:53
@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

cc @kou @raulcd

@raulcd

raulcd commented Sep 9, 2026

Copy link
Copy Markdown
Member

Is there any specific log to look for to see this happening in the future? I am unsure I know how to find that this cache size has become too small.

@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

What I did is run a container locally, issued ccache -Cz to clear the cache and its statistics, then ran the compilation and looked at the ccache stats at the end.

I'm afraid there's no easy way to automate such a hint on CI builds.

@kou kou left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@kou

kou commented Sep 10, 2026

Copy link
Copy Markdown
Member

How about monitoring build time or cache miss rate?

FYI: Velox monitors build time (and build size): https://facebookincubator.github.io/velox/bm-report/
Hmm. It seems that it's not updated now...

@github-actions github-actions Bot added awaiting merge Awaiting merge and removed awaiting review Awaiting review labels Sep 10, 2026
@pitrou

pitrou commented Sep 10, 2026

Copy link
Copy Markdown
Member Author

How about monitoring build time or cache miss rate?

Monitoring build times would be interesting, but it needs someone to setup (and maintain the setup?). It would also require us to watch the results for deviations.

@pitrou
pitrou merged commit 1eb26c6 into apache:main Sep 10, 2026
90 of 91 checks passed
@pitrou pitrou removed the awaiting merge Awaiting merge label Sep 10, 2026
@pitrou
pitrou deleted the minor-ccache-size branch September 10, 2026 08:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI: Extra: C++ Run extra C++ CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants