Skip to content

GH-51254: [C++][CI] Move ubuntu-cpp-bundled-offline to C++ Extra - #51255

Merged
kou merged 2 commits into
apache:mainfrom
pitrou:gh51254-move-bundle-offline
Sep 10, 2026
Merged

GH-51254: [C++][CI] Move ubuntu-cpp-bundled-offline to C++ Extra#51255
kou merged 2 commits into
apache:mainfrom
pitrou:gh51254-move-bundle-offline

Conversation

@pitrou

@pitrou pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member

Rationale for this change

The test-ubuntu-24.04-cpp-bundled-offline Crossbow job usually takes one hour to complete:
https://github.com/ursacomputing/crossbow/actions/runs/34175056969/job/101902703505

This is because, despite sccache being configured, the S3-stored compilation cache is unavailable because the network is shut off during compilation. And the job compiles all dependencies from scratch.

What changes are included in this PR?

Move the CI job to the C++ Extra workflow, so as to take advantage of ccache-based compilation caching using apache/infrastructure-actions/stash.

Are these changes tested?

By definition, yes.

Are there any user-facing changes?

No.

@pitrou pitrou added the CI: Extra: C++ Run extra C++ CI label Sep 9, 2026
@github-actions github-actions Bot added the awaiting review Awaiting review label Sep 9, 2026
@pitrou
pitrou force-pushed the gh51254-move-bundle-offline branch from c2a8ec9 to 9fcc34d Compare September 9, 2026 07:44
@pitrou
pitrou force-pushed the gh51254-move-bundle-offline branch from 9fcc34d to 9c19850 Compare September 9, 2026 07:58
@pitrou
pitrou force-pushed the gh51254-move-bundle-offline branch from 80b0c10 to d6f1ee1 Compare September 9, 2026 11:08
@pitrou
pitrou marked this pull request as ready for review September 9, 2026 11:30
@pitrou

pitrou commented Sep 9, 2026

Copy link
Copy Markdown
Member Author

cc @kou

pitrou added a commit to pitrou/arrow that referenced this pull request Sep 9, 2026
When trying to analyze the compilation caching behavior on apache#51255, I realized that our maximum ccache size of 1GB had become too small for some builds. The result is that a single build cannot be cached in its entirety, making identical rebuilds costlier than they should be.

@kou kou left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

I confirmed that ccache was used:

https://github.com/apache/arrow/actions/runs/34343953743/job/102772045066?pr=51255#step:6:11935

  Hits:                              7475 / 15253 (49.01%)

@kou
kou merged commit a273e69 into apache:main Sep 10, 2026
87 of 89 checks passed
@kou kou removed the awaiting review Awaiting review label Sep 10, 2026
@github-actions github-actions Bot added the awaiting merge Awaiting merge label Sep 10, 2026
@pitrou
pitrou deleted the gh51254-move-bundle-offline branch September 10, 2026 07:18
pitrou added a commit that referenced this pull request Sep 10, 2026
### Rationale for this change

When trying to analyze the compilation caching behavior on #51255, I realized that our maximum ccache size of 1GB had become too small for some builds. The result is that a single build cannot be cached in its entirety, making identical rebuilds costlier than they should be.

### What changes are included in this PR?

Bump ccache max size to 1.5 GB.

### Are these changes tested?

Yes, by existing builds.

### Are there any user-facing changes?

No.

Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants