[CI][C++][Python] macOS jobs fail with segfaults in S3 tests since Jul 27

[tadeja]

Describe the bug, including details regarding any error messages, version, and platform.

The macOS jobs ARM64 macOS 14 and AMD64 macOS 15-intel fail on main for the last few runs for C++ and Python workflows
ARM64 macOS 14 C++
AMD64 macOS 15-intel C++

106/107 Test  #79: arrow-s3fs-test ..............................***Failed  151.52 sec
Running arrow-s3fs-test, redirecting output into /Users/runner/work/arrow/arrow/build/cpp/build/test-logs/arrow-s3fs-test.txt (attempt 1/1)
/Users/runner/work/arrow/arrow/cpp/build-support/run-test.sh: line 88: 44070 Segmentation fault: 11     (core dumped) $TEST_EXECUTABLE "$@" > $LOGFILE.raw 2>&1
...
...
The following tests FAILED:
	 79 - arrow-s3fs-test (Failed)                          arrow-tests filesystem unittest

AMD64 macOS 15-intel Python 3
ARM64 macOS 14 Python 3

Fatal Python error: Aborted

......................[gw1] node down: Not properly terminated
Thread 0x00000001700fb000 (most recent call first):
  File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/execnet/gateway_base.py", line 534 in read
...
Fatal Python error: Segmentation fault
...
______________________ tests/parquet/test_parquet_file.py ______________________
[gw1] darwin -- Python 3.11.9 /Library/Frameworks/Python.framework/Versions/3.11/bin/python
worker 'gw1' crashed while running 'tests/parquet/test_parquet_file.py::test_parquet_file_with_filesystem[True]'
_______________________________ tests/test_fs.py _______________________________
[gw2] darwin -- Python 3.11.9 /Library/Frameworks/Python.framework/Versions/3.11/bin/python
worker 'gw2' crashed while running 'tests/test_fs.py::test_filesystem_pickling[builtin_pickle-S3FileSystem-True]'
_______________________________ tests/test_fs.py _______________________________
[gw4] darwin -- Python 3.11.9 /Library/Frameworks/Python.framework/Versions/3.11/bin/python
worker 'gw4' crashed while running 'tests/test_fs.py::test_s3_real_aws_region_selection'
...

The last green commit was 974c3fc on Jul 27. My fork branch based on 974c3fc with no further commits also fails now, so this looks caused by the hosted-runner environment rather than Arrow code.

Component(s)

Continuous Integration, C++, Python