[GR-67892] Prepare for the 25.0 feature freeze.

PullRequest: graalpython/3914

Author: timfel

.github/workflows/downstream-tests.yml

@@ -0,0 +1,52 @@
+name: Weekly Downstream Tests
+on:
+  schedule:
+  - cron: '0 0 * * 1'
+  workflow_dispatch:
+
+jobs:
+  downstream-tests:
+    strategy:
+      fail-fast: false
+      matrix:
+        name:
+        - pybind11
+        - virtualenv
+        - pyo3
+        os:
+        - id: ubuntu-latest
+          platform: linux
+          arch: amd64
+        - id: macos-latest
+          platform: darwin
+          arch: aarch64
+
+    runs-on: ${{ matrix.os.id }}
+
+    steps:
+    - name: Install CMake (Linux)
+      if: ${{ matrix.os.platform == 'linux' && matrix.name == 'pybind11' }}
+      run: |
+        sudo apt-get update
+        sudo apt-get install -y cmake
+
+    - name: Install CMake (Darwin)
+      if: ${{ matrix.os.platform == 'darwin' && matrix.name == 'pybind11' }}
+      run: brew install cmake
+
+    - name: Install Rust toolchain
+      if: ${{ matrix.name == 'pyo3' }}
+      run: |
+        curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y
+        echo "${HOME}/.cargo/bin" >> $GITHUB_PATH
+
+    - name: Checkout main repository
+      uses: actions/checkout@v4
+
+    - name: Get GraalPy EA build
+      run: |
+        tarball="$(curl -sfL https://raw.githubusercontent.com/graalvm/graal-languages-ea-builds/refs/heads/main/graalpy/versions/latest-native-${{ matrix.os.platform }}-${{ matrix.os.arch}}.url)"
+        curl -sfL "$tarball" | tar xz
+
+    - name: Run downstream tests for ${{ matrix.name }}
+      run: python mx.graalpython/downstream_tests.py graalpy-*/bin/python ${{ matrix.name }}

.pre-commit-config.yaml

@@ -0,0 +1,37 @@
+repos:
+- repo: local
+  hooks:
+  - id: checkcopyrights
+    name: Copyright check
+    language: system
+    entry: bash scripts/pre-commit-checkcopyrights.sh
+    types: [text]
+  - id: eclipseformat
+    name: Eclipse formatter
+    language: system
+    entry: bash scripts/pre-commit-eclipseformat.sh
+    types: [text]
+    files: '\.java$'
+  - id: checkstyle
+    name: Checkstyle
+    language: system
+    entry: bash scripts/pre-commit-checkstyle.sh
+    types: [text]
+    files: '\.java$'
+  - id: pylint
+    name: Pylint on mx files
+    language: system
+    pass_filenames: false
+    entry: bash scripts/pre-commit-pylint.sh
+    types: [text]
+    files: '^mx\.graalpython/.*\.py$'
+- repo: https://github.com/pre-commit/pre-commit-hooks
+  rev: v5.0.0
+  hooks:
+  - id: trailing-whitespace
+    name: Trim Trailing Whitespace
+    entry: trailing-whitespace-fixer
+    language: python
+    types: [text]
+    files: '\.(java|py|md|c|h|sh)$'
+    exclude: '^graalpython/lib-python/.*'

CHANGELOG.md

@@ -8,8 +8,16 @@ language runtime. The main focus is on user-observable behavior of the engine.
 * `GRAALPY_VERSION_NUM` C macro now inlcudes the release level and serial number at the end to conform to the `hexversion` format. This shouldn't break any existing comparisons.
 * `dir(foreign_object)` now returns both foreign methods and Python methods (it used to return only foreign methods).
 * Support `__name__`, `__doc__`, `__text_signature__` fields on foreign executables to serve as their proper counterparts on the Python side. This is useful to, for example, use Java functional interfaces in lieu of Python functions for things like LangChain's `@tool` annotation that want to inspect the underlying function.
-* Remove support for running C extensions as LLVM bitcode. This also removes the related options `python.UseSystemToolchain` and `python.NativeModules`.
+* Remove support for running C extensions as LLVM bitcode. This also removes the related options `python.UseSystemToolchain` and `python.NativeModules`. Isolation of native code when embedding GraalPy into Java projects is now provided via the GraalVM enterprise edition polyglot isolate feature, which can launch in a separate external sub-process by setting the `--engine.IsolateMode=external` option.
 * Remove built-in HPy module. HPy can now be installed and used from the upstream sources.
+* Update Python standard library and core to 3.12.8.
+* Implement `faulthandler.dump_traceback_later` to better support testing frameworks that implement resilience to crashes.
+* Fix various issues affecting cibuildwheels on Windows, to make it easier for Python projects to provide native extensions for GraalPy on all supported platforms.
+* Add support for sharing Arrow arrays and tables between Java, PyArrow, and Pandas to avoid data copying when embedding those libraries into a Java project.
+* Enable FTS3, FTS4, FTS5, RTREE, and math function features in the bundled sqlite3 library.
+* Add support patches for Torch 2.7.0, PyGObject 3.52.3, xmlschema 4.0.0, lxml < 5.4.0, SciPy 1.15, jq 1.8.0, NumPy < 2.3, ormsgpack < 1.9.1, pandas 2.2.3, PyArrow 19.0, PyMuPDF 1.25.4.
+* The GraalPy Native standalone on Linux now uses the G1 garbage collector which is much faster.
+* Speedup native extensions by using the Panama NFI backend for faster native calls, available on GraalVM 25, JDK 25 and in the GraalPy JVM standalone.
 
 ## Version 24.2.0
 * Updated developer metadata of Maven artifacts.