Update Beam website to release 2.74.0 #38536
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
| @@ -0,0 +1,74 @@ | ||||||
| --- | ||||||
| title: "Apache Beam 2.74.0" | ||||||
| date: 2026-05-?? 9:00:00 -0700 | ||||||
| categories: | ||||||
| - blog | ||||||
| - release | ||||||
| authors: | ||||||
| - vterentev | ||||||
| --- | ||||||
| <!-- | ||||||
| Licensed under the Apache License, Version 2.0 (the "License"); | ||||||
| you may not use this file except in compliance with the License. | ||||||
| You may obtain a copy of the License at | ||||||
| http://www.apache.org/licenses/LICENSE-2.0 | ||||||
| Unless required by applicable law or agreed to in writing, software | ||||||
| distributed under the License is distributed on an "AS IS" BASIS, | ||||||
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||||||
| See the License for the specific language governing permissions and | ||||||
| limitations under the License. | ||||||
| --> | ||||||
|
|
||||||
| We are happy to present the new 2.74.0 release of Beam. | ||||||
| This release includes both improvements and new functionality. | ||||||
| See the [download page](/get-started/downloads/#2740-2026-05-??) for this release. | ||||||
|
|
||||||
| <!--more--> | ||||||
|
|
||||||
| For more information on changes in 2.74.0, check out the [detailed release notes](https://github.com/apache/beam/milestone/42). | ||||||
|
|
||||||
| ## Highlights | ||||||
|
|
||||||
| * Spark 4 runner support for Java SDK ([#38255](https://github.com/apache/beam/issues/38255)). | ||||||
|
|
||||||
| ### I/Os | ||||||
|
|
||||||
| * IcebergIO: support declaring a table's sort order on dynamic table creation via the new `sort_fields` config ([#38269](https://github.com/apache/beam/issues/38269)). | ||||||
| * IcebergIO: support writing with hash distribution mode, and with autosharding ([#38061](https://github.com/apache/beam/issues/38061))). | ||||||
|
Contributor
There was a problem hiding this comment. There is an extra closing parenthesis at the end of this line. It should be
Suggested change
|
||||||
|
|
||||||
| ### New Features / Improvements | ||||||
|
|
||||||
| * Capability introduces an indicator for aggregations and timers firing during a pipeline drain, allowing users and sinks to recognize and appropriately handle potentially incomplete or partial data ([#36884](https://github.com/apache/beam/issues/36884)). | ||||||
| * Added support for setting disk provisioned IOPS and throughput in Dataflow runner via `--diskProvisionedIops` and `--diskProvisionedThroughputMibps` pipeline options (Java/Go/Python) ([#38349](https://github.com/apache/beam/issues/38349)). | ||||||
| * TriggerStateMachineRunner changes from BitSetCoder to SentinelBitSetCoder to | ||||||
| encode finished bitset. SentinelBitSetCoder and BitSetCoder are state | ||||||
| compatible. Both coders can decode encoded bytes from the other coder | ||||||
| ([#38139](https://github.com/apache/beam/issues/38139)). | ||||||
| * (Python) Added type alias for with_exception_handling to be used for typehints. ([#38173](https://github.com/apache/beam/issues/38173)). | ||||||
| * (Java) BatchElements transform for Java SDK ([#38369](https://github.com/apache/beam/issues/38369)) | ||||||
| * Added plugin mechanism to support different Lineage implementations (Java) ([#36790](https://github.com/apache/beam/issues/36790)). | ||||||
| * (Python) Supported Python user type in Beam SQL. For example, SQL statements like `SELECT some_field from PCOLLECTION` can now operate a PCollection of Beam Row containing pickable Python user type ([#20738](https://github.com/apache/beam/issues/20738)). | ||||||
| * (Python) Introduced `beam.coders.registry.register_row` as preferred API to register a named tuple or dataclass with a Beam Row. At pipelne runtime, the original type associated with the registered row are preserved across the serialization boundary ([#38108](https://github.com/apache/beam/issues/38108)). | ||||||
|
Contributor
There was a problem hiding this comment. There is a typo in 'pipelne' (should be 'pipeline') and a grammatical error ('type ... are' should be 'type ... is').
Suggested change
|
||||||
|
|
||||||
| ### Breaking Changes | ||||||
|
|
||||||
| * (Python) Made Beartype the default fallback type checking tool. This can be disabled with the `--disable_beartype` pipeline option. ([#38275](https://github.com/apache/beam/issues/38275)) | ||||||
|
|
||||||
| ### Deprecations | ||||||
|
|
||||||
| * Dropped Java 8 support ([#31678](https://github.com/apache/beam/issues/31678)). | ||||||
| * Removed Samza Runner support ([#35448](https://github.com/apache/beam/issues/35448)). | ||||||
|
|
||||||
| ### Bugfixes | ||||||
|
|
||||||
| * Fixed BigQueryEnrichmentHandler batch mode dropping earlier requests when multiple requests share the same enrichment key (Python) ([#38035](https://github.com/apache/beam/issues/38035)). | ||||||
| * Added `max_batch_duration_secs` passthrough support in Python Enrichment BigQuery and CloudSQL handlers so batching duration can be forwarded to `BatchElements` ([#38243](https://github.com/apache/beam/issues/38243)). | ||||||
|
|
||||||
| ### Security Fixes | ||||||
|
|
||||||
| * Fixed [CVE-YYYY-NNNN](https://www.cve.org/CVERecord?id=CVE-YYYY-NNNN) (Java/Python/Go) ([#X](https://github.com/apache/beam/issues/X)). | ||||||
|
Contributor
There was a problem hiding this comment. This line contains placeholders ( |
||||||
| ## List of Contributors | ||||||
|
|
||||||
| According to git shortlog, the following people contributed to the 2.74.0 release. Thank you to all contributors! | ||||||
|
|
||||||
| Abdelrahman Ibrahim, Ahmed Abualsaud, Andrew Crites, Andrew Kabas, Arran Cudbard-Bell, Arun Pandian, Asish Kumar, Bentsi Leviav, Blake Jones, Bruno Volpato, Chris Jordan, Danny McCormick, Deji Ibrahim, Derrick Williams, Elia LIU, Ganesh Sivakumar, Jack McCluskey, Kenneth Knowles, Lalit Yadav, M Junaid Shaukat, Matej Aleksandrov, Prabhnoor Singh, Radek Stankiewicz, Radosław Stankiewicz, Reuven Lax, RuiLong J., Sam Whittle, Shunping Huang, Subramanya V, Tarun Annapareddy, Tobias Kaymak, TongruiLi, Valentyn Tymofieiev, Vitaly Terentyev, XQ Hu, Yi Hu, ZIHAN DAI, apanich, bambadiouf1, chenxuesdu, claudevdm, harshadkhetpal, johnjcasey, parveensania, tianz101 | ||||||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is an extra closing parenthesis at the end of this line. It should be
).instead of)).to correctly close the opening parenthesis and the markdown link.