Skip to content

[SPARK-54713][SPARK-55030][SPARK-55031][PYTHON][SQL][FOLLOWUP] Add Scala/Python bindings for vector functions#56322

Open
sarutak wants to merge 3 commits into
apache:masterfrom
sarutak:pyspark-vector-functions
Open

[SPARK-54713][SPARK-55030][SPARK-55031][PYTHON][SQL][FOLLOWUP] Add Scala/Python bindings for vector functions#56322
sarutak wants to merge 3 commits into
apache:masterfrom
sarutak:pyspark-vector-functions

Conversation

@sarutak
Copy link
Copy Markdown
Member

@sarutak sarutak commented Jun 4, 2026

What changes were proposed in this pull request?

This PR adds following Scala/Python bindings for vector functions which were added in SPARK-55030 (#53924), SPARK-55593 (#54368) and SPARK-55031 (#54011)

Why are the changes needed?

For better built-in function parity.

Does this PR introduce any user-facing change?

Yes, new built-in functions introduced.

How was this patch tested?

New tests.

Was this patch authored or co-authored using generative AI tooling?

Kiro CLI / Claude.

@sarutak sarutak force-pushed the pyspark-vector-functions branch from 913cf92 to 9fad765 Compare June 4, 2026 13:33
@sarutak sarutak changed the title [SPARK-54713][SPARK-55030][SPARK-55031][SQL][FOLLOWUP] Add PySpark bindings for vector functions [SPARK-54713][SPARK-55030][SPARK-55031][SQL][FOLLOWUP] Add Scala/Python bindings for vector functions Jun 4, 2026
@sarutak sarutak force-pushed the pyspark-vector-functions branch from 71c0a0c to d822a56 Compare June 4, 2026 15:43
@zhengruifeng
Copy link
Copy Markdown
Contributor

Nit, it is a user-facing PR that add new features, maybe worth a regular ticket other than followups

@zhengruifeng zhengruifeng changed the title [SPARK-54713][SPARK-55030][SPARK-55031][SQL][FOLLOWUP] Add Scala/Python bindings for vector functions [SPARK-54713][SPARK-55030][SPARK-55031][PYTHON][SQL][FOLLOWUP] Add Scala/Python bindings for vector functions Jun 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants