Skip to content

[format] Fix ORC zstd compression option inconsistent across writers - #9453

Merged
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/jvm-zstd-bug
Aug 29, 2026
Merged

[format] Fix ORC zstd compression option inconsistent across writers#9453
JingsongLi merged 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/jvm-zstd-bug

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • Multiple ORC writers on same JVM share the options. When writers use different compression settings, one writer overwrites the settings used by another.
  • Paimon applies each writer’s compression level and window size directly to the shared defaults, making the resulting compression depend on writer creation order.
  • Ensure each writer gets it's own copy

Tests

  • UT

@JingsongLi JingsongLi closed this Aug 28, 2026
@JingsongLi JingsongLi reopened this Aug 28, 2026
@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit 42b39f1 into apache:master Aug 29, 2026
24 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants