Skip to content

HIVE-29656: q.out regex fix#6547

Open
illiabarbashov-sketch wants to merge 1 commit into
apache:masterfrom
illiabarbashov-sketch:HIVE-29656-q_out_regex
Open

HIVE-29656: q.out regex fix#6547
illiabarbashov-sketch wants to merge 1 commit into
apache:masterfrom
illiabarbashov-sketch:HIVE-29656-q_out_regex

Conversation

@illiabarbashov-sketch

@illiabarbashov-sketch illiabarbashov-sketch commented Jun 17, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

  1. Adds masks to non-deterministic values in the .q.out files (killedVertices)
  2. Deduplicates consecutive standalone vertex-killed lines
  3. Squashes multiple consecutive embedded Masked entries on the same line

Why are the changes needed?

  1. To improve determinism in query test runs. (Reduce flakiness)

Does this PR introduce any user-facing change?

No

How was this patch tested?

  • Unit tests
  • Query tests with clientpositive and clientnegative cases

@sonarqubecloud

Copy link
Copy Markdown

@abstractdog abstractdog left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

patch looks good, we need to extend it for the currently existing (negative) q.outs
maybe having a look at those changes might make us more confident that this patch is correct

Comment on lines +1025 to +1026
// This preserves backward compatibility with existing .q.out files that were written
// before the masking rules were introduced.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we need backward compatibility: if the masking rules change, all the q.outs should change

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants