Skip to content

[fix][EC][spark] resolve spark engine task execution failures and optimize logging#992

Open
v-kkhuang wants to merge 5 commits intodev-2.0.0from
dev-2.0.0-bug-fix
Open

[fix][EC][spark] resolve spark engine task execution failures and optimize logging#992
v-kkhuang wants to merge 5 commits intodev-2.0.0from
dev-2.0.0-bug-fix

Conversation

@v-kkhuang
Copy link
Copy Markdown

What is the purpose of the change

Background/Problem:
Currently, spark engine tasks fail during execution due to null pointer exceptions in logging initialization and exception handling issues. Additionally, dependency injection failures and inconsistent error logging affect system stability.

Purpose of Change:
To address these problems, this PR optimizes logging output, fixes spark init SQL exception handling, resolves dependency injection failures, and improves exception comments across multiple engine executors.

Value/Impact:
After the change, spark engine tasks execute more reliably with better error handling and logging, improving system stability and debugging capability.

Related issues/PRs

Related issues: close apache#5284
Related pr:none

Brief change log

  • Add CodeUtils utility class for common code operations
  • Optimize HDFSUtils keytab cache handling with null checks
  • Optimize logging output in spark, hive, flink, and other engine executors
  • Fix spark init SQL exception handling
  • Fix dependency injection failures in entrance module
  • Improve exception comments in multiple engine plugins
  • Update 2.0.0 feature documentation structure
  • Clean up obsolete test files and documentation

Checklist

  • I have read the Contributing Guidelines on pull requests.
  • I have explained the need for this PR and the problem it solves
  • I have explained the changes or the new features added to this PR
  • I have added tests corresponding to this change
  • I have updated the documentation to reflect this change
  • I have verified that this change is backward compatible
  • If this is a code change: I have written unit tests to fully verify the new behavior.

@v-kkhuang v-kkhuang added the bug Something isn't working label Apr 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant