Skip to content

[feat][CGS][engineconn-manager] add support for hadoop3 engine material refresh#996

Open
v-kkhuang wants to merge 2 commits intodev-2.0.0from
dev-2.0.0-hadoop3-sup
Open

[feat][CGS][engineconn-manager] add support for hadoop3 engine material refresh#996
v-kkhuang wants to merge 2 commits intodev-2.0.0from
dev-2.0.0-hadoop3-sup

Conversation

@v-kkhuang
Copy link
Copy Markdown

What is the purpose of the change

Background/Problem:
Currently, the engineconn manager does not fully support hadoop3 engine material refresh functionality. This can cause issues when engine materials need to be updated or refreshed in hadoop3 environments, affecting engine startup and resource management.

Purpose of Change:
To address this problem, this PR adds support for hadoop3 engine material refresh by enhancing the engineconn manager's configuration, command building, and launch processes to properly handle material refresh operations in hadoop3 environments.

Value/Impact:
After the change, hadoop3 engine materials can be refreshed properly, improving engine startup reliability and resource management in hadoop3 environments.

Related issues/PRs

Related issues: close #995
Related pr:none

Brief change log

  • Add configuration options in ECPCoreConf for hadoop3 material refresh
  • Enhance ProcessEngineCommandBuilder to support material refresh commands
  • Update ProcessEngineConnLaunch to handle material refresh during engine startup
  • Improve Environment handling for hadoop3 specific variables

Checklist

  • I have read the Contributing Guidelines on pull requests.
  • I have explained the need for this PR and the problem it solves
  • I have explained the changes or the new features added to this PR
  • I have added tests corresponding to this change
  • I have updated the documentation to reflect this change
  • I have verified that this change is backward compatible
  • If this is a code change: I have written unit tests to fully verify the new behavior.

@v-kkhuang v-kkhuang added the enhancement New feature or request label Apr 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants