Skip to content

[feature][EC][spark] add spark timeout task diagnosis and configuration optimization #5385

@aiceflower

Description

@aiceflower

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Spark tasks need timeout diagnosis and configuration optimization.

Description

Add Spark timeout task diagnosis feature and optimize related configurations.

Use case

When Spark tasks timeout, users can get diagnostic information to identify root causes and optimize configurations.

Solutions

  1. Added Spark timeout task diagnosis feature
  2. Optimized Spark related configurations for better performance

Anything else

None.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions