Skip to content

[INLONG-12198][SDK] Make getWorker atomic in Dataproxy Go SDK - #12205

Open
yfsn666 wants to merge 1 commit into
apache:masterfrom
yfsn666:INLONG-12198
Open

[INLONG-12198][SDK] Make getWorker atomic in Dataproxy Go SDK#12205
yfsn666 wants to merge 1 commit into
apache:masterfrom
yfsn666:INLONG-12198

Conversation

@yfsn666

@yfsn666 yfsn666 commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Fixes #12198

Motivation

In the Dataproxy Go SDK, concurrent Send calls can start the round-robin scan from the same worker index, so the load is not evenly distributed across workers under high concurrency.

Modifications

Changed client.getWorker() to use the return value of the atomic increment (Add(1) - 1) as the starting index, ensuring each concurrent caller gets a distinct sequence number.

Verifying this change

(Please pick either of the following options)

  • This change is a trivial rework/code cleanup without any test coverage.

  • This change is already covered by existing tests, such as:
    (please describe tests)

  • This change added tests and can be verified as follows:

    (example:)

    • Added integration tests for end-to-end deployment with large payloads (10MB)
    • Extended integration test for recovery after broker failure

Documentation

  • Does this pull request introduce a new feature? no

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Improve][SDK] Fix non-atomic worker selection in getWorker in the DataProxy Go SDK

1 participant