Skip to content

[WIP] Performance tests - #3630

Draft
csviri wants to merge 5 commits into
operator-framework:mainfrom
csviri:performance-tests
Draft

csviri wants to merge 5 commits into
operator-framework:mainfrom
csviri:performance-tests

Conversation

@csviri

@csviri csviri commented Sep 20, 2026

Copy link
Copy Markdown
Collaborator

No description provided.

Signed-off-by: Attila Mészáros <a_meszaros@apple.com>
Signed-off-by: Attila Mészáros <a_meszaros@apple.com>
Split performance-tests into submodules and record the results of every run
so they can be compared across commits.

- jmh: the existing benchmarks and in-process throughput tests
- e2e: reconciliation throughput of an operator against a real cluster
- reporting: writes the measurements of both as JSON

Results are keyed by commit, ordered by commit timestamp and indexed in
index.json. The workflow runs on main and next, merges the results of all
jobs and commits them to the performance-test-results branch.

Also fixes PrimaryToSecondaryIndexBenchmark, which did not compile against
the current onAddOrUpdate signature, and excludes the JMH generated classes
from spotbugs so that the module passes verify.
Signed-off-by: Attila Mészáros <a_meszaros@apple.com>
jmh.version, maven-shade-plugin.version, the jackson-databind version and
the operator-framework-core test-jar version were referenced but never
defined, so the perf module POMs could not be parsed. skipPerformanceTests
also got lost when the single module was split up.
@openshift-ci openshift-ci Bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Sep 20, 2026
@coderabbitai

coderabbitai Bot commented Sep 20, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@csviri csviri linked an issue Sep 20, 2026 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Performance Tests

1 participant