Skip to content

Feat/benchmark artifact manifests - #12

Closed
BurhanAbdullah wants to merge 9 commits into
Power-Agent:mainfrom
BurhanAbdullah:feat/benchmark-artifact-manifests
Closed

BurhanAbdullah wants to merge 9 commits into
Power-Agent:mainfrom
BurhanAbdullah:feat/benchmark-artifact-manifests

Conversation

@BurhanAbdullah

Copy link
Copy Markdown
Contributor

Adds SHA-256 manifests for benchmark artifacts, including file sizes, checksums, and optional run metadata. Includes integrity verification, regression tests, documentation, and CI integration.

Validation: Local tests passed; upstream CI is pending.

@kosmylo

kosmylo commented Oct 23, 2026

Copy link
Copy Markdown
Collaborator

Thanks for the contribution. The checksum manifest has a clear use for detecting missing or modified files in a shared result bundle. However, it is optional artifact-integrity tooling rather than a requirement for benchmark execution or scoring.

I suggest deferring this PR until we define a concrete publication, archival, or submission workflow that will use the manifest. A documented manual workflow would be sufficient, but the current proposal does not establish why the benchmark needs to maintain this additional CLI and file format now.

If we proceed, please reconcile the branch with current main and preserve the scoped Level 2 test command introduced in PR #10. The older workaround that installs pytest for unrestricted unittest discovery is no longer needed for that job.

@kosmylo kosmylo closed this Oct 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants