Skip to content

Ground truth validation: Phase 2 roadmap (coverage, gradients, numcrux) #984

Description

@michalharakal

Parent tracking issue for the follow-up work identified while wiring
skainet-test-groundtruth into real CI (see the PR that adds
.github/workflows/ground-truth.yml, closes the metadata-parsing gap, and adds
-PrequireGroundTruth). That change made the existing pipeline actually run and
actually fail loud when broken — it did not expand what the pipeline covers. This issue
tracks what's next.

Related: #447 ("Wire IREE execution into CI and gate on PyTorch numerical checks") is
the same idea for the compiled (IREE) path — this issue's Phase 1 work is the eager-path
analog, already landed. #321 (closed) has historical context on the 3-repo layout.

Sub-issues

  • Expand Python-side op coverage
  • Decide on gradient validation
  • Numcrux transfer/donation (governance)
  • (stretch) Single-source DSL generating both Kotlin and Python fixtures

Filed as separate linked issues so each can be picked up independently.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesttrackingParent/tracking issue with sub-issues

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions