Skip to content

[CG-13] Quality check of the Broadleaf Insights (manual sampling) #13

Description

@jgrodziski

Priority: P1
Owner: Jérémie

Context

Run facts: full walk of the graph, ~25 000 LLM requests through OpenRouter with a cheap Flash-class model, > 24 h wall time, ~$13–15 total. A retry was added after the run failed on exhausted credit. The file is valuable — don't lose it. Broadleaf was chosen on purpose because its domain structure is poor.

Description

Sample entities, read the code, read the generated explanation, check the model isn't making things up. Prerequisite to reusing the pipeline on client codebases.

Acceptance criteria

  • Sampled review documented (n entities, error rate, typical failure modes)
  • Insights file shared with David

Source: CodeGraph backlog extracted from the 2026-09-21 weekly (David / Jérémie).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions