Skip to content

feat(frontend): migrate evaluator configs CRUD#3576

Merged
mmabrouk merged 15 commits intochore/migrate-evaluatorsfrom
feat/migrate-evaluator-playground-frontend
Feb 16, 2026
Merged

feat(frontend): migrate evaluator configs CRUD#3576
mmabrouk merged 15 commits intochore/migrate-evaluatorsfrom
feat/migrate-evaluator-playground-frontend

Conversation

@mmabrouk
Copy link
Member

@mmabrouk mmabrouk commented Jan 28, 2026

Summary

  • migrate evaluator config CRUD to SimpleEvaluator endpoints and types
  • switch evaluator config form state to parameters/data.parameters with updated registry usage
  • align online/new evaluation UI with resolved evaluator keys and parameters, update migration docs

Testing

  • pnpm lint-fix (warns about in web/oss/src/components/Editor/plugins/code/nodes/Base64Node.tsx)

Open with Devin

@vercel
Copy link

vercel bot commented Jan 28, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
agenta-documentation Ready Ready Preview, Comment Feb 16, 2026 1:06pm

Request Review

Copy link
Contributor

@devin-ai-integration devin-ai-integration bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 7 additional flags.

Open in Devin Review

@mmabrouk
Copy link
Member Author

Checked backend: Simple Evaluator responses intentionally do not include revision fields. DTO SimpleEvaluator has only id/slug/lifecycle/header/metadata + flags/data (no revision_id). See api/oss/src/core/evaluators/dtos.py#L278 and response models in api/oss/src/apis/fastapi/evaluators/models.py#L178. Service fetches latest EvaluatorRevision internally but returns SimpleEvaluator without revision fields (api/oss/src/core/evaluators/service.py#L976).

@mmabrouk mmabrouk marked this pull request as ready for review February 13, 2026 19:55
Expose output schemas from evaluator templates and send them on config create/edit, including dynamic derivation for auto_ai_critique and json_multi_field_match. Also remove legacy /evaluators/map usage and relax config listing filters so older non-human configs remain visible.
@dosubot dosubot bot added size:XXL This PR changes 1000+ lines, ignoring generated files. Frontend labels Feb 13, 2026
Copy link
Contributor

@devin-ai-integration devin-ai-integration bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 10 additional findings.

Open in Devin Review

…ound-run

feat(frontend): migrate evaluator run invocation
@mmabrouk mmabrouk merged commit 9aff016 into chore/migrate-evaluators Feb 16, 2026
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Frontend size:XXL This PR changes 1000+ lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants