evals-engineering

Here are 5 public repositories matching this topic...

pinecone-io / cultivar

Use cultivar to test your Agent Skills and Docs by running them in sandboxes, and across different agents.

agent benchmarking modal tests typesafe testing-tools cursor copilot codex pinecone evals pinecone-db gemini-cli agent-skills claude-code agent-traces evals-engineering jev typesafe-ai

Updated Sep 18, 2026
Python

sutro-sh / sutro

Star

Optimize and run consistent AI Functions.

s3 prompt data-engineering data-pipelines observability evaluation-framework synthetic-data unstructured-data mlops batch-inference prompt-engineering llm-inference evals distributed-inference evals-engineering

Updated Sep 17, 2026
Python

rishabhsaini282 / blogs-llm-evaluation-evals-engineering

Star

Salary benchmarks, CI/CD regression testing pipelines, OpenTelemetry standards, and enterprise rubrics for LLM Evals Engineers in 2026.

opentelemetry prompt-engineering ai-testing llmops langfuse llm-evaluation rag-evaluation deepeval evals-engineering

Updated May 30, 2026

PithomLabs / pithomlabs.github.io

Star

Pithom Labs Blog

javascript golang ai hugo physics software-engineering evals-engineering

Updated Jun 10, 2026
HTML

Ed-Marcavage / awesome-eval-engineering

Star

Awesome list for eval engineering (evals engineering): tools that automate LLM evals and agent evals, turn traces into test cases, and calibrate LLM-as-a-judge.

awesome awesome-list ai-agents ai-evaluation ai-testing llm-eval evals llm-evaluation llm-as-judge llm-as-a-judge llm-testing llm-evals agent-evals agent-evaluation ai-evals evaluation-engineering evals-engineering eval-engineering

Updated Sep 15, 2026

Add this topic to your repo

To associate your repository with the evals-engineering topic, visit your repo's landing page and select "manage topics."

Learn more