Agent evals
Human Eval Panels Store
Structured human judgment at scale.
In the pipeline — stocking up Cluster: Agent Platform
Arriving in the Human Eval Panels Store
0 live products today — more arriving daily. These 1 kits are in production for this store.
In the pipelineHuman Evaluation Panel Playbook
PDF · Agent evals
$19 one-time
A 30-page playbook for running human eval panels: rater recruitment, inter-rater reliability measurement, adjudication workflows, and cost control.
Sibling stores in EvalWarden
More specialized shelves in the same ecosystem.
Eval Fundamentals Store
Agent evals
What good agent evaluation actually measures.
Browse →Golden Datasets Store
Agent evals
The ground truth your evals stand on.
Browse →LLM-as-Judge Store
Agent evals
Using models to grade models, carefully.
Browse →Task Success Metrics Store
Agent evals
Did the agent actually finish the job?
Browse →Faithfulness Evals Store
Agent evals
Checking agents against their sources.
Browse →Tool-Use Evals Store
Agent evals
Did the agent call the right tools?
Browse →Regression Evals Store
Agent evals
Catch capability loss before users do.
Browse →Eval Data Labeling Store
Agent evals
Labels your evals can trust.
Browse →DeepEval Workflows Store
Agent evals
Structured evals with DeepEval.
Browse →Red-Teaming Agents Store
Agent evals
Adversarial evals that find real weaknesses.
Browse →Safety Evals Store
Agent evals
Refusal, harm, and policy compliance checks.
Browse →Multi-Turn Evals Store
Agent evals
Conversations, not single shots.
Browse →
Parent ecosystem
The Human Eval Panels Store is one of 50 stores inside EvalWarden.
Start here
Three free or cheap entry points — pick whichever fits.
1
Free MIT playbook
The ghostcorpnet playbook — free, MIT-licensed. Read it here →
2
The $5 AI Agent Risk Scan
A five-minute self-audit of your agent setup. Get the scan →
Build on EvalWarden
Every ecosystem follows the open ghostcorpnet Pack Standard v1 — interoperable packs, a public directory, and a certification badge.