Agent evals

Golden Datasets Store

The ground truth your evals stand on.

In the pipeline — stocking up Cluster: Agent Platform

Arriving in the Golden Datasets Store

0 live products today — more arriving daily. These 1 kits are in production for this store.

In the pipeline

Golden Dataset Builder's Guide

PDF · Agent evals

$19 one-time

A 30-page guide to building golden eval datasets: example selection, labeling protocols, version control, and coverage analysis for agent tasks.

Sibling stores in EvalWarden

More specialized shelves in the same ecosystem.

Eval Fundamentals Store

Agent evals

What good agent evaluation actually measures.

Browse →

LLM-as-Judge Store

Agent evals

Using models to grade models, carefully.

Browse →

Task Success Metrics Store

Agent evals

Did the agent actually finish the job?

Browse →

Faithfulness Evals Store

Agent evals

Checking agents against their sources.

Browse →

Tool-Use Evals Store

Agent evals

Did the agent call the right tools?

Browse →

Regression Evals Store

Agent evals

Catch capability loss before users do.

Browse →

Human Eval Panels Store

Agent evals

Structured human judgment at scale.

Browse →

Eval Data Labeling Store

Agent evals

Labels your evals can trust.

Browse →

DeepEval Workflows Store

Agent evals

Structured evals with DeepEval.

Browse →

Red-Teaming Agents Store

Agent evals

Adversarial evals that find real weaknesses.

Browse →

Safety Evals Store

Agent evals

Refusal, harm, and policy compliance checks.

Browse →

Multi-Turn Evals Store

Agent evals

Conversations, not single shots.

Browse →

Parent ecosystem

The Golden Datasets Store is one of 50 stores inside EvalWarden.

EvalWarden

Agent evals

Test your agents like you mean it.

Explore the ecosystem →

Start here

Three free or cheap entry points — pick whichever fits.

1

Free MIT playbook

The ghostcorpnet playbook — free, MIT-licensed. Read it here →

2

The $5 AI Agent Risk Scan

A five-minute self-audit of your agent setup. Get the scan →

3

Browse the catalog

Every ghostcorpnet product in one filterable grid. Open the catalog →

Build on EvalWarden

Every ecosystem follows the open ghostcorpnet Pack Standard v1 — interoperable packs, a public directory, and a certification badge.