Agent evals

Eval Fundamentals Store

What good agent evaluation actually measures.

In the pipeline — stocking up Cluster: Agent Platform

Arriving in the Eval Fundamentals Store

0 live products today — more arriving daily. These 1 kits are in production for this store.

In the pipeline

Agent Evaluation Fundamentals Guide

PDF · Agent evals

$19 one-time

A 35-page introduction to evaluating AI agents: task success vs process quality, metric selection, and the difference between demos and evidence.

Sibling stores in EvalWarden

More specialized shelves in the same ecosystem.

Golden Datasets Store

Agent evals

The ground truth your evals stand on.

Browse →

LLM-as-Judge Store

Agent evals

Using models to grade models, carefully.

Browse →

Task Success Metrics Store

Agent evals

Did the agent actually finish the job?

Browse →

Faithfulness Evals Store

Agent evals

Checking agents against their sources.

Browse →

Tool-Use Evals Store

Agent evals

Did the agent call the right tools?

Browse →

Regression Evals Store

Agent evals

Catch capability loss before users do.

Browse →

Human Eval Panels Store

Agent evals

Structured human judgment at scale.

Browse →

Eval Data Labeling Store

Agent evals

Labels your evals can trust.

Browse →

DeepEval Workflows Store

Agent evals

Structured evals with DeepEval.

Browse →

Red-Teaming Agents Store

Agent evals

Adversarial evals that find real weaknesses.

Browse →

Safety Evals Store

Agent evals

Refusal, harm, and policy compliance checks.

Browse →

Multi-Turn Evals Store

Agent evals

Conversations, not single shots.

Browse →

Parent ecosystem

The Eval Fundamentals Store is one of 50 stores inside EvalWarden.

EvalWarden

Agent evals

Test your agents like you mean it.

Explore the ecosystem →

Start here

Three free or cheap entry points — pick whichever fits.

1

Free MIT playbook

The ghostcorpnet playbook — free, MIT-licensed. Read it here →

2

The $5 AI Agent Risk Scan

A five-minute self-audit of your agent setup. Get the scan →

3

Browse the catalog

Every ghostcorpnet product in one filterable grid. Open the catalog →

Build on EvalWarden

Every ecosystem follows the open ghostcorpnet Pack Standard v1 — interoperable packs, a public directory, and a certification badge.