Agent evals

Eval Tooling Build Store

Build your own eval harness.

In the pipeline — stocking up Cluster: Agent Platform

Arriving in the Eval Tooling Build Store

0 live products today — more arriving daily. These 1 kits are in production for this store.

In the pipeline

Custom Eval Harness Builder

PPTX · Agent evals

$79 one-time

A 60-slide guide to building custom evaluation harnesses: runner architecture, result storage schemas, and comparison views.

Sibling stores in EvalWarden

More specialized shelves in the same ecosystem.

Eval Fundamentals Store

Agent evals

What good agent evaluation actually measures.

Browse →

Golden Datasets Store

Agent evals

The ground truth your evals stand on.

Browse →

LLM-as-Judge Store

Agent evals

Using models to grade models, carefully.

Browse →

Task Success Metrics Store

Agent evals

Did the agent actually finish the job?

Browse →

Faithfulness Evals Store

Agent evals

Checking agents against their sources.

Browse →

Tool-Use Evals Store

Agent evals

Did the agent call the right tools?

Browse →

Regression Evals Store

Agent evals

Catch capability loss before users do.

Browse →

Human Eval Panels Store

Agent evals

Structured human judgment at scale.

Browse →

Eval Data Labeling Store

Agent evals

Labels your evals can trust.

Browse →

DeepEval Workflows Store

Agent evals

Structured evals with DeepEval.

Browse →

Red-Teaming Agents Store

Agent evals

Adversarial evals that find real weaknesses.

Browse →

Safety Evals Store

Agent evals

Refusal, harm, and policy compliance checks.

Browse →

Parent ecosystem

The Eval Tooling Build Store is one of 50 stores inside EvalWarden.

EvalWarden

Agent evals

Test your agents like you mean it.

Explore the ecosystem →

Start here

Three free or cheap entry points — pick whichever fits.

1

Free MIT playbook

The ghostcorpnet playbook — free, MIT-licensed. Read it here →

2

The $5 AI Agent Risk Scan

A five-minute self-audit of your agent setup. Get the scan →

3

Browse the catalog

Every ghostcorpnet product in one filterable grid. Open the catalog →

Build on EvalWarden

Every ecosystem follows the open ghostcorpnet Pack Standard v1 — interoperable packs, a public directory, and a certification badge.