---
title: "Evaluation standard: definition | Chainfore"
url: https://chainfore.com/glossary/evaluation-standard
updated: 2026-10-22
summary: "Chainfore's seven published measures for an agent in production and the rule that every figure carries method, baseline, repeat count and limits."
---

Glossary

# Evaluation standard

Chainfore's seven published measures for an agent in production and the rule that every figure carries method, baseline, repeat count and limits.

## Example

With zero failures in 300 independent, representative trials, the exact one-sided 95% upper bound on the failure rate is about 1%: arithmetic on a sample size, not a measured result.

## Related terms

- 01 pass^k: The probability that an agent succeeds on all k independent attempts at a task, as opposed to pass@k, the probability that at least one attempt succeeds. Enterprises need pass^k.

- 02 Buyer scorecard: A weighted comparison of AI agent suppliers on a hidden test set: outcome, control and recovery, integration, economics, accountability.