Glossary
Evaluation standard
Chainfore's seven published measures for an agent in production and the rule that every figure carries method, baseline, repeat count and limits.
Example
With zero failures in 300 independent, representative trials, the exact one-sided 95% upper bound on the failure rate is about 1%: arithmetic on a sample size, not a measured result.
Evaluation standard →Related terms
01pass^kThe probability that an agent succeeds on all k independent attempts at a task, as opposed to pass@k, the probability that at least one attempt succeeds. Enterprises need pass^k.02Buyer scorecardA weighted comparison of AI agent suppliers on a hidden test set: outcome, control and recovery, integration, economics, accountability.