Performance Arena & Certification

"Vs your previous process"

Comparisons between AI and named people create the wrong incentives. The Performance Arena measures an agent against the tenant's previous process baseline for the same task class: cost, quality and speed before the rental, which may have included tools, outsourcing or manual work. No human-versus-AI leaderboards or named-person comparisons are allowed in the UI or exports.

Scorecards

Standard scorecard dimensions carry default weights: outcomes 35%, quality 25%, safety and compliance 20% (any S1 or S2 failure fails the dimension), with efficiency making up the rest. Shadow agreement metrics and scorecards per agent are an internal view in Year 1. A tenant-visible Arena dashboard per agent and squad is planned for W3.

Evidence before claims

Each Verified agent has an evidence pack: segment, channel, sample size, method, confidence, eval results and simulator results. Offline benchmarks on simulator scenarios use significance tests before any claim, and outcome benchmarks come from holdouts linked to the Ledger. Marketing claims need an evidence pack approved by product and legal.

Three trust levels

• Listed: template spec complete, Eval Pack minimum, persona policy and owner.
• Verified: template Eval Coverage of at least 85 on allowed skills, simulator pass, disclosure policy, owner and stop triggers. Where live data is missing, the label says "Simulator-verified".
• Certified Outcome (later): Verified plus holdout-validated lift in several tenants of the target segment and a dispute rate below threshold.

The Certification Center

Planned in full for W3, the Certification Center runs submissions through automated checks (Eval Coverage Score, skill pack security scan, persona policy validity and ledger checks) and human review. Recertification happens on template major versions, at a fixed interval and automatically after incidents. Certification data feeds Store capability cards with level, date and evidence summary. Partner templates are certified under the Marketplace Trust Standard.