Evals Control Room

Evals Control RoomPublic-safe prototype
Job function classifierGolden set / release gate
Promotion gateBlocked by 3 regressions
Last run · 4m ago · deterministic fixture
Overall accuracy94.2%Target 95.0% · -1.6 pp
Edge-case F181.4%Target 88.0% · -7.1 pp
Cost / 1K$0.8418% below baseline
p95 latency620 msWithin 800 ms budget
Regression triage
CaseSliceExpectedActualConfidenceResult
Ambiguous leadershipProductOperations0.62
Technical productProductEngineering0.68
Adjacent functionOperationsProduct0.73
Core productProductProduct0.97
Technical productProductProduct0.91
Confusion matrixSelected slice
ProductEngineeringOperationsProduct14612Engineering0410Operations1049
CorrectRegression