Skip to main content
The harness scores each model decision against configurable KPI weights. This lets teams encode business priorities into agent behavior without changing agent code.

KPI Dimensions

Configuration

Weights

Weights are relative — they don’t need to sum to 1.0 (they are normalized internally). They control the relative importance of each dimension in the composite score.

Targets

Targets set minimum acceptable values. If a model’s score for a dimension falls below the target, it is penalized in the composite score.

Scoring Formula

The composite score for a model is:
Where w_* are the normalized weights and utility values are computed from model priors.

Quality Priors

Built-in quality priors for common models (OpenAI):

Per-Agent KPI Weights

Different agents can have different priorities: