The reliability curve: how well the engine's reported confidence predicts

the real-world honored rate, bucketed by confidence, with an Expected Calibration Error…

GET /v1/decisions/calibration

cURL

curl --request GET \
  --url 'https://api.nsr.stateset.com/v1/decisions/calibration' \
  --header "X-API-Key: $STATESET_NSR_API_KEY"

200

{
  "bins": [
    {
      "approvals": 1,
      "confidence_high": 7.5,
      "confidence_low": 7.5,
      "honored": 1,
      "honored_rate": 7.5
    }
  ],
  "expected_calibration_error": 7.5,
  "labeled_approvals": 1
}

the real-world honored rate, bucketed by confidence, with an Expected Calibration Error. Requires recorded outcomes (see the outcome endpoint) — this is what lets an operator set an auto-send threshold they can trust.

Required scope: read

Response

Calibration

bins · CalibrationBin[] · required

Populated confidence buckets, ascending.

Show CalibrationBin

approvals · integer · required

Approved decisions in this bucket that have a recorded outcome.

confidence_high · number (double) · required

confidence_low · number (double) · required

honored · integer · required

How many of them were honored.

honored_rate · number (double) · required

honored / approvals — should track the bucket’s confidence midpoint when the engine is well-calibrated.

expected_calibration_error · number (double) · required

Expected Calibration Error in [0, 1]; 0 = perfectly calibrated.

labeled_approvals · integer · required

Approved decisions in the window with a recorded outcome (the sample).

Status codes

Code	Meaning
200	Reliability curve
401	Unauthorized — missing or invalid credentials
403	Forbidden — the key/token lacks the required scope
429	Rate limited — see Retry-After / X-RateLimit-Reset

cURL

curl --request GET \
  --url 'https://api.nsr.stateset.com/v1/decisions/calibration' \
  --header "X-API-Key: $STATESET_NSR_API_KEY"

200

{
  "bins": [
    {
      "approvals": 1,
      "confidence_high": 7.5,
      "confidence_low": 7.5,
      "honored": 1,
      "honored_rate": 7.5
    }
  ],
  "expected_calibration_error": 7.5,
  "labeled_approvals": 1
}