Compare two model checkpoints

Required scope: models:manage

POST /api/v1/model/compare

cURL

curl --request POST \
  --url 'https://api.nsr.stateset.com/api/v1/model/compare' \
  --header "X-API-Key: $STATESET_NSR_API_KEY" \
  --header 'Content-Type: application/json' \
  --data '{
  "checkpoint_a": "string",
  "checkpoint_b": "string"
}'

200

{
  "checkpoint_a": "string",
  "checkpoint_b": "string",
  "config_changes": [
    {
      "field": "string",
      "value_a": "string",
      "value_b": "string"
    }
  ],
  "metric_diffs": {
    "accuracy_diff": 1.5,
    "f1_diff": 1.5,
    "loss_diff": 1.5
  },
  "recommendation": "string"
}

Required scope: models:manage

Request body

CompareModelsRequest

checkpoint_a · string · required

First checkpoint ID

checkpoint_b · string · required

Second checkpoint ID

Response

ModelComparison

checkpoint_a · string · required

Checkpoint A identifier

checkpoint_b · string · required

Checkpoint B identifier

config_changes · ConfigChange[] · required

Configuration changes

Show ConfigChange

field · string · required

Field that changed

value_a · string · required

Value in checkpoint A

value_b · string · required

Value in checkpoint B

metric_diffs · MetricDiff · required

Show MetricDiff

accuracy_diff · number (double) · required

Accuracy difference (B - A)

f1_diff · number (double) · required

F1 score difference

loss_diff · number (double) · required

Loss difference

recommendation · string · required

Recommendation

Status codes

Code	Meaning
200	Comparison result
401	Unauthorized — missing or invalid credentials
403	Forbidden — the key/token lacks the required scope
404	Checkpoint not found
429	Rate limited — see Retry-After / X-RateLimit-Reset

cURL

curl --request POST \
  --url 'https://api.nsr.stateset.com/api/v1/model/compare' \
  --header "X-API-Key: $STATESET_NSR_API_KEY" \
  --header 'Content-Type: application/json' \
  --data '{
  "checkpoint_a": "string",
  "checkpoint_b": "string"
}'

200

{
  "checkpoint_a": "string",
  "checkpoint_b": "string",
  "config_changes": [
    {
      "field": "string",
      "value_a": "string",
      "value_b": "string"
    }
  ],
  "metric_diffs": {
    "accuracy_diff": 1.5,
    "f1_diff": 1.5,
    "loss_diff": 1.5
  },
  "recommendation": "string"
}