Evaluate machine handler

Required scope: models:manage

POST /api/v1/machines/evaluate

cURL

curl --request POST \
  --url 'https://api.nsr.stateset.com/api/v1/machines/evaluate' \
  --header "X-API-Key: $STATESET_NSR_API_KEY" \
  --header 'Content-Type: application/json' \
  --data '{
  "examples": [
    {
      "expected_category": "string",
      "input": "string"
    }
  ]
}'

200

{
  "accuracy": 1.5,
  "correct": 1,
  "org_id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
  "total": 102
}

Required scope: models:manage

Request body

EvaluateRequest

examples · ProvisionTrainingExample[] · required

Test examples to evaluate the machine on.

Response

EvaluateResponse

accuracy · number (double) · required

correct · integer · required

org_id · string · required

total · integer · required

Status codes

Code	Meaning
200	Evaluation results
400	No test examples provided
401	Unauthorized — missing or invalid credentials
403	Forbidden — the key/token lacks the required scope
404	Machine not provisioned
429	Rate limited — see Retry-After / X-RateLimit-Reset

cURL

curl --request POST \
  --url 'https://api.nsr.stateset.com/api/v1/machines/evaluate' \
  --header "X-API-Key: $STATESET_NSR_API_KEY" \
  --header 'Content-Type: application/json' \
  --data '{
  "examples": [
    {
      "expected_category": "string",
      "input": "string"
    }
  ]
}'

200

{
  "accuracy": 1.5,
  "correct": 1,
  "org_id": "3fa85f64-5717-4562-b3fc-2c963f66afa6",
  "total": 102
}