Evaluations

Run a typed evaluation

Jev नामित प्रश्नों के आधार पर JSON state का मूल्यांकन करता है और boolean, choice या score प्रकार के उत्तर देता है। Bearer authentication के साथ POST /v1/evaluations कॉल करें; मॉडल की context window 32K tokens की है। Jev को /v1/models?output_modalities=decisions या /v1/models?output_modalities=all से खोजें; डिफ़ॉल्ट text-only मॉडल सूची में केवल decisions देने वाले मॉडल नहीं होते। Jev केवल evaluations endpoint के माध्यम से उपलब्ध है; chat-आकार के endpoint HTTP 400 लौटाते हैं। वर्तमान सूची मूल्य प्रति 1M input tokens $0.042 और प्रति 1M output tokens $0 है। उपयोग के लिए खाते में पर्याप्त credits होने चाहिए।

POST/v1/evaluations

प्राधिकरण

Authorizationआवश्यक

string · header

Authorization हेडर में bearer token के रूप में API कुंजी।

Body

model

string

The optional evaluation model in the request body. Omit it to use the default typesafe-ai/jev; any other value is rejected as model_not_available.

optional; defaults to typesafe-ai/jev

Example: "typesafe-ai/jev"

stateआवश्यक

JSON string | object | array

The state or evidence to evaluate. It may be a string, object, or array.

JSON value

Example: "The support agent issued a full refund."

questionsआवश्यक

record<string, Question>

One or more named questions evaluated in parallel.

typeआवश्यक

boolean | choice | score

The typed answer requested for this question.

instructionsआवश्यक

JSON string | object | array

Instructions describing what this question should decide.

criteria

record<string, JSON> | JSON[]

Required for choice questions as an option-to-description record; required for score questions as an ordered array of at least two criteria; optional for boolean questions.

POST /v1/evaluations

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
curl https://api.bazaarlink.ai/v1/evaluations \
  -H "Authorization: Bearer $BAZAARLINK_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "typesafe-ai/jev",
    "state": "The support agent issued a full refund and apologised for the delay.",
    "questions": {
      "refunded": {
        "type": "boolean",
        "instructions": "Was a refund issued?"
      },
      "tone": {
        "type": "choice",
        "instructions": "Tone of the agent?",
        "criteria": {
          "apologetic": "The agent apologises",
          "neutral": "No emotional language",
          "hostile": "The agent is rude"
        }
      },
      "quality": {
        "type": "score",
        "instructions": "How complete was the resolution?",
        "criteria": ["poor", "partial", "complete"]
      }
    }
  }'

प्रतिक्रिया उदाहरण

Success. The response includes id, object, model, answers, usage, rounding, and warnings. answers is keyed by question name; choice probabilities use option names as keys. For score questions, score is the expected value over indices 0 through N-1, and probabilities keys are the string indices in criteria order. usage reports input_tokens, output_tokens, and total_tokens; rounding reports probabilityDecimals and scoreDecimals.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
{
  "id": "eval-a3d350e5-2705-4a9b-be7c-838fa4e4eb2b",
  "object": "evaluation",
  "model": "typesafe-ai/jev",
  "answers": {
    "refunded": {
      "type": "boolean",
      "probability": 0.99
    },
    "tone": {
      "type": "choice",
      "choice": "apologetic",
      "probabilities": {
        "apologetic": 1,
        "neutral": 0,
        "hostile": 0
      }
    },
    "quality": {
      "type": "score",
      "score": 1.98,
      "probabilities": {
        "0": 0,
        "1": 0.02,
        "2": 0.98
      }
    }
  },
  "usage": {
    "input_tokens": 394,
    "output_tokens": 74,
    "total_tokens": 468
  },
  "rounding": {
    "probabilityDecimals": 2,
    "scoreDecimals": 2
  },
  "warnings": []
}