Create Evaluation
POSThttps://cloud.agenta.ai/api/evaluations
Creates a new comparison table document Raises: HTTPException: description Returns: description
Request
- application/json
Body
required
app_id App Id (string)required
variant_ids string[]required
evaluators_configs string[]required
testset_id Testset Id (string)required
rate_limitobjectrequired
lm_providers_keysobject
correct_answer_columnobject
Responses
- 200
- 422
Successful Response
- application/json
- Schema
- Example (from schema)
Schema
Array [
]
id Id (string)required
app_id App Id (string)required
project_id Project Id (string)required
variant_ids string[]required
variant_names string[]required
variant_revision_ids string[]required
revisions string[]required
testset_idobject
testset_nameobject
statusobjectrequired
aggregated_resultsobject[]required
average_costobject
total_costobject
average_latencyobject
created_at date-timerequired
updated_at date-timerequired
[
{
"id": "string",
"app_id": "string",
"project_id": "string",
"variant_ids": [
"string"
],
"variant_names": [
"string"
],
"variant_revision_ids": [
"string"
],
"revisions": [
"string"
],
"testset_id": "string",
"testset_name": "string",
"status": {
"type": "string",
"error": {}
},
"aggregated_results": [
{
"evaluator_config": {},
"result": {
"type": "string",
"error": {}
}
}
],
"average_cost": {},
"total_cost": {},
"average_latency": {},
"created_at": "2024-11-22T12:54:54.291Z",
"updated_at": "2024-11-22T12:54:54.291Z"
}
]
Validation Error
- application/json
- Schema
- Example (from schema)
Schema
detailobject[]
{
"detail": [
{
"loc": [
"string",
0
],
"msg": "string",
"type": "string"
}
]
}
- curl
- python
- go
- nodejs
- ruby
- csharp
- php
- java
- powershell
- CURL
curl -L 'https://cloud.agenta.ai/api/evaluations' \
-H 'Content-Type: application/json' \
-H 'Accept: application/json' \
-H 'Authorization: <API_KEY_VALUE>' \
-d '{
"app_id": "string",
"variant_ids": [
"string"
],
"evaluators_configs": [
"string"
],
"testset_id": "string",
"rate_limit": {
"batch_size": 0,
"max_retries": 0,
"retry_delay": 0,
"delay_between_batches": 0
},
"lm_providers_keys": {},
"correct_answer_column": "string"
}'
ResponseClear