Design eval run queue

POST/v1/design/evals/runs

Signed-in sessionLaunch key product.design.evalsOperation design_eval_run_queue

An internal tool for design rules and components that agents synthesize, review and promote, with evaluation runs to check them.

Body

expectedAuthorizationVersionstring
split"challenge" | "golden" | "holdout"Required
modelobjectRequired
gateIdstringRequired
issuerIdstringRequired
configurationDigeststringRequired
candidateBundleIdstringRequired
baselineBundleIdstringRequired
promptDigeststringRequired
repoDigeststringRequired
commitDigeststringRequired

Returns

Nothing: the response's result is empty.

Errors

400, 401, 403, 404, 409, 429 and 503 return {"error": {"code", "message", "correlationId"}}.

POST/v1/design/evals/runs

curl "$SPECIFY_API_ORIGIN/v1/design/evals/runs" \
  -X POST \
  -H "Authorization: Bearer $SPECIFY_SESSION_TOKEN" \
  -H "X-Specify-Account-Id: <accountId>" \
  -H "X-Specify-Service-Tenancy-Id: <serviceTenancyId>" \
  -H "Content-Type: application/json" \
  -d '{"split":"challenge","model":{"provider":"<provider>","name":"<name>","version":"<version>","settingsHash":"<settingsHash>"},"gateId":"<gateId>","issuerId":"<issuerId>","configurationDigest":"<configurationDigest>","candidateBundleId":"<candidateBundleId>","baselineBundleId":"<baselineBundleId>","promptDigest":"<promptDigest>","repoDigest":"<repoDigest>","commitDigest":"<commitDigest>"}'

Response

{
  "result": "<result>"
}