Llm
For instructions on how to authenticate to use this endpoint, see API overview.
Endpoints
GET | |
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
POST | |
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
GET | |
GET | |
POST | |
GET | |
POST | |
GET | |
PATCH |
Retrieve llm analytics models
List available models, for one provider or for every supported provider.
Required API key scopes
llm_analytics:readQuery parameters
- key_idstring
- providerstringOne of:
"anthropic""azure_openai""fireworks""gemini""minimax""openai""openai_compatible""openrouter""system_one""together_ai"
Response
Example request
GET /api /projects /:project_id /llm_analytics /modelsExample response
Status 200
RESPONSE
List all llm analytics parser recipes
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- offsetinteger
Response
Example request
GET /api /projects /:project_id /llm_analytics /parser_recipesExample response
Status 200
RESPONSE
Create llm analytics parser recipes
Required API key scopes
llm_analytics:writeRequest parameters
- namestring
- sourcestring
Response
Example request
POST /api /projects /:project_id /llm_analytics /parser_recipesExample response
Status 201
RESPONSE
Retrieve llm analytics parser recipes
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 200
RESPONSE
Update llm analytics parser recipes
Required API key scopes
llm_analytics:writePath parameters
- idstring
Request parameters
- namestring
- sourcestring
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 200
RESPONSE
Delete llm analytics parser recipes
Required API key scopes
llm_analytics:writePath parameters
- idstring
Example request
DELETE /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 204 No response body
Create llm analytics provider key validations
Validate LLM provider API keys without persisting them
Required API key scopes
llm_provider_key:writeExample request
POST /api /projects /:project_id /llm_analytics /provider_key_validationsExample response
Status 200
List all llm analytics provider keys
Required API key scopes
llm_provider_key:readQuery parameters
- limitinteger
- offsetinteger
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keysExample response
Status 200
RESPONSE
Create llm analytics provider keys
Required API key scopes
llm_provider_key:writeRequest parameters
- provider
- namestring
- api_keystring
- base_urlstring
- system_one_modelstring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /projects /:project_id /llm_analytics /provider_keysExample response
Status 201
RESPONSE
Retrieve llm analytics provider keys
Required API key scopes
llm_provider_key:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Update llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- base_urlstring
- system_one_modelstring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Delete llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Example request
DELETE /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 204 No response body
Retrieve llm analytics provider keys dependent configs
Get evaluations using this key and alternative keys for replacement.
Required API key scopes
llm_provider_key:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /:id /dependent_configsExample response
Status 200
RESPONSE
List all llm analytics provider keys models
Models this provider key can run, as the model pickers list them. Scoped to the project in the URL, so a page on a project other than the user's current one still lists its own keys' models.
Required API key scopes
llm_provider_key:readPath parameters
- idstring
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /:id /modelsExample response
Status 200
RESPONSE
Create llm analytics provider keys validate
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- base_urlstring
- system_one_modelstring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /projects /:project_id /llm_analytics /provider_keys /:id /validateExample response
Status 200
RESPONSE
List all llm analytics review queue items
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- offsetinteger
- order_bystring
- queue_idstring
- searchstring
- trace_idstring
- trace_id__instring
Response
Example request
GET /api /projects /:project_id /llm_analytics /review_queue_itemsExample response
Status 200
RESPONSE
Create llm analytics review queue items
Required API key scopes
llm_analytics:writeRequest parameters
- queue_idstring
- trace_idstring
Response
Example request
POST /api /projects /:project_id /llm_analytics /review_queue_itemsExample response
Status 201
RESPONSE
Retrieve llm analytics review queue items
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE
Update llm analytics review queue items
Required API key scopes
llm_analytics:writePath parameters
- idstring
Request parameters
- queue_idstring
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE





