List Scorers With Filters
curl --request POST \
--url https://api.galileo.ai/v2/scorers/list \
--header 'Content-Type: application/json' \
--header 'Galileo-API-Key: <api-key>' \
--data '
{
"filters": [
{
"value": "<string>",
"name": "name",
"case_sensitive": false
}
],
"sort": {
"name": "name",
"ascending": true,
"sort_type": "column"
}
}
'{
"starting_token": 0,
"limit": 100,
"paginated": false,
"next_starting_token": 123,
"scorers": [
{
"id": "<string>",
"name": "<string>",
"tags": [
"<string>"
],
"defaults": {
"model_name": "<string>",
"num_judges": 123,
"filters": [
{
"value": "<string>",
"name": "node_name",
"case_sensitive": true
}
],
"scoreable_node_types": [
"<string>"
],
"cot_enabled": true
},
"latest_version": {
"id": "<string>",
"version": 123,
"scorer_id": "<string>",
"generated_scorer": {
"id": "<string>",
"name": "<string>",
"chain_poll_template": {
"template": "<string>",
"metric_system_prompt": "<string>",
"metric_description": "<string>",
"value_field_name": "rating",
"explanation_field_name": "explanation",
"metric_few_shot_examples": [
{
"generation_prompt_and_response": "<string>",
"evaluating_response": "<string>"
}
],
"response_schema": {}
},
"instructions": "<string>",
"user_prompt": "<string>"
},
"registered_scorer": {
"id": "<string>",
"name": "<string>",
"score_type": "<string>"
},
"finetuned_scorer": {
"id": "<string>",
"name": "<string>",
"lora_task_id": 123,
"prompt": "<string>",
"lora_weights_path": "<string>",
"class_name_to_vocab_ix": {}
},
"model_name": "<string>",
"num_judges": 123,
"scoreable_node_types": [
"<string>"
],
"cot_enabled": true
},
"ground_truth": true,
"default_version_id": "<string>",
"default_version": {
"id": "<string>",
"version": 123,
"scorer_id": "<string>",
"generated_scorer": {
"id": "<string>",
"name": "<string>",
"chain_poll_template": {
"template": "<string>",
"metric_system_prompt": "<string>",
"metric_description": "<string>",
"value_field_name": "rating",
"explanation_field_name": "explanation",
"metric_few_shot_examples": [
{
"generation_prompt_and_response": "<string>",
"evaluating_response": "<string>"
}
],
"response_schema": {}
},
"instructions": "<string>",
"user_prompt": "<string>"
},
"registered_scorer": {
"id": "<string>",
"name": "<string>",
"score_type": "<string>"
},
"finetuned_scorer": {
"id": "<string>",
"name": "<string>",
"lora_task_id": 123,
"prompt": "<string>",
"lora_weights_path": "<string>",
"class_name_to_vocab_ix": {}
},
"model_name": "<string>",
"num_judges": 123,
"scoreable_node_types": [
"<string>"
],
"cot_enabled": true
},
"user_prompt": "<string>",
"scoreable_node_types": [
"<string>"
],
"multimodal_capabilities": [],
"required_scorers": [
"<string>"
],
"required_metric_ids": [
"<string>"
],
"deprecated": true,
"roll_up_config": {
"roll_up_methods": "<unknown>"
},
"label": "",
"included_fields": [
"<string>"
],
"description": "<string>",
"created_by": "<string>",
"created_at": "2023-11-07T05:31:56Z",
"updated_at": "2023-11-07T05:31:56Z",
"metric_color_picker_config": {
"constraints": [
{
"value": 123
}
],
"type": "numeric"
},
"color_threshold_config": {
"constraints": [
{
"value": 123
}
],
"type": "numeric"
},
"metric_name": "<string>"
}
]
}data
List Scorers With Filters
POST
/
v2
/
scorers
/
list
List Scorers With Filters
curl --request POST \
--url https://api.galileo.ai/v2/scorers/list \
--header 'Content-Type: application/json' \
--header 'Galileo-API-Key: <api-key>' \
--data '
{
"filters": [
{
"value": "<string>",
"name": "name",
"case_sensitive": false
}
],
"sort": {
"name": "name",
"ascending": true,
"sort_type": "column"
}
}
'{
"starting_token": 0,
"limit": 100,
"paginated": false,
"next_starting_token": 123,
"scorers": [
{
"id": "<string>",
"name": "<string>",
"tags": [
"<string>"
],
"defaults": {
"model_name": "<string>",
"num_judges": 123,
"filters": [
{
"value": "<string>",
"name": "node_name",
"case_sensitive": true
}
],
"scoreable_node_types": [
"<string>"
],
"cot_enabled": true
},
"latest_version": {
"id": "<string>",
"version": 123,
"scorer_id": "<string>",
"generated_scorer": {
"id": "<string>",
"name": "<string>",
"chain_poll_template": {
"template": "<string>",
"metric_system_prompt": "<string>",
"metric_description": "<string>",
"value_field_name": "rating",
"explanation_field_name": "explanation",
"metric_few_shot_examples": [
{
"generation_prompt_and_response": "<string>",
"evaluating_response": "<string>"
}
],
"response_schema": {}
},
"instructions": "<string>",
"user_prompt": "<string>"
},
"registered_scorer": {
"id": "<string>",
"name": "<string>",
"score_type": "<string>"
},
"finetuned_scorer": {
"id": "<string>",
"name": "<string>",
"lora_task_id": 123,
"prompt": "<string>",
"lora_weights_path": "<string>",
"class_name_to_vocab_ix": {}
},
"model_name": "<string>",
"num_judges": 123,
"scoreable_node_types": [
"<string>"
],
"cot_enabled": true
},
"ground_truth": true,
"default_version_id": "<string>",
"default_version": {
"id": "<string>",
"version": 123,
"scorer_id": "<string>",
"generated_scorer": {
"id": "<string>",
"name": "<string>",
"chain_poll_template": {
"template": "<string>",
"metric_system_prompt": "<string>",
"metric_description": "<string>",
"value_field_name": "rating",
"explanation_field_name": "explanation",
"metric_few_shot_examples": [
{
"generation_prompt_and_response": "<string>",
"evaluating_response": "<string>"
}
],
"response_schema": {}
},
"instructions": "<string>",
"user_prompt": "<string>"
},
"registered_scorer": {
"id": "<string>",
"name": "<string>",
"score_type": "<string>"
},
"finetuned_scorer": {
"id": "<string>",
"name": "<string>",
"lora_task_id": 123,
"prompt": "<string>",
"lora_weights_path": "<string>",
"class_name_to_vocab_ix": {}
},
"model_name": "<string>",
"num_judges": 123,
"scoreable_node_types": [
"<string>"
],
"cot_enabled": true
},
"user_prompt": "<string>",
"scoreable_node_types": [
"<string>"
],
"multimodal_capabilities": [],
"required_scorers": [
"<string>"
],
"required_metric_ids": [
"<string>"
],
"deprecated": true,
"roll_up_config": {
"roll_up_methods": "<unknown>"
},
"label": "",
"included_fields": [
"<string>"
],
"description": "<string>",
"created_by": "<string>",
"created_at": "2023-11-07T05:31:56Z",
"updated_at": "2023-11-07T05:31:56Z",
"metric_color_picker_config": {
"constraints": [
{
"value": 123
}
],
"type": "numeric"
},
"color_threshold_config": {
"constraints": [
{
"value": 123
}
],
"type": "numeric"
},
"metric_name": "<string>"
}
]
}Documentation Index
Fetch the complete documentation index at: https://docs.galileo.ai/llms.txt
Use this file to discover all available pages before exploring further.
Authorizations
APIKeyHeaderOAuth2PasswordBearerHTTPBasic
Body
application/json
filters
(ScorerNameFilter · object | ScorerTypeFilter · object | ScorerModelTypeFilter · object | ScorerExcludeSlmScorersFilter · object | ScorerExcludeMultimodalScorersFilter · object | ScorerTagsFilter · object | ScorerCreatorFilter · object | ScorerCreatedAtFilter · object | ScorerUpdatedAtFilter · object | ScorerLabelFilter · object | ScorerScoreableNodeTypesFilter · object | ScorerIDFilter · object)[]
- ScorerNameFilter
- ScorerTypeFilter
- ScorerModelTypeFilter
- ScorerExcludeSlmScorersFilter
- ScorerExcludeMultimodalScorersFilter
- ScorerTagsFilter
- ScorerCreatorFilter
- ScorerCreatedAtFilter
- ScorerUpdatedAtFilter
- ScorerLabelFilter
- ScorerScoreableNodeTypesFilter
- ScorerIDFilter
Show child attributes
Show child attributes
- ScorerNameSort
- ScorerUpdatedAtSort
- ScorerEnabledInRunSort
- ScorerEnabledInPlaygroundSort
Show child attributes
Show child attributes
Was this page helpful?
⌘I