Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.galileo.ai/llms.txt

Use this file to discover all available pages before exploring further.

​
Type Alias: ScorerConfigOpenAPI

type ScorerConfigOpenAPI = object;
Defined in: src/types/openapi.types.ts ScorerConfig Used for configuring a scorer for a scorer job.

​
Properties

​
cot_enabled?

optional cot_enabled: boolean | null;
Defined in: src/types/openapi.types.ts Cot Enabled Whether to enable chain of thought for this scorer. Defaults to False for llm scorers.

​
filters?

optional filters:
  | (
  | object & NodeNameFilter
  | object & MetadataFilter
  | object & ModalityFilter)[]
  | null;
Defined in: src/types/openapi.types.ts Filters List of filters to apply to the scorer.

​
id

id: string;
Defined in: src/types/openapi.types.ts Id

​
input_type?

optional input_type: InputTypeEnum | null;
Defined in: src/types/openapi.types.ts What type of input to use for model-based scorers (sessions_normalized, trace_io_only, etc..).

​
model_name?

optional model_name: string | null;
Defined in: src/types/openapi.types.ts Model Name

​
model_type?

optional model_type: ModelType | null;
Defined in: src/types/openapi.types.ts Type of model to use for this scorer. slm maps to luna, and llm maps to plus

​
multimodal_capabilities?

optional multimodal_capabilities: MultimodalCapability[] | null;
Defined in: src/types/openapi.types.ts Multimodal Capabilities Multimodal capabilities which this scorer can utilize in its evaluation.

​
name?

optional name: string | null;
Defined in: src/types/openapi.types.ts Name

​
num_judges?

optional num_judges: number | null;
Defined in: src/types/openapi.types.ts Num Judges

​
output_type?

optional output_type: OutputTypeEnum | null;
Defined in: src/types/openapi.types.ts What type of output to use for model-based scorers (boolean, categorical, etc.).

​
roll_up_method?

optional roll_up_method: RollUpMethodDisplayOptions | null;
Defined in: src/types/openapi.types.ts

​
score_type?

optional score_type: string | null;
Defined in: src/types/openapi.types.ts Score Type Return type of code scorers (e.g., ‘bool’, ‘int’, ‘float’, ‘str’).

​
scoreable_node_types?

optional scoreable_node_types: string[] | null;
Defined in: src/types/openapi.types.ts Scoreable Node Types List of node types that can be scored by this scorer. Defaults to llm/chat.

​
scorer_type

scorer_type: ScorerTypes;
Defined in: src/types/openapi.types.ts

​
scorer_version?

optional scorer_version: BaseScorerVersionDb | null;
Defined in: src/types/openapi.types.ts ScorerVersion to use for this scorer. If not provided, the latest version will be used.