> ## Documentation Index
> Fetch the complete documentation index at: https://docs.galileo.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# GalileoApiClient

***

# Class: GalileoApiClient

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

## Extends

* `BaseClient`

## Constructors

### Constructor

```ts theme={null}
new GalileoApiClient(): GalileoApiClient;
```

#### Returns

`GalileoApiClient`

#### Inherited from

```ts theme={null}
BaseClient.constructor;
```

## Properties

### apiUrl

```ts theme={null}
protected apiUrl: string = '';
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Inherited from

```ts theme={null}
BaseClient.apiUrl;
```

***

### client

```ts theme={null}
protected client: undefined | Client<paths, `${string}/${string}`> = undefined;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Inherited from

```ts theme={null}
BaseClient.client;
```

***

### datasetId

```ts theme={null}
datasetId: string = "";
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### experimentId

```ts theme={null}
experimentId: string = "";
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### logStreamId

```ts theme={null}
logStreamId: string = "";
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### projectId

```ts theme={null}
projectId: string = "";
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### projectScoped

```ts theme={null}
projectScoped: boolean = true;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### projectType

```ts theme={null}
projectType:
  | "prompt_evaluation"
  | "llm_monitor"
  | "gen_ai"
  | "training_inference"
  | "protect" = ProjectTypes.genAI;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### runId

```ts theme={null}
runId: string = "";
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### sessionId?

```ts theme={null}
optional sessionId: string = undefined;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

***

### token

```ts theme={null}
protected token: string = '';
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Inherited from

```ts theme={null}
BaseClient.token;
```

***

### timestampRecord

```ts theme={null}
static timestampRecord: number = 0;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

## Methods

### appendRowsToDatasetContent()

```ts theme={null}
appendRowsToDatasetContent(
   datasetId: string,
   etag: string,
rows: DatasetAppendRow[]): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Appends rows to the content of a dataset.

#### Parameters

##### datasetId

`string`

The ID of the dataset.

##### etag

`string`

The ETag used for optimistic concurrency control.

##### rows

[`DatasetAppendRow`](/sdk-api/typescript/reference/types/type-aliases/DatasetAppendRow)\[]

The rows to append to the dataset content.

#### Returns

`Promise`\<`void`>

A promise that resolves when the rows have been appended.

***

### convertToCamelCase()

```ts theme={null}
convertToCamelCase<T, TTarget>(obj: T): ValidatedCamelCase<T, TTarget>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Type Parameters

##### T

`T` *extends* `object`

##### TTarget

`TTarget`

#### Parameters

##### obj

`T`

#### Returns

`ValidatedCamelCase`\<`T`, `TTarget`>

#### Inherited from

```ts theme={null}
BaseClient.convertToCamelCase;
```

***

### convertToSnakeCase()

```ts theme={null}
convertToSnakeCase<T, TTarget>(obj: T): ValidatedSnakeCase<T, TTarget>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Type Parameters

##### T

`T` *extends* `object`

##### TTarget

`TTarget`

#### Parameters

##### obj

`T`

#### Returns

`ValidatedSnakeCase`\<`T`, `TTarget`>

#### Inherited from

```ts theme={null}
BaseClient.convertToSnakeCase;
```

***

### countSessions()

```ts theme={null}
countSessions(options: object): Promise<{
  totalCount: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Count the number of sessions matching the provided query criteria.

#### Parameters

##### options

Count request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to identify sessions to count

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

#### Returns

`Promise`\<\{
`totalCount`: `number`;
}>

Promise resolving to a response containing the total count

***

### countSpans()

```ts theme={null}
countSpans(options: object): Promise<{
  totalCount: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Count the number of spans matching the provided query criteria.

#### Parameters

##### options

Count request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to identify spans to count

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

#### Returns

`Promise`\<\{
`totalCount`: `number`;
}>

Promise resolving to a response containing the total count

***

### countTraces()

```ts theme={null}
countTraces(options: object): Promise<{
  totalCount: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Count the number of traces matching the provided query criteria.

#### Parameters

##### options

Count request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to identify traces to count

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

#### Returns

`Promise`\<\{
`totalCount`: `number`;
}>

Promise resolving to a response containing the total count

***

### createCodeScorerVersion()

```ts theme={null}
createCodeScorerVersion(
   scorerId: string,
   codeContent: string,
validationResult?: string): Promise<BaseScorerVersionResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a code-based scorer version.

#### Parameters

##### scorerId

`string`

The unique identifier of the scorer.

##### codeContent

`string`

The Python code content for the scorer.

##### validationResult?

`string`

(Optional) The validation result JSON string.

#### Returns

`Promise`\<[`BaseScorerVersionResponse`](/sdk-api/typescript/reference/types/type-aliases/BaseScorerVersionResponse)>

A promise that resolves to the created scorer version.

***

### createDataset()

#### Call Signature

```ts theme={null}
createDataset(
   name: string,
   filePath: string,
format: DatasetFormat): Promise<any>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new dataset with a name, file path, and format.

##### Parameters

###### name

`string`

The name of the dataset.

###### filePath

`string`

The path to the dataset file.

###### format

[`DatasetFormat`](/sdk-api/typescript/reference/README/type-aliases/DatasetFormat)

The format of the dataset file.

##### Returns

`Promise`\<`any`>

A promise that resolves to the created dataset.

#### Call Signature

```ts theme={null}
createDataset(params: object): Promise<any>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new dataset from an options object.

##### Parameters

###### params

The options used to create the dataset.

###### filePath

`string`

The path to the dataset file.

###### format

[`DatasetFormat`](/sdk-api/typescript/reference/README/type-aliases/DatasetFormat)

The format of the dataset file.

###### name

`string`

The name of the dataset.

###### projectId?

`string`

(Optional) The ID of the project that will use the dataset.

##### Returns

`Promise`\<`any`>

A promise that resolves to the created dataset.

***

### createExperiment()

```ts theme={null}
createExperiment(name: string, dataset?:
  | null
  | {
  dataset_id: string;
  version_index: number;
}): Promise<{
  aggregate_feedback?: {
   [key: string]: object;
  };
  aggregate_metrics?: {
   [key: string]: unknown;
  };
  created_at?: string;
  created_by?: null | string;
  created_by_user?:   | null
     | {
     email: string;
     first_name?: null | string;
     id: string;
     last_name?: null | string;
   };
  dataset?:   | null
     | {
     dataset_id?: null | string;
     name?: null | string;
     version_index?: null | number;
   };
  id: string;
  name?: string;
  num_samples?: null | number;
  playground?:   | null
     | {
     name?: null | string;
     playground_id?: null | string;
   };
  playground_id?: null | string;
  project_id: string;
  prompt?:   | null
     | {
     content?: null | string;
     name?: null | string;
     prompt_template_id?: null | string;
     version_index?: null | number;
   };
  prompt_model?: null | string;
  prompt_run_settings?:   | null
     | {
     deployment_name?: null | string;
     echo?: boolean;
     frequency_penalty?: number;
     known_models?: object[];
     logprobs?: boolean;
     max_tokens?: number;
     model_alias?: string;
     n?: number;
     presence_penalty?: number;
     reasoning_effort?: string;
     response_format?:   | null
        | {
      [key: string]: string;
      };
     stop_sequences?: null | string[];
     temperature?: number;
     tool_choice?:   | null
        | string
        | {
        function: {
           name: string;
        };
        type?: string;
      };
     tools?: null | object[];
     top_k?: number;
     top_logprobs?: number;
     top_p?: number;
     verbosity?: string;
   };
  rank?: null | number;
  ranking_score?: null | number;
  status?: {
     log_generation?: {
        progress_percent?: number;
     };
  };
  tags?: {
   [key: string]: object[];
  };
  task_type: 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18;
  updated_at?: null | string;
  winner?: null | boolean;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### name

`string`

##### dataset?

`null` |

\{
`dataset_id`: `string`;
`version_index`: `number`;
}

###### dataset\_id

`string`

Dataset Id
Format: uuid4

###### version\_index

`number`

Version Index

#### Returns

`Promise`\<\{
`aggregate_feedback?`: \{
\[`key`: `string`]: `object`;
};
`aggregate_metrics?`: \{
\[`key`: `string`]: `unknown`;
};
`created_at?`: `string`;
`created_by?`: `null` | `string`;
`created_by_user?`: | `null`
\| \{
`email`: `string`;
`first_name?`: `null` | `string`;
`id`: `string`;
`last_name?`: `null` | `string`;
};
`dataset?`: | `null`
\| \{
`dataset_id?`: `null` | `string`;
`name?`: `null` | `string`;
`version_index?`: `null` | `number`;
};
`id`: `string`;
`name?`: `string`;
`num_samples?`: `null` | `number`;
`playground?`: | `null`
\| \{
`name?`: `null` | `string`;
`playground_id?`: `null` | `string`;
};
`playground_id?`: `null` | `string`;
`project_id`: `string`;
`prompt?`: | `null`
\| \{
`content?`: `null` | `string`;
`name?`: `null` | `string`;
`prompt_template_id?`: `null` | `string`;
`version_index?`: `null` | `number`;
};
`prompt_model?`: `null` | `string`;
`prompt_run_settings?`: | `null`
\| \{
`deployment_name?`: `null` | `string`;
`echo?`: `boolean`;
`frequency_penalty?`: `number`;
`known_models?`: `object`\[];
`logprobs?`: `boolean`;
`max_tokens?`: `number`;
`model_alias?`: `string`;
`n?`: `number`;
`presence_penalty?`: `number`;
`reasoning_effort?`: `string`;
`response_format?`: | `null`
\| \{
\[`key`: `string`]: `string`;
};
`stop_sequences?`: `null` | `string`\[];
`temperature?`: `number`;
`tool_choice?`: | `null`
\| `string`
\| \{
`function`: \{
`name`: `string`;
};
`type?`: `string`;
};
`tools?`: `null` | `object`\[];
`top_k?`: `number`;
`top_logprobs?`: `number`;
`top_p?`: `number`;
`verbosity?`: `string`;
};
`rank?`: `null` | `number`;
`ranking_score?`: `null` | `number`;
`status?`: \{
`log_generation?`: \{
`progress_percent?`: `number`;
};
};
`tags?`: \{
\[`key`: `string`]: `object`\[];
};
`task_type`: `0` | `1` | `2` | `3` | `4` | `5` | `6` | `7` | `8` | `9` | `10` | `11` | `12` | `13` | `14` | `15` | `16` | `17` | `18`;
`updated_at?`: `null` | `string`;
`winner?`: `null` | `boolean`;
}>

***

### createGlobalPromptTemplate()

```ts theme={null}
createGlobalPromptTemplate(
   template: object[],
   name: string,
options?: object): Promise<PromptTemplate>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a global prompt template, optionally resolving a project by ID or name.

If both `projectId` and `projectName` are provided, an error will be thrown.
Only one of these parameters should be specified.

#### Parameters

##### template

`object`\[]

Template messages stored in the template.

##### name

`string`

Name assigned to the template.

##### options?

(Optional) Project scoping information.

###### projectId?

`null` | `string`

(Optional) Project ID to associate with the template.

###### projectName?

`string`

(Optional) Project name to resolve to an ID.

#### Returns

`Promise`\<[`PromptTemplate`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplate)>

A promise that resolves to the created template payload.

***

### createJob()

```ts theme={null}
createJob(
   projectId: string,
   name: string,
   runId: string,
   datasetId: string,
   promptTemplateId: string,
   taskType: TaskType,
   promptSettings: PromptRunSettings,
   scorers?: ScorerConfig[]): Promise<{
  dataset_id?: null | string;
  dataset_version_index?: null | number;
  epoch?: number;
  feature_names?: null | string[];
  job_id?: null | string;
  job_name?: string;
  labels?: string[] | string[][];
  link: string;
  log_metric_computing_records?: boolean;
  luna_model?: null | string;
  message: string;
  metric_critique_configuration?:   | null
     | {
     critique_ids: string[];
     metric_name: string;
     project_type: "prompt_evaluation" | "llm_monitor" | "gen_ai";
     recompute_settings?:   | null
        | {
        mode: "runs";
        run_ids: string[];
      }
        | {
        mode: "project";
      }
        | {
        filters: unknown[];
        mode: "observe_filters";
      }
        | {
        filters: unknown[];
        mode: "log_stream_filters";
        run_id: string;
      };
     scorer_id?: null | string;
   };
  migration_name?: null | string;
  monitor_batch_id?: null | string;
  ner_labels?: null | string[];
  non_inference_logged?: boolean;
  process_existing_inference_runs?: boolean;
  project_id: string;
  prompt_customized_scorers_configuration?:   | null
     | (
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "agentic_session_success";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_agentic_session_success";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "agentic_workflow_success";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_agentic_workflow_success";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: null | string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "chunk_attribution_utilization";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_chunk_attribution_utilization_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: null | string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "completeness";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_completeness_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     function_explanation_param_name?: string;
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "correctness";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_factuality";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "context_adherence";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_groundedness";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     function_explanation_param_name?: string;
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "instruction_adherence";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_instruction_adherence";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "ground_truth_adherence";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_ground_truth_adherence";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "prompt_injection";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_prompt_injection_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "output_sexist";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_sexist_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "input_sexist";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_input_sexist_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "tool_selection_quality";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_tool_selection_quality";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "tool_error_rate";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_tool_error_rate";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "output_toxicity";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_toxicity_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "input_toxicity";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_input_toxicity_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   })[];
  prompt_dataset_id?: null | string;
  prompt_finetuned_scorers_configuration?: null | object[];
  prompt_generated_scorers_configuration?: null | string[];
  prompt_optimization_configuration?:   | null
     | {
     evaluation_criteria: string;
     evaluation_model_alias: string;
     generation_model_alias: string;
     includes_target: boolean;
     integration_name?:   | "anthropic"
        | "custom"
        | "aws_bedrock"
        | "aws_sagemaker"
        | "azure"
        | "databricks"
        | "mistral"
        | "nvidia"
        | "openai"
        | "vegas_gateway"
        | "vertex_ai"
        | "writer";
     iterations: number;
     max_tokens: number;
     num_rows: number;
     prompt: string;
     reasoning_effort?: null | string;
     task_description: string;
     temperature: number;
     verbosity?: null | string;
   };
  prompt_registered_scorers_configuration?: null | object[];
  prompt_scorer_settings?:   | null
     | {
     aggregate_keys?: null | string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?:   | null
        | {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: null | string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template: string;
        value_field_name?: string;
      };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: boolean;
        filter_type?: "string";
        name: "node_name";
        operator: "eq" | "ne" | "contains";
        value: string;
      }
        | {
        filter_type?: "map";
        key: string;
        name: "metadata";
        operator: "eq" | "ne" | "not_in" | "one_of";
        value: string | string[];
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: null | string;
     name?: string;
     num_judges?: null | number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name?: string;
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   };
  prompt_scorers_configuration?:   | null
     | {
     action_advancement_luna?: boolean;
     action_completion_luna?: boolean;
     adherence_nli?: boolean;
     agentic_session_success?: boolean;
     agentic_workflow_success?: boolean;
     bleu?: boolean;
     chunk_attribution_utilization_gpt?: boolean;
     chunk_attribution_utilization_nli?: boolean;
     completeness_gpt?: boolean;
     completeness_nli?: boolean;
     context_adherence_luna?: boolean;
     context_relevance?: boolean;
     context_relevance_luna?: boolean;
     cost?: boolean;
     factuality?: boolean;
     ground_truth_adherence?: boolean;
     groundedness?: boolean;
     input_pii?: boolean;
     input_sexist?: boolean;
     input_sexist_gpt?: boolean;
     input_tone?: boolean;
     input_toxicity?: boolean;
     input_toxicity_gpt?: boolean;
     instruction_adherence?: boolean;
     latency?: boolean;
     pii?: boolean;
     prompt_injection?: boolean;
     prompt_injection_gpt?: boolean;
     prompt_perplexity?: boolean;
     protect_status?: boolean;
     rouge?: boolean;
     sexist?: boolean;
     sexist_gpt?: boolean;
     tone?: boolean;
     tool_error_rate?: boolean;
     tool_error_rate_luna?: boolean;
     tool_selection_quality?: boolean;
     tool_selection_quality_luna?: boolean;
     toxicity?: boolean;
     toxicity_gpt?: boolean;
     uncertainty?: boolean;
   };
  prompt_settings?:   | null
     | {
     deployment_name?: null | string;
     echo?: boolean;
     frequency_penalty?: number;
     known_models?: object[];
     logprobs?: boolean;
     max_tokens?: number;
     model_alias?: string;
     n?: number;
     presence_penalty?: number;
     reasoning_effort?: string;
     response_format?:   | null
        | {
      [key: string]: string;
      };
     stop_sequences?: null | string[];
     temperature?: number;
     tool_choice?:   | null
        | string
        | {
        function: {
           name: string;
        };
        type?: string;
      };
     tools?: null | object[];
     top_k?: number;
     top_logprobs?: number;
     top_p?: number;
     verbosity?: string;
   };
  prompt_template_version_id?: null | string;
  protect_scorer_payload?: null | string;
  protect_trace_id?: null | string;
  resource_limits?:   | null
     | {
     cpu_time?: number;
     memory_mb?: number;
   };
  run_id: string;
  scorer_config?:   | null
     | {
     cot_enabled?: null | boolean;
     filters?:   | null
        | (
        | {
        case_sensitive?: boolean;
        filter_type?: "string";
        name: "node_name";
        operator: "eq" | "ne" | "contains";
        value: string;
      }
        | {
        filter_type?: "map";
        key: string;
        name: "metadata";
        operator: "eq" | "ne" | "not_in" | "one_of";
        value: string | string[];
      })[];
     id: string;
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     model_name?: null | string;
     model_type?: null | "llm" | "code" | "slm";
     name?: null | string;
     num_judges?: null | number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     scoreable_node_types?: null | string[];
     scorer_type: "luna" | "llm" | "code" | "preset";
     scorer_version?:   | null
        | {
        cot_enabled?: null | boolean;
        finetuned_scorer?:   | null
           | {
           class_name_to_vocab_ix?:   | null
              | {
            [key: string]: ...[];
            }
              | {
            [key: string]: number;
            };
           executor?:   | null
              | "agentic_session_success"
              | "agentic_workflow_success"
              | "action_completion_luna"
              | "action_advancement_luna"
              | "agent_efficiency"
              | "agent_flow"
              | "bleu"
              | "chunk_attribution_utilization_luna"
              | "chunk_attribution_utilization"
              | "completeness_luna"
              | "completeness"
              | "context_adherence"
              | "context_adherence_luna"
              | "context_relevance"
              | "context_relevance_luna"
              | "conversation_quality"
              | "correctness"
              | "ground_truth_adherence"
              | "input_pii"
              | "input_pii_gpt"
              | "input_sexist"
              | "input_sexist_luna"
              | "input_tone"
              | "input_tone_gpt"
              | "input_toxicity"
              | "input_toxicity_luna"
              | "instruction_adherence"
              | "output_pii"
              | "output_pii_gpt"
              | "output_sexist"
              | "output_sexist_luna"
              | "output_tone"
              | "output_tone_gpt"
              | "output_toxicity"
              | "output_toxicity_luna"
              | "prompt_injection"
              | "prompt_injection_luna"
              | "prompt_perplexity"
              | "rouge"
              | "tool_error_rate"
              | "tool_error_rate_luna"
              | "tool_selection_quality"
              | "tool_selection_quality_luna"
              | "uncertainty"
              | "user_intent_change";
           id: string;
           lora_task_id: number;
           luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
           luna_output_type?: null | "string" | "float" | "string_list";
           name: string;
           prompt: string;
         };
        generated_scorer?:   | null
           | {
           chain_poll_template: {
              explanation_field_name?: string;
              metric_description?: null | string;
              metric_few_shot_examples?: ...[];
              metric_system_prompt?: null | string;
              response_schema?:   | null
                 | {
               [key: ...]: ...;
               };
              template: string;
              value_field_name?: string;
           };
           id: string;
           instructions?: null | string;
           name: string;
           user_prompt?: null | string;
         };
        id: string;
        input_type?:   | null
           | "basic"
           | "llm_spans"
           | "retriever_spans"
           | "sessions_normalized"
           | "sessions_trace_io_only"
           | "tool_spans"
           | "trace_input_only"
           | "trace_io_only"
           | "trace_normalized"
           | "trace_output_only"
           | "agent_spans"
           | "workflow_spans";
        model_name?: null | string;
        num_judges?: null | number;
        output_type?:   | null
           | "boolean"
           | "categorical"
           | "count"
           | "discrete"
           | "freeform"
           | "percentage"
           | "multilabel";
        registered_scorer?:   | null
           | {
           id: string;
           name: string;
           score_type?: null | string;
         };
        scoreable_node_types?: null | string[];
        scorer_id: string;
        version: number;
      };
   };
  scorers?:   | null
     | object[]
     | (
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "agentic_session_success";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "agentic_workflow_success";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "bleu";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "chunk_attribution_utilization";
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "completeness";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "context_adherence";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "context_relevance";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "correctness";
     num_judges?: null | number;
     type?: "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "ground_truth_adherence";
     num_judges?: null | number;
     type?: "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "input_pii";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "input_sexist";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "input_tone";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "input_toxicity";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "instruction_adherence";
     num_judges?: null | number;
     type?: "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "output_pii";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "output_sexist";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "output_tone";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "output_toxicity";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "prompt_injection";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "prompt_perplexity";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "rouge";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "tool_error_rate";
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "tool_selection_quality";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "uncertainty";
   })[];
  segment_filters?: null | object[];
  should_retry?: boolean;
  sub_scorers?: (
     | "_completeness_gpt"
     | "_context_adherence_luna"
     | "_context_relevance"
     | "_context_relevance_luna"
     | "_chunk_attribution_utilization_gpt"
     | "_factuality"
     | "_groundedness"
     | "_latency"
     | "_prompt_perplexity"
     | "_protect_status"
     | "_pii"
     | "_input_pii"
     | "_sexist"
     | "_input_sexist"
     | "_sexist_gpt"
     | "_input_sexist_gpt"
     | "_tone"
     | "_input_tone"
     | "_toxicity"
     | "_toxicity_gpt"
     | "_input_toxicity"
     | "_input_toxicity_gpt"
     | "_user_registered"
     | "_user_submitted"
     | "_user_generated"
     | "_user_finetuned"
     | "_uncertainty"
     | "_bleu"
     | "_cost"
     | "_rouge"
     | "_prompt_injection_gpt"
     | "_prompt_injection"
     | "_rag_nli"
     | "_adherence_nli"
     | "_completeness_nli"
     | "_chunk_attribution_utilization_nli"
     | "_instruction_adherence"
     | "_ground_truth_adherence"
     | "_tool_selection_quality"
     | "_tool_selection_quality_luna"
     | "_tool_error_rate"
     | "_tool_error_rate_luna"
     | "_action_completion_luna"
     | "_agentic_session_success"
     | "_action_advancement_luna"
     | "_agentic_workflow_success"
     | "_generic_wizard"
     | "_customized_completeness_gpt"
     | "_customized_factuality"
     | "_customized_groundedness"
     | "_customized_chunk_attribution_utilization_gpt"
     | "_customized_instruction_adherence"
     | "_customized_ground_truth_adherence"
     | "_customized_prompt_injection_gpt"
     | "_customized_tool_selection_quality"
     | "_customized_tool_error_rate"
     | "_customized_agentic_session_success"
     | "_customized_agentic_workflow_success"
     | "_customized_sexist_gpt"
     | "_customized_input_sexist_gpt"
     | "_customized_toxicity_gpt"
    | "_customized_input_toxicity_gpt")[];
  task_type?:   | null
     | 0
     | 1
     | 2
     | 3
     | 4
     | 5
     | 6
     | 7
     | 8
     | 9
     | 10
     | 11
     | 12
     | 13
     | 14
     | 15
     | 16
     | 17
     | 18;
  tasks?: null | string[];
  upload_data_in_separate_task?: boolean;
  user_id?: null | string;
  xray?: boolean;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### projectId

`string`

##### name

`string`

##### runId

`string`

##### datasetId

`string`

##### promptTemplateId

`string`

##### taskType

[`TaskType`](/sdk-api/typescript/reference/types/enumerations/TaskType)

##### promptSettings

[`PromptRunSettings`](/sdk-api/typescript/reference/types/interfaces/PromptRunSettings)

##### scorers?

[`ScorerConfig`](/sdk-api/typescript/reference/types/type-aliases/ScorerConfig)\[]

#### Returns

`Promise`\<\{
`dataset_id?`: `null` | `string`;
`dataset_version_index?`: `null` | `number`;
`epoch?`: `number`;
`feature_names?`: `null` | `string`\[];
`job_id?`: `null` | `string`;
`job_name?`: `string`;
`labels?`: `string`\[] | `string`\[]\[];
`link`: `string`;
`log_metric_computing_records?`: `boolean`;
`luna_model?`: `null` | `string`;
`message`: `string`;
`metric_critique_configuration?`: | `null`
\| \{
`critique_ids`: `string`\[];
`metric_name`: `string`;
`project_type`: `"prompt_evaluation"` | `"llm_monitor"` | `"gen_ai"`;
`recompute_settings?`: | `null`
\| \{
`mode`: `"runs"`;
`run_ids`: `string`\[];
}
\| \{
`mode`: `"project"`;
}
\| \{
`filters`: `unknown`\[];
`mode`: `"observe_filters"`;
}
\| \{
`filters`: `unknown`\[];
`mode`: `"log_stream_filters"`;
`run_id`: `string`;
};
`scorer_id?`: `null` | `string`;
};
`migration_name?`: `null` | `string`;
`monitor_batch_id?`: `null` | `string`;
`ner_labels?`: `null` | `string`\[];
`non_inference_logged?`: `boolean`;
`process_existing_inference_runs?`: `boolean`;
`project_id`: `string`;
`prompt_customized_scorers_configuration?`: | `null`
\| (
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"agentic_session_success"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_agentic_session_success"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"agentic_workflow_success"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_agentic_workflow_success"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"chunk_attribution_utilization"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_chunk_attribution_utilization_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"completeness"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_completeness_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`function_explanation_param_name?`: `string`;
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"correctness"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_factuality"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"context_adherence"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_groundedness"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`function_explanation_param_name?`: `string`;
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"instruction_adherence"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_instruction_adherence"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"ground_truth_adherence"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_ground_truth_adherence"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"prompt_injection"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_prompt_injection_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"output_sexist"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_sexist_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"input_sexist"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_input_sexist_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"tool_selection_quality"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_tool_selection_quality"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"tool_error_rate"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_tool_error_rate"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"output_toxicity"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_toxicity_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"input_toxicity"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_input_toxicity_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
})\[];
`prompt_dataset_id?`: `null` | `string`;
`prompt_finetuned_scorers_configuration?`: `null` | `object`\[];
`prompt_generated_scorers_configuration?`: `null` | `string`\[];
`prompt_optimization_configuration?`: | `null`
\| \{
`evaluation_criteria`: `string`;
`evaluation_model_alias`: `string`;
`generation_model_alias`: `string`;
`includes_target`: `boolean`;
`integration_name?`: | `"anthropic"`
\| `"custom"`
\| `"aws_bedrock"`
\| `"aws_sagemaker"`
\| `"azure"`
\| `"databricks"`
\| `"mistral"`
\| `"nvidia"`
\| `"openai"`
\| `"vegas_gateway"`
\| `"vertex_ai"`
\| `"writer"`;
`iterations`: `number`;
`max_tokens`: `number`;
`num_rows`: `number`;
`prompt`: `string`;
`reasoning_effort?`: `null` | `string`;
`task_description`: `string`;
`temperature`: `number`;
`verbosity?`: `null` | `string`;
};
`prompt_registered_scorers_configuration?`: `null` | `object`\[];
`prompt_scorer_settings?`: | `null`
\| \{
`aggregate_keys?`: `null` | `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: | `null`
\| \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: `boolean`;
`filter_type?`: `"string"`;
`name`: `"node_name"`;
`operator`: `"eq"` | `"ne"` | `"contains"`;
`value`: `string`;
}
\| \{
`filter_type?`: `"map"`;
`key`: `string`;
`name`: `"metadata"`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `null` | `string`;
`name?`: `string`;
`num_judges?`: `null` | `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name?`: `string`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
};
`prompt_scorers_configuration?`: | `null`
\| \{
`action_advancement_luna?`: `boolean`;
`action_completion_luna?`: `boolean`;
`adherence_nli?`: `boolean`;
`agentic_session_success?`: `boolean`;
`agentic_workflow_success?`: `boolean`;
`bleu?`: `boolean`;
`chunk_attribution_utilization_gpt?`: `boolean`;
`chunk_attribution_utilization_nli?`: `boolean`;
`completeness_gpt?`: `boolean`;
`completeness_nli?`: `boolean`;
`context_adherence_luna?`: `boolean`;
`context_relevance?`: `boolean`;
`context_relevance_luna?`: `boolean`;
`cost?`: `boolean`;
`factuality?`: `boolean`;
`ground_truth_adherence?`: `boolean`;
`groundedness?`: `boolean`;
`input_pii?`: `boolean`;
`input_sexist?`: `boolean`;
`input_sexist_gpt?`: `boolean`;
`input_tone?`: `boolean`;
`input_toxicity?`: `boolean`;
`input_toxicity_gpt?`: `boolean`;
`instruction_adherence?`: `boolean`;
`latency?`: `boolean`;
`pii?`: `boolean`;
`prompt_injection?`: `boolean`;
`prompt_injection_gpt?`: `boolean`;
`prompt_perplexity?`: `boolean`;
`protect_status?`: `boolean`;
`rouge?`: `boolean`;
`sexist?`: `boolean`;
`sexist_gpt?`: `boolean`;
`tone?`: `boolean`;
`tool_error_rate?`: `boolean`;
`tool_error_rate_luna?`: `boolean`;
`tool_selection_quality?`: `boolean`;
`tool_selection_quality_luna?`: `boolean`;
`toxicity?`: `boolean`;
`toxicity_gpt?`: `boolean`;
`uncertainty?`: `boolean`;
};
`prompt_settings?`: | `null`
\| \{
`deployment_name?`: `null` | `string`;
`echo?`: `boolean`;
`frequency_penalty?`: `number`;
`known_models?`: `object`\[];
`logprobs?`: `boolean`;
`max_tokens?`: `number`;
`model_alias?`: `string`;
`n?`: `number`;
`presence_penalty?`: `number`;
`reasoning_effort?`: `string`;
`response_format?`: | `null`
\| \{
\[`key`: `string`]: `string`;
};
`stop_sequences?`: `null` | `string`\[];
`temperature?`: `number`;
`tool_choice?`: | `null`
\| `string`
\| \{
`function`: \{
`name`: `string`;
};
`type?`: `string`;
};
`tools?`: `null` | `object`\[];
`top_k?`: `number`;
`top_logprobs?`: `number`;
`top_p?`: `number`;
`verbosity?`: `string`;
};
`prompt_template_version_id?`: `null` | `string`;
`protect_scorer_payload?`: `null` | `string`;
`protect_trace_id?`: `null` | `string`;
`resource_limits?`: | `null`
\| \{
`cpu_time?`: `number`;
`memory_mb?`: `number`;
};
`run_id`: `string`;
`scorer_config?`: | `null`
\| \{
`cot_enabled?`: `null` | `boolean`;
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: `boolean`;
`filter_type?`: `"string"`;
`name`: `"node_name"`;
`operator`: `"eq"` | `"ne"` | `"contains"`;
`value`: `string`;
}
\| \{
`filter_type?`: `"map"`;
`key`: `string`;
`name`: `"metadata"`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
})\[];
`id`: `string`;
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`model_name?`: `null` | `string`;
`model_type?`: `null` | `"llm"` | `"code"` | `"slm"`;
`name?`: `null` | `string`;
`num_judges?`: `null` | `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`scoreable_node_types?`: `null` | `string`\[];
`scorer_type`: `"luna"` | `"llm"` | `"code"` | `"preset"`;
`scorer_version?`: | `null`
\| \{
`cot_enabled?`: `null` | `boolean`;
`finetuned_scorer?`: | `null`
\| \{
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: ...\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`executor?`: | `null`
\| `"agentic_session_success"`
\| `"agentic_workflow_success"`
\| `"action_completion_luna"`
\| `"action_advancement_luna"`
\| `"agent_efficiency"`
\| `"agent_flow"`
\| `"bleu"`
\| `"chunk_attribution_utilization_luna"`
\| `"chunk_attribution_utilization"`
\| `"completeness_luna"`
\| `"completeness"`
\| `"context_adherence"`
\| `"context_adherence_luna"`
\| `"context_relevance"`
\| `"context_relevance_luna"`
\| `"conversation_quality"`
\| `"correctness"`
\| `"ground_truth_adherence"`
\| `"input_pii"`
\| `"input_pii_gpt"`
\| `"input_sexist"`
\| `"input_sexist_luna"`
\| `"input_tone"`
\| `"input_tone_gpt"`
\| `"input_toxicity"`
\| `"input_toxicity_luna"`
\| `"instruction_adherence"`
\| `"output_pii"`
\| `"output_pii_gpt"`
\| `"output_sexist"`
\| `"output_sexist_luna"`
\| `"output_tone"`
\| `"output_tone_gpt"`
\| `"output_toxicity"`
\| `"output_toxicity_luna"`
\| `"prompt_injection"`
\| `"prompt_injection_luna"`
\| `"prompt_perplexity"`
\| `"rouge"`
\| `"tool_error_rate"`
\| `"tool_error_rate_luna"`
\| `"tool_selection_quality"`
\| `"tool_selection_quality_luna"`
\| `"uncertainty"`
\| `"user_intent_change"`;
`id`: `string`;
`lora_task_id`: `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`name`: `string`;
`prompt`: `string`;
};
`generated_scorer?`: | `null`
\| \{
`chain_poll_template`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: ...\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: ...]: ...;
};
`template`: `string`;
`value_field_name?`: `string`;
};
`id`: `string`;
`instructions?`: `null` | `string`;
`name`: `string`;
`user_prompt?`: `null` | `string`;
};
`id`: `string`;
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`model_name?`: `null` | `string`;
`num_judges?`: `null` | `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`registered_scorer?`: | `null`
\| \{
`id`: `string`;
`name`: `string`;
`score_type?`: `null` | `string`;
};
`scoreable_node_types?`: `null` | `string`\[];
`scorer_id`: `string`;
`version`: `number`;
};
};
`scorers?`: | `null`
\| `object`\[]
\| (
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"agentic_session_success"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"agentic_workflow_success"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"bleu"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"chunk_attribution_utilization"`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"completeness"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"context_adherence"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"context_relevance"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"correctness"`;
`num_judges?`: `null` | `number`;
`type?`: `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"ground_truth_adherence"`;
`num_judges?`: `null` | `number`;
`type?`: `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"input_pii"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"input_sexist"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"input_tone"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"input_toxicity"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"instruction_adherence"`;
`num_judges?`: `null` | `number`;
`type?`: `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"output_pii"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"output_sexist"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"output_tone"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"output_toxicity"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"prompt_injection"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"prompt_perplexity"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"rouge"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"tool_error_rate"`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"tool_selection_quality"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"uncertainty"`;
})\[];
`segment_filters?`: `null` | `object`\[];
`should_retry?`: `boolean`;
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
`task_type?`: | `null`
\| `0`
\| `1`
\| `2`
\| `3`
\| `4`
\| `5`
\| `6`
\| `7`
\| `8`
\| `9`
\| `10`
\| `11`
\| `12`
\| `13`
\| `14`
\| `15`
\| `16`
\| `17`
\| `18`;
`tasks?`: `null` | `string`\[];
`upload_data_in_separate_task?`: `boolean`;
`user_id?`: `null` | `string`;
`xray?`: `boolean`;
}>

***

### createLlmScorerVersion()

#### Call Signature

```ts theme={null}
createLlmScorerVersion(scorerId: string, options: object): Promise<BaseScorerVersionResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new LLM scorer version.

##### Parameters

###### scorerId

`string`

The unique identifier of the scorer.

###### options

The LLM scorer version creation options.

###### chainPollTemplate?

\{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template`: `string`;
`value_field_name?`: `string`;
}

(Optional) Chain poll template configuration.

###### chainPollTemplate.explanation\_field\_name?

`string`

Explanation Field Name

**Description**

Field name to look for in the chainpoll response, for the explanation.

**Default**

```ts theme={null}
explanation;
```

###### chainPollTemplate.metric\_description?

`null` | `string`

Metric Description

**Description**

Description of what the metric should do.

###### chainPollTemplate.metric\_few\_shot\_examples?

`object`\[]

Metric Few Shot Examples

**Description**

Few-shot examples for the metric.

###### chainPollTemplate.metric\_system\_prompt?

`null` | `string`

Metric System Prompt

**Description**

System prompt for the metric.

###### chainPollTemplate.response\_schema?

\| `null`
\| \{
\[`key`: `string`]: `unknown`;
}

Response Schema

**Description**

Response schema for the output

###### chainPollTemplate.template

`string`

Template

**Description**

Chainpoll prompt template.

###### chainPollTemplate.value\_field\_name?

`string`

Value Field Name

**Description**

Field name to look for in the chainpoll response, for the rating.

**Default**

```ts theme={null}
rating;
```

###### cotEnabled?

`boolean`

(Optional) Whether chain-of-thought is enabled.

###### instructions?

`string`

(Optional) Instructions for the LLM scorer.

###### modelName?

`string`

(Optional) The model name to use.

###### numJudges?

`number`

(Optional) The number of judges for consensus.

###### userPrompt?

`string`

(Optional) User prompt for the LLM scorer.

##### Returns

`Promise`\<[`BaseScorerVersionResponse`](/sdk-api/typescript/reference/types/type-aliases/BaseScorerVersionResponse)>

A promise that resolves to the created scorer version.

#### Call Signature

```ts theme={null}
createLlmScorerVersion(
   scorerId: string,
   instructions?: string,
   chainPollTemplate?: object,
   userPrompt?: string,
   cotEnabled?: boolean,
   modelName?: string,
numJudges?: number): Promise<BaseScorerVersionResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new LLM scorer version.

##### Parameters

###### scorerId

`string`

The unique identifier of the scorer.

###### instructions?

`string`

(Optional) Instructions for the LLM scorer.

###### chainPollTemplate?

(Optional) Chain poll template configuration.

###### explanation\_field\_name?

`string`

Explanation Field Name

**Description**

Field name to look for in the chainpoll response, for the explanation.

**Default**

```ts theme={null}
explanation;
```

###### metric\_description?

`null` | `string`

Metric Description

**Description**

Description of what the metric should do.

###### metric\_few\_shot\_examples?

`object`\[]

Metric Few Shot Examples

**Description**

Few-shot examples for the metric.

###### metric\_system\_prompt?

`null` | `string`

Metric System Prompt

**Description**

System prompt for the metric.

###### response\_schema?

\| `null`
\| \{
\[`key`: `string`]: `unknown`;
}

Response Schema

**Description**

Response schema for the output

###### template

`string`

Template

**Description**

Chainpoll prompt template.

###### value\_field\_name?

`string`

Value Field Name

**Description**

Field name to look for in the chainpoll response, for the rating.

**Default**

```ts theme={null}
rating;
```

###### userPrompt?

`string`

(Optional) User prompt for the LLM scorer.

###### cotEnabled?

`boolean`

(Optional) Whether chain-of-thought is enabled.

###### modelName?

`string`

(Optional) The model name to use.

###### numJudges?

`number`

(Optional) The number of judges for consensus.

##### Returns

`Promise`\<[`BaseScorerVersionResponse`](/sdk-api/typescript/reference/types/type-aliases/BaseScorerVersionResponse)>

A promise that resolves to the created scorer version.

***

### createLogStream()

```ts theme={null}
createLogStream(name: string): Promise<{
  created_at: string;
  created_by?: null | string;
  has_user_created_sessions?: boolean;
  id: string;
  name: string;
  project_id: string;
  updated_at: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### name

`string`

#### Returns

`Promise`\<\{
`created_at`: `string`;
`created_by?`: `null` | `string`;
`has_user_created_sessions?`: `boolean`;
`id`: `string`;
`name`: `string`;
`project_id`: `string`;
`updated_at`: `string`;
}>

***

### createLogStreamScorerSettings()

```ts theme={null}
createLogStreamScorerSettings(logStreamId: string, scorers: ScorerConfig[]): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### logStreamId

`string`

##### scorers

[`ScorerConfig`](/sdk-api/typescript/reference/types/type-aliases/ScorerConfig)\[]

#### Returns

`Promise`\<`void`>

***

### createProject()

```ts theme={null}
createProject(name: string, options?: ProjectCreateOptions): Promise<{
  createdAt: string;
  createdBy?: null | string;
  id: string;
  name?: null | string;
  type?:   | null
     | "prompt_evaluation"
     | "llm_monitor"
     | "gen_ai"
     | "training_inference"
     | "protect";
  updatedAt: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new project.

#### Parameters

##### name

`string`

Name of the project to create.

##### options?

[`ProjectCreateOptions`](/sdk-api/typescript/reference/types/type-aliases/ProjectCreateOptions)

(Optional) Additional project creation parameters.

#### Returns

`Promise`\<\{
`createdAt`: `string`;
`createdBy?`: `null` | `string`;
`id`: `string`;
`name?`: `null` | `string`;
`type?`: | `null`
\| `"prompt_evaluation"`
\| `"llm_monitor"`
\| `"gen_ai"`
\| `"training_inference"`
\| `"protect"`;
`updatedAt`: `string`;
}>

A promise that resolves to the created project payload.

***

### createPromptRunJob()

```ts theme={null}
createPromptRunJob(
   experimentId: string,
   projectId: string,
   promptTemplateVersionId: string,
   datasetId: string,
   scorers?: ScorerConfig[],
   promptSettings?: PromptRunSettings): Promise<{
  dataset_id?: null | string;
  dataset_version_index?: null | number;
  epoch?: number;
  feature_names?: null | string[];
  job_id?: null | string;
  job_name?: string;
  labels?: string[] | string[][];
  link: string;
  log_metric_computing_records?: boolean;
  luna_model?: null | string;
  message: string;
  metric_critique_configuration?:   | null
     | {
     critique_ids: string[];
     metric_name: string;
     project_type: "prompt_evaluation" | "llm_monitor" | "gen_ai";
     recompute_settings?:   | null
        | {
        mode: "runs";
        run_ids: string[];
      }
        | {
        mode: "project";
      }
        | {
        filters: unknown[];
        mode: "observe_filters";
      }
        | {
        filters: unknown[];
        mode: "log_stream_filters";
        run_id: string;
      };
     scorer_id?: null | string;
   };
  migration_name?: null | string;
  monitor_batch_id?: null | string;
  ner_labels?: null | string[];
  non_inference_logged?: boolean;
  process_existing_inference_runs?: boolean;
  project_id: string;
  prompt_customized_scorers_configuration?:   | null
     | (
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "agentic_session_success";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_agentic_session_success";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "agentic_workflow_success";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_agentic_workflow_success";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: null | string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "chunk_attribution_utilization";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_chunk_attribution_utilization_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: null | string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "completeness";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_completeness_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     function_explanation_param_name?: string;
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "correctness";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_factuality";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "context_adherence";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_groundedness";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     function_explanation_param_name?: string;
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "instruction_adherence";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_instruction_adherence";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "ground_truth_adherence";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_ground_truth_adherence";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "prompt_injection";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_prompt_injection_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "output_sexist";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_sexist_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "input_sexist";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_input_sexist_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "tool_selection_quality";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_tool_selection_quality";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "tool_error_rate";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_tool_error_rate";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "output_toxicity";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_toxicity_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   }
     | {
     aggregate_keys?: string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?: {
        explanation_field_name?: string;
        metric_description?: string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template?: string;
        value_field_name?: string;
     };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: string;
     name?: "input_toxicity";
     num_judges?: number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name: "_customized_input_toxicity_gpt";
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   })[];
  prompt_dataset_id?: null | string;
  prompt_finetuned_scorers_configuration?: null | object[];
  prompt_generated_scorers_configuration?: null | string[];
  prompt_optimization_configuration?:   | null
     | {
     evaluation_criteria: string;
     evaluation_model_alias: string;
     generation_model_alias: string;
     includes_target: boolean;
     integration_name?:   | "anthropic"
        | "custom"
        | "aws_bedrock"
        | "aws_sagemaker"
        | "azure"
        | "databricks"
        | "mistral"
        | "nvidia"
        | "openai"
        | "vegas_gateway"
        | "vertex_ai"
        | "writer";
     iterations: number;
     max_tokens: number;
     num_rows: number;
     prompt: string;
     reasoning_effort?: null | string;
     task_description: string;
     temperature: number;
     verbosity?: null | string;
   };
  prompt_registered_scorers_configuration?: null | object[];
  prompt_scorer_settings?:   | null
     | {
     aggregate_keys?: null | string[];
     aggregates?:   | null
        | {
      [key: string]: unknown;
      };
     can_copy_to_llm?: null | boolean;
     chainpoll_template?:   | null
        | {
        explanation_field_name?: string;
        metric_description?: null | string;
        metric_few_shot_examples?: object[];
        metric_system_prompt?: null | string;
        response_schema?:   | null
           | {
         [key: string]: unknown;
         };
        template: string;
        value_field_name?: string;
      };
     class_name_to_vocab_ix?:   | null
        | {
      [key: string]: number[];
      }
        | {
      [key: string]: number;
      };
     cot_enabled?: null | boolean;
     description?: null | string;
     extra?:   | null
        | {
      [key: string]: unknown;
      };
     filters?:   | null
        | (
        | {
        case_sensitive?: boolean;
        filter_type?: "string";
        name: "node_name";
        operator: "eq" | "ne" | "contains";
        value: string;
      }
        | {
        filter_type?: "map";
        key: string;
        name: "metadata";
        operator: "eq" | "ne" | "not_in" | "one_of";
        value: string | string[];
      })[];
     generated_scorer_id?: null | string;
     ground_truth?: null | boolean;
     indices?: null | number[];
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     lora_task_id?: null | number;
     luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
     luna_output_type?: null | "string" | "float" | "string_list";
     metric_name?: null | string;
     model_alias?: null | string;
     name?: string;
     num_judges?: null | number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     prompt?: null | string;
     regex_field?: string;
     registered_scorer_id?: null | string;
     required_scorers?: null | string[];
     scoreable_node_types?:   | null
        | (
        | "agent"
        | "llm"
        | "retriever"
        | "tool"
        | "workflow"
        | "trace"
        | "session"
        | "chain"
        | "chat")[];
     scorer_name?: string;
     scores?: null | unknown[];
     sub_scorers?: (
        | "_completeness_gpt"
        | "_context_adherence_luna"
        | "_context_relevance"
        | "_context_relevance_luna"
        | "_chunk_attribution_utilization_gpt"
        | "_factuality"
        | "_groundedness"
        | "_latency"
        | "_prompt_perplexity"
        | "_protect_status"
        | "_pii"
        | "_input_pii"
        | "_sexist"
        | "_input_sexist"
        | "_sexist_gpt"
        | "_input_sexist_gpt"
        | "_tone"
        | "_input_tone"
        | "_toxicity"
        | "_toxicity_gpt"
        | "_input_toxicity"
        | "_input_toxicity_gpt"
        | "_user_registered"
        | "_user_submitted"
        | "_user_generated"
        | "_user_finetuned"
        | "_uncertainty"
        | "_bleu"
        | "_cost"
        | "_rouge"
        | "_prompt_injection_gpt"
        | "_prompt_injection"
        | "_rag_nli"
        | "_adherence_nli"
        | "_completeness_nli"
        | "_chunk_attribution_utilization_nli"
        | "_instruction_adherence"
        | "_ground_truth_adherence"
        | "_tool_selection_quality"
        | "_tool_selection_quality_luna"
        | "_tool_error_rate"
        | "_tool_error_rate_luna"
        | "_action_completion_luna"
        | "_agentic_session_success"
        | "_action_advancement_luna"
        | "_agentic_workflow_success"
        | "_generic_wizard"
        | "_customized_completeness_gpt"
        | "_customized_factuality"
        | "_customized_groundedness"
        | "_customized_chunk_attribution_utilization_gpt"
        | "_customized_instruction_adherence"
        | "_customized_ground_truth_adherence"
        | "_customized_prompt_injection_gpt"
        | "_customized_tool_selection_quality"
        | "_customized_tool_error_rate"
        | "_customized_agentic_session_success"
        | "_customized_agentic_workflow_success"
        | "_customized_sexist_gpt"
        | "_customized_input_sexist_gpt"
        | "_customized_toxicity_gpt"
       | "_customized_input_toxicity_gpt")[];
   };
  prompt_scorers_configuration?:   | null
     | {
     action_advancement_luna?: boolean;
     action_completion_luna?: boolean;
     adherence_nli?: boolean;
     agentic_session_success?: boolean;
     agentic_workflow_success?: boolean;
     bleu?: boolean;
     chunk_attribution_utilization_gpt?: boolean;
     chunk_attribution_utilization_nli?: boolean;
     completeness_gpt?: boolean;
     completeness_nli?: boolean;
     context_adherence_luna?: boolean;
     context_relevance?: boolean;
     context_relevance_luna?: boolean;
     cost?: boolean;
     factuality?: boolean;
     ground_truth_adherence?: boolean;
     groundedness?: boolean;
     input_pii?: boolean;
     input_sexist?: boolean;
     input_sexist_gpt?: boolean;
     input_tone?: boolean;
     input_toxicity?: boolean;
     input_toxicity_gpt?: boolean;
     instruction_adherence?: boolean;
     latency?: boolean;
     pii?: boolean;
     prompt_injection?: boolean;
     prompt_injection_gpt?: boolean;
     prompt_perplexity?: boolean;
     protect_status?: boolean;
     rouge?: boolean;
     sexist?: boolean;
     sexist_gpt?: boolean;
     tone?: boolean;
     tool_error_rate?: boolean;
     tool_error_rate_luna?: boolean;
     tool_selection_quality?: boolean;
     tool_selection_quality_luna?: boolean;
     toxicity?: boolean;
     toxicity_gpt?: boolean;
     uncertainty?: boolean;
   };
  prompt_settings?:   | null
     | {
     deployment_name?: null | string;
     echo?: boolean;
     frequency_penalty?: number;
     known_models?: object[];
     logprobs?: boolean;
     max_tokens?: number;
     model_alias?: string;
     n?: number;
     presence_penalty?: number;
     reasoning_effort?: string;
     response_format?:   | null
        | {
      [key: string]: string;
      };
     stop_sequences?: null | string[];
     temperature?: number;
     tool_choice?:   | null
        | string
        | {
        function: {
           name: string;
        };
        type?: string;
      };
     tools?: null | object[];
     top_k?: number;
     top_logprobs?: number;
     top_p?: number;
     verbosity?: string;
   };
  prompt_template_version_id?: null | string;
  protect_scorer_payload?: null | string;
  protect_trace_id?: null | string;
  resource_limits?:   | null
     | {
     cpu_time?: number;
     memory_mb?: number;
   };
  run_id: string;
  scorer_config?:   | null
     | {
     cot_enabled?: null | boolean;
     filters?:   | null
        | (
        | {
        case_sensitive?: boolean;
        filter_type?: "string";
        name: "node_name";
        operator: "eq" | "ne" | "contains";
        value: string;
      }
        | {
        filter_type?: "map";
        key: string;
        name: "metadata";
        operator: "eq" | "ne" | "not_in" | "one_of";
        value: string | string[];
      })[];
     id: string;
     input_type?:   | null
        | "basic"
        | "llm_spans"
        | "retriever_spans"
        | "sessions_normalized"
        | "sessions_trace_io_only"
        | "tool_spans"
        | "trace_input_only"
        | "trace_io_only"
        | "trace_normalized"
        | "trace_output_only"
        | "agent_spans"
        | "workflow_spans";
     model_name?: null | string;
     model_type?: null | "llm" | "code" | "slm";
     name?: null | string;
     num_judges?: null | number;
     output_type?:   | null
        | "boolean"
        | "categorical"
        | "count"
        | "discrete"
        | "freeform"
        | "percentage"
        | "multilabel";
     scoreable_node_types?: null | string[];
     scorer_type: "luna" | "llm" | "code" | "preset";
     scorer_version?:   | null
        | {
        cot_enabled?: null | boolean;
        finetuned_scorer?:   | null
           | {
           class_name_to_vocab_ix?:   | null
              | {
            [key: string]: ...[];
            }
              | {
            [key: string]: number;
            };
           executor?:   | null
              | "agentic_session_success"
              | "agentic_workflow_success"
              | "action_completion_luna"
              | "action_advancement_luna"
              | "agent_efficiency"
              | "agent_flow"
              | "bleu"
              | "chunk_attribution_utilization_luna"
              | "chunk_attribution_utilization"
              | "completeness_luna"
              | "completeness"
              | "context_adherence"
              | "context_adherence_luna"
              | "context_relevance"
              | "context_relevance_luna"
              | "conversation_quality"
              | "correctness"
              | "ground_truth_adherence"
              | "input_pii"
              | "input_pii_gpt"
              | "input_sexist"
              | "input_sexist_luna"
              | "input_tone"
              | "input_tone_gpt"
              | "input_toxicity"
              | "input_toxicity_luna"
              | "instruction_adherence"
              | "output_pii"
              | "output_pii_gpt"
              | "output_sexist"
              | "output_sexist_luna"
              | "output_tone"
              | "output_tone_gpt"
              | "output_toxicity"
              | "output_toxicity_luna"
              | "prompt_injection"
              | "prompt_injection_luna"
              | "prompt_perplexity"
              | "rouge"
              | "tool_error_rate"
              | "tool_error_rate_luna"
              | "tool_selection_quality"
              | "tool_selection_quality_luna"
              | "uncertainty"
              | "user_intent_change";
           id: string;
           lora_task_id: number;
           luna_input_type?: null | "span" | "trace_object" | "trace_input_output_only";
           luna_output_type?: null | "string" | "float" | "string_list";
           name: string;
           prompt: string;
         };
        generated_scorer?:   | null
           | {
           chain_poll_template: {
              explanation_field_name?: string;
              metric_description?: null | string;
              metric_few_shot_examples?: ...[];
              metric_system_prompt?: null | string;
              response_schema?:   | null
                 | {
               [key: ...]: ...;
               };
              template: string;
              value_field_name?: string;
           };
           id: string;
           instructions?: null | string;
           name: string;
           user_prompt?: null | string;
         };
        id: string;
        input_type?:   | null
           | "basic"
           | "llm_spans"
           | "retriever_spans"
           | "sessions_normalized"
           | "sessions_trace_io_only"
           | "tool_spans"
           | "trace_input_only"
           | "trace_io_only"
           | "trace_normalized"
           | "trace_output_only"
           | "agent_spans"
           | "workflow_spans";
        model_name?: null | string;
        num_judges?: null | number;
        output_type?:   | null
           | "boolean"
           | "categorical"
           | "count"
           | "discrete"
           | "freeform"
           | "percentage"
           | "multilabel";
        registered_scorer?:   | null
           | {
           id: string;
           name: string;
           score_type?: null | string;
         };
        scoreable_node_types?: null | string[];
        scorer_id: string;
        version: number;
      };
   };
  scorers?:   | null
     | object[]
     | (
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "agentic_session_success";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "agentic_workflow_success";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "bleu";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "chunk_attribution_utilization";
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "completeness";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "context_adherence";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "context_relevance";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "correctness";
     num_judges?: null | number;
     type?: "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "ground_truth_adherence";
     num_judges?: null | number;
     type?: "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "input_pii";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "input_sexist";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "input_tone";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "input_toxicity";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "instruction_adherence";
     num_judges?: null | number;
     type?: "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "output_pii";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "output_sexist";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "output_tone";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "output_toxicity";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "prompt_injection";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "prompt_perplexity";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "rouge";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "tool_error_rate";
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     model_name?: null | string;
     name: "tool_selection_quality";
     num_judges?: null | number;
     type?: "luna" | "plus";
   }
     | {
     filters?:   | null
        | (
        | {
        case_sensitive?: ... | ... | ...;
        filter_type?: ... | ...;
        name: "node_name";
        operator: ... | ... | ...;
        value: string;
      }
        | {
        filter_type?: ... | ...;
        key: string;
        name: "metadata";
        operator: ... | ... | ... | ...;
        value: ... | ...;
      })[];
     name: "uncertainty";
   })[];
  segment_filters?: null | object[];
  should_retry?: boolean;
  sub_scorers?: (
     | "_completeness_gpt"
     | "_context_adherence_luna"
     | "_context_relevance"
     | "_context_relevance_luna"
     | "_chunk_attribution_utilization_gpt"
     | "_factuality"
     | "_groundedness"
     | "_latency"
     | "_prompt_perplexity"
     | "_protect_status"
     | "_pii"
     | "_input_pii"
     | "_sexist"
     | "_input_sexist"
     | "_sexist_gpt"
     | "_input_sexist_gpt"
     | "_tone"
     | "_input_tone"
     | "_toxicity"
     | "_toxicity_gpt"
     | "_input_toxicity"
     | "_input_toxicity_gpt"
     | "_user_registered"
     | "_user_submitted"
     | "_user_generated"
     | "_user_finetuned"
     | "_uncertainty"
     | "_bleu"
     | "_cost"
     | "_rouge"
     | "_prompt_injection_gpt"
     | "_prompt_injection"
     | "_rag_nli"
     | "_adherence_nli"
     | "_completeness_nli"
     | "_chunk_attribution_utilization_nli"
     | "_instruction_adherence"
     | "_ground_truth_adherence"
     | "_tool_selection_quality"
     | "_tool_selection_quality_luna"
     | "_tool_error_rate"
     | "_tool_error_rate_luna"
     | "_action_completion_luna"
     | "_agentic_session_success"
     | "_action_advancement_luna"
     | "_agentic_workflow_success"
     | "_generic_wizard"
     | "_customized_completeness_gpt"
     | "_customized_factuality"
     | "_customized_groundedness"
     | "_customized_chunk_attribution_utilization_gpt"
     | "_customized_instruction_adherence"
     | "_customized_ground_truth_adherence"
     | "_customized_prompt_injection_gpt"
     | "_customized_tool_selection_quality"
     | "_customized_tool_error_rate"
     | "_customized_agentic_session_success"
     | "_customized_agentic_workflow_success"
     | "_customized_sexist_gpt"
     | "_customized_input_sexist_gpt"
     | "_customized_toxicity_gpt"
    | "_customized_input_toxicity_gpt")[];
  task_type?:   | null
     | 0
     | 1
     | 2
     | 3
     | 4
     | 5
     | 6
     | 7
     | 8
     | 9
     | 10
     | 11
     | 12
     | 13
     | 14
     | 15
     | 16
     | 17
     | 18;
  tasks?: null | string[];
  upload_data_in_separate_task?: boolean;
  user_id?: null | string;
  xray?: boolean;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### experimentId

`string`

##### projectId

`string`

##### promptTemplateVersionId

`string`

##### datasetId

`string`

##### scorers?

[`ScorerConfig`](/sdk-api/typescript/reference/types/type-aliases/ScorerConfig)\[]

##### promptSettings?

[`PromptRunSettings`](/sdk-api/typescript/reference/types/interfaces/PromptRunSettings)

#### Returns

`Promise`\<\{
`dataset_id?`: `null` | `string`;
`dataset_version_index?`: `null` | `number`;
`epoch?`: `number`;
`feature_names?`: `null` | `string`\[];
`job_id?`: `null` | `string`;
`job_name?`: `string`;
`labels?`: `string`\[] | `string`\[]\[];
`link`: `string`;
`log_metric_computing_records?`: `boolean`;
`luna_model?`: `null` | `string`;
`message`: `string`;
`metric_critique_configuration?`: | `null`
\| \{
`critique_ids`: `string`\[];
`metric_name`: `string`;
`project_type`: `"prompt_evaluation"` | `"llm_monitor"` | `"gen_ai"`;
`recompute_settings?`: | `null`
\| \{
`mode`: `"runs"`;
`run_ids`: `string`\[];
}
\| \{
`mode`: `"project"`;
}
\| \{
`filters`: `unknown`\[];
`mode`: `"observe_filters"`;
}
\| \{
`filters`: `unknown`\[];
`mode`: `"log_stream_filters"`;
`run_id`: `string`;
};
`scorer_id?`: `null` | `string`;
};
`migration_name?`: `null` | `string`;
`monitor_batch_id?`: `null` | `string`;
`ner_labels?`: `null` | `string`\[];
`non_inference_logged?`: `boolean`;
`process_existing_inference_runs?`: `boolean`;
`project_id`: `string`;
`prompt_customized_scorers_configuration?`: | `null`
\| (
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"agentic_session_success"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_agentic_session_success"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"agentic_workflow_success"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_agentic_workflow_success"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"chunk_attribution_utilization"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_chunk_attribution_utilization_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"completeness"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_completeness_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`function_explanation_param_name?`: `string`;
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"correctness"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_factuality"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"context_adherence"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_groundedness"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`function_explanation_param_name?`: `string`;
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"instruction_adherence"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_instruction_adherence"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"ground_truth_adherence"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_ground_truth_adherence"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"prompt_injection"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_prompt_injection_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"output_sexist"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_sexist_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"input_sexist"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_input_sexist_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"tool_selection_quality"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_tool_selection_quality"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"tool_error_rate"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_tool_error_rate"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"output_toxicity"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_toxicity_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
}
\| \{
`aggregate_keys?`: `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template?`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `string`;
`name?`: `"input_toxicity"`;
`num_judges?`: `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name`: `"_customized_input_toxicity_gpt"`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
})\[];
`prompt_dataset_id?`: `null` | `string`;
`prompt_finetuned_scorers_configuration?`: `null` | `object`\[];
`prompt_generated_scorers_configuration?`: `null` | `string`\[];
`prompt_optimization_configuration?`: | `null`
\| \{
`evaluation_criteria`: `string`;
`evaluation_model_alias`: `string`;
`generation_model_alias`: `string`;
`includes_target`: `boolean`;
`integration_name?`: | `"anthropic"`
\| `"custom"`
\| `"aws_bedrock"`
\| `"aws_sagemaker"`
\| `"azure"`
\| `"databricks"`
\| `"mistral"`
\| `"nvidia"`
\| `"openai"`
\| `"vegas_gateway"`
\| `"vertex_ai"`
\| `"writer"`;
`iterations`: `number`;
`max_tokens`: `number`;
`num_rows`: `number`;
`prompt`: `string`;
`reasoning_effort?`: `null` | `string`;
`task_description`: `string`;
`temperature`: `number`;
`verbosity?`: `null` | `string`;
};
`prompt_registered_scorers_configuration?`: `null` | `object`\[];
`prompt_scorer_settings?`: | `null`
\| \{
`aggregate_keys?`: `null` | `string`\[];
`aggregates?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`can_copy_to_llm?`: `null` | `boolean`;
`chainpoll_template?`: | `null`
\| \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: `object`\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`template`: `string`;
`value_field_name?`: `string`;
};
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: `number`\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`cot_enabled?`: `null` | `boolean`;
`description?`: `null` | `string`;
`extra?`: | `null`
\| \{
\[`key`: `string`]: `unknown`;
};
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: `boolean`;
`filter_type?`: `"string"`;
`name`: `"node_name"`;
`operator`: `"eq"` | `"ne"` | `"contains"`;
`value`: `string`;
}
\| \{
`filter_type?`: `"map"`;
`key`: `string`;
`name`: `"metadata"`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
})\[];
`generated_scorer_id?`: `null` | `string`;
`ground_truth?`: `null` | `boolean`;
`indices?`: `null` | `number`\[];
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`lora_task_id?`: `null` | `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`metric_name?`: `null` | `string`;
`model_alias?`: `null` | `string`;
`name?`: `string`;
`num_judges?`: `null` | `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`prompt?`: `null` | `string`;
`regex_field?`: `string`;
`registered_scorer_id?`: `null` | `string`;
`required_scorers?`: `null` | `string`\[];
`scoreable_node_types?`: | `null`
\| (
\| `"agent"`
\| `"llm"`
\| `"retriever"`
\| `"tool"`
\| `"workflow"`
\| `"trace"`
\| `"session"`
\| `"chain"`
\| `"chat"`)\[];
`scorer_name?`: `string`;
`scores?`: `null` | `unknown`\[];
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
};
`prompt_scorers_configuration?`: | `null`
\| \{
`action_advancement_luna?`: `boolean`;
`action_completion_luna?`: `boolean`;
`adherence_nli?`: `boolean`;
`agentic_session_success?`: `boolean`;
`agentic_workflow_success?`: `boolean`;
`bleu?`: `boolean`;
`chunk_attribution_utilization_gpt?`: `boolean`;
`chunk_attribution_utilization_nli?`: `boolean`;
`completeness_gpt?`: `boolean`;
`completeness_nli?`: `boolean`;
`context_adherence_luna?`: `boolean`;
`context_relevance?`: `boolean`;
`context_relevance_luna?`: `boolean`;
`cost?`: `boolean`;
`factuality?`: `boolean`;
`ground_truth_adherence?`: `boolean`;
`groundedness?`: `boolean`;
`input_pii?`: `boolean`;
`input_sexist?`: `boolean`;
`input_sexist_gpt?`: `boolean`;
`input_tone?`: `boolean`;
`input_toxicity?`: `boolean`;
`input_toxicity_gpt?`: `boolean`;
`instruction_adherence?`: `boolean`;
`latency?`: `boolean`;
`pii?`: `boolean`;
`prompt_injection?`: `boolean`;
`prompt_injection_gpt?`: `boolean`;
`prompt_perplexity?`: `boolean`;
`protect_status?`: `boolean`;
`rouge?`: `boolean`;
`sexist?`: `boolean`;
`sexist_gpt?`: `boolean`;
`tone?`: `boolean`;
`tool_error_rate?`: `boolean`;
`tool_error_rate_luna?`: `boolean`;
`tool_selection_quality?`: `boolean`;
`tool_selection_quality_luna?`: `boolean`;
`toxicity?`: `boolean`;
`toxicity_gpt?`: `boolean`;
`uncertainty?`: `boolean`;
};
`prompt_settings?`: | `null`
\| \{
`deployment_name?`: `null` | `string`;
`echo?`: `boolean`;
`frequency_penalty?`: `number`;
`known_models?`: `object`\[];
`logprobs?`: `boolean`;
`max_tokens?`: `number`;
`model_alias?`: `string`;
`n?`: `number`;
`presence_penalty?`: `number`;
`reasoning_effort?`: `string`;
`response_format?`: | `null`
\| \{
\[`key`: `string`]: `string`;
};
`stop_sequences?`: `null` | `string`\[];
`temperature?`: `number`;
`tool_choice?`: | `null`
\| `string`
\| \{
`function`: \{
`name`: `string`;
};
`type?`: `string`;
};
`tools?`: `null` | `object`\[];
`top_k?`: `number`;
`top_logprobs?`: `number`;
`top_p?`: `number`;
`verbosity?`: `string`;
};
`prompt_template_version_id?`: `null` | `string`;
`protect_scorer_payload?`: `null` | `string`;
`protect_trace_id?`: `null` | `string`;
`resource_limits?`: | `null`
\| \{
`cpu_time?`: `number`;
`memory_mb?`: `number`;
};
`run_id`: `string`;
`scorer_config?`: | `null`
\| \{
`cot_enabled?`: `null` | `boolean`;
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: `boolean`;
`filter_type?`: `"string"`;
`name`: `"node_name"`;
`operator`: `"eq"` | `"ne"` | `"contains"`;
`value`: `string`;
}
\| \{
`filter_type?`: `"map"`;
`key`: `string`;
`name`: `"metadata"`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
})\[];
`id`: `string`;
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`model_name?`: `null` | `string`;
`model_type?`: `null` | `"llm"` | `"code"` | `"slm"`;
`name?`: `null` | `string`;
`num_judges?`: `null` | `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`scoreable_node_types?`: `null` | `string`\[];
`scorer_type`: `"luna"` | `"llm"` | `"code"` | `"preset"`;
`scorer_version?`: | `null`
\| \{
`cot_enabled?`: `null` | `boolean`;
`finetuned_scorer?`: | `null`
\| \{
`class_name_to_vocab_ix?`: | `null`
\| \{
\[`key`: `string`]: ...\[];
}
\| \{
\[`key`: `string`]: `number`;
};
`executor?`: | `null`
\| `"agentic_session_success"`
\| `"agentic_workflow_success"`
\| `"action_completion_luna"`
\| `"action_advancement_luna"`
\| `"agent_efficiency"`
\| `"agent_flow"`
\| `"bleu"`
\| `"chunk_attribution_utilization_luna"`
\| `"chunk_attribution_utilization"`
\| `"completeness_luna"`
\| `"completeness"`
\| `"context_adherence"`
\| `"context_adherence_luna"`
\| `"context_relevance"`
\| `"context_relevance_luna"`
\| `"conversation_quality"`
\| `"correctness"`
\| `"ground_truth_adherence"`
\| `"input_pii"`
\| `"input_pii_gpt"`
\| `"input_sexist"`
\| `"input_sexist_luna"`
\| `"input_tone"`
\| `"input_tone_gpt"`
\| `"input_toxicity"`
\| `"input_toxicity_luna"`
\| `"instruction_adherence"`
\| `"output_pii"`
\| `"output_pii_gpt"`
\| `"output_sexist"`
\| `"output_sexist_luna"`
\| `"output_tone"`
\| `"output_tone_gpt"`
\| `"output_toxicity"`
\| `"output_toxicity_luna"`
\| `"prompt_injection"`
\| `"prompt_injection_luna"`
\| `"prompt_perplexity"`
\| `"rouge"`
\| `"tool_error_rate"`
\| `"tool_error_rate_luna"`
\| `"tool_selection_quality"`
\| `"tool_selection_quality_luna"`
\| `"uncertainty"`
\| `"user_intent_change"`;
`id`: `string`;
`lora_task_id`: `number`;
`luna_input_type?`: `null` | `"span"` | `"trace_object"` | `"trace_input_output_only"`;
`luna_output_type?`: `null` | `"string"` | `"float"` | `"string_list"`;
`name`: `string`;
`prompt`: `string`;
};
`generated_scorer?`: | `null`
\| \{
`chain_poll_template`: \{
`explanation_field_name?`: `string`;
`metric_description?`: `null` | `string`;
`metric_few_shot_examples?`: ...\[];
`metric_system_prompt?`: `null` | `string`;
`response_schema?`: | `null`
\| \{
\[`key`: ...]: ...;
};
`template`: `string`;
`value_field_name?`: `string`;
};
`id`: `string`;
`instructions?`: `null` | `string`;
`name`: `string`;
`user_prompt?`: `null` | `string`;
};
`id`: `string`;
`input_type?`: | `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`;
`model_name?`: `null` | `string`;
`num_judges?`: `null` | `number`;
`output_type?`: | `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`;
`registered_scorer?`: | `null`
\| \{
`id`: `string`;
`name`: `string`;
`score_type?`: `null` | `string`;
};
`scoreable_node_types?`: `null` | `string`\[];
`scorer_id`: `string`;
`version`: `number`;
};
};
`scorers?`: | `null`
\| `object`\[]
\| (
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"agentic_session_success"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"agentic_workflow_success"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"bleu"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"chunk_attribution_utilization"`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"completeness"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"context_adherence"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"context_relevance"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"correctness"`;
`num_judges?`: `null` | `number`;
`type?`: `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"ground_truth_adherence"`;
`num_judges?`: `null` | `number`;
`type?`: `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"input_pii"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"input_sexist"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"input_tone"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"input_toxicity"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"instruction_adherence"`;
`num_judges?`: `null` | `number`;
`type?`: `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"output_pii"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"output_sexist"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"output_tone"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"output_toxicity"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"prompt_injection"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"prompt_perplexity"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"rouge"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"tool_error_rate"`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`model_name?`: `null` | `string`;
`name`: `"tool_selection_quality"`;
`num_judges?`: `null` | `number`;
`type?`: `"luna"` | `"plus"`;
}
\| \{
`filters?`: | `null`
\| (
\| \{
`case_sensitive?`: ... | ... | ...;
`filter_type?`: ... | ...;
`name`: `"node_name"`;
`operator`: ... | ... | ...;
`value`: `string`;
}
\| \{
`filter_type?`: ... | ...;
`key`: `string`;
`name`: `"metadata"`;
`operator`: ... | ... | ... | ...;
`value`: ... | ...;
})\[];
`name`: `"uncertainty"`;
})\[];
`segment_filters?`: `null` | `object`\[];
`should_retry?`: `boolean`;
`sub_scorers?`: (
\| `"_completeness_gpt"`
\| `"_context_adherence_luna"`
\| `"_context_relevance"`
\| `"_context_relevance_luna"`
\| `"_chunk_attribution_utilization_gpt"`
\| `"_factuality"`
\| `"_groundedness"`
\| `"_latency"`
\| `"_prompt_perplexity"`
\| `"_protect_status"`
\| `"_pii"`
\| `"_input_pii"`
\| `"_sexist"`
\| `"_input_sexist"`
\| `"_sexist_gpt"`
\| `"_input_sexist_gpt"`
\| `"_tone"`
\| `"_input_tone"`
\| `"_toxicity"`
\| `"_toxicity_gpt"`
\| `"_input_toxicity"`
\| `"_input_toxicity_gpt"`
\| `"_user_registered"`
\| `"_user_submitted"`
\| `"_user_generated"`
\| `"_user_finetuned"`
\| `"_uncertainty"`
\| `"_bleu"`
\| `"_cost"`
\| `"_rouge"`
\| `"_prompt_injection_gpt"`
\| `"_prompt_injection"`
\| `"_rag_nli"`
\| `"_adherence_nli"`
\| `"_completeness_nli"`
\| `"_chunk_attribution_utilization_nli"`
\| `"_instruction_adherence"`
\| `"_ground_truth_adherence"`
\| `"_tool_selection_quality"`
\| `"_tool_selection_quality_luna"`
\| `"_tool_error_rate"`
\| `"_tool_error_rate_luna"`
\| `"_action_completion_luna"`
\| `"_agentic_session_success"`
\| `"_action_advancement_luna"`
\| `"_agentic_workflow_success"`
\| `"_generic_wizard"`
\| `"_customized_completeness_gpt"`
\| `"_customized_factuality"`
\| `"_customized_groundedness"`
\| `"_customized_chunk_attribution_utilization_gpt"`
\| `"_customized_instruction_adherence"`
\| `"_customized_ground_truth_adherence"`
\| `"_customized_prompt_injection_gpt"`
\| `"_customized_tool_selection_quality"`
\| `"_customized_tool_error_rate"`
\| `"_customized_agentic_session_success"`
\| `"_customized_agentic_workflow_success"`
\| `"_customized_sexist_gpt"`
\| `"_customized_input_sexist_gpt"`
\| `"_customized_toxicity_gpt"`
\| `"_customized_input_toxicity_gpt"`)\[];
`task_type?`: | `null`
\| `0`
\| `1`
\| `2`
\| `3`
\| `4`
\| `5`
\| `6`
\| `7`
\| `8`
\| `9`
\| `10`
\| `11`
\| `12`
\| `13`
\| `14`
\| `15`
\| `16`
\| `17`
\| `18`;
`tasks?`: `null` | `string`\[];
`upload_data_in_separate_task?`: `boolean`;
`user_id?`: `null` | `string`;
`xray?`: `boolean`;
}>

***

### createPromptTemplate()

```ts theme={null}
createPromptTemplate(template: object[], name: string): Promise<PromptTemplate>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new prompt template scoped to the initialized project.

Creates a project-scoped prompt template that is associated with the project
the client was initialized with.

For global templates (which can be shared across projects but can optionally
be associated with a project), use `createGlobalPromptTemplate()` instead,
which accepts optional `projectId` or `projectName` parameters.

#### Parameters

##### template

`object`\[]

An array of Message objects representing the template
content. Each message should have a role (e.g., 'user', 'system',
'assistant') and content.

##### name

`string`

A unique name to assign to the template within the project.
The name should be descriptive and follow your naming conventions.

#### Returns

`Promise`\<[`PromptTemplate`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplate)>

A promise that resolves to the created prompt template payload,
including the assigned ID, version information, and metadata.

#### Throws

Error if a template with the same name already exists in the project,
if the client is not initialized with a project, if the service is
unavailable, or if the template data is invalid.

***

### createRunScorerSettings()

```ts theme={null}
createRunScorerSettings(
   experimentId: string,
   projectId: string,
scorers: ScorerConfig[]): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### experimentId

`string`

##### projectId

`string`

##### scorers

[`ScorerConfig`](/sdk-api/typescript/reference/types/type-aliases/ScorerConfig)\[]

#### Returns

`Promise`\<`void`>

***

### createScorer()

#### Call Signature

```ts theme={null}
createScorer(options: createScorerOptions): Promise<ScorerResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new scorer.

##### Parameters

###### options

[`createScorerOptions`](/sdk-api/typescript/reference/types/type-aliases/createScorerOptions)

The scorer creation options.

##### Returns

`Promise`\<[`ScorerResponse`](/sdk-api/typescript/reference/types/type-aliases/ScorerResponse)>

A promise that resolves to the created scorer.

#### Call Signature

```ts theme={null}
createScorer(
   name: string,
   scorerType: ScorerTypes,
   description?: string,
   tags?: string[],
   defaults?: object,
   modelType?: "llm" | "code" | "slm",
   defaultVersionId?: string,
   scoreableNodeTypes?: ("agent" | "llm" | "retriever" | "tool" | "workflow" | "trace" | "session")[],
   outputType?: OutputType,
inputType?: InputType): Promise<ScorerResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates a new scorer.

##### Parameters

###### name

`string`

The name of the scorer.

###### scorerType

[`ScorerTypes`](/sdk-api/typescript/reference/types/enumerations/ScorerTypes)

The type of the scorer.

###### description?

`string`

(Optional) A description for the scorer.

###### tags?

`string`\[]

(Optional) Tags to associate with the scorer.

###### defaults?

(Optional) Default settings for the scorer. Required for LLM scorers.

###### cot\_enabled?

`null` | `boolean`

Cot Enabled

**Description**

Whether to enable chain of thought for this scorer. Defaults to False for llm scorers.

###### filters?

\| `null`
\| (
\| \{
`case_sensitive?`: `boolean`;
`filter_type?`: `"string"`;
`name`: `"node_name"`;
`operator`: `"eq"` | `"ne"` | `"contains"`;
`value`: `string`;
}
\| \{
`filter_type?`: `"map"`;
`key`: `string`;
`name`: `"metadata"`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
})\[]

Filters

**Description**

List of filters to apply to the scorer.

###### input\_type?

\| `null`
\| `"basic"`
\| `"llm_spans"`
\| `"retriever_spans"`
\| `"sessions_normalized"`
\| `"sessions_trace_io_only"`
\| `"tool_spans"`
\| `"trace_input_only"`
\| `"trace_io_only"`
\| `"trace_normalized"`
\| `"trace_output_only"`
\| `"agent_spans"`
\| `"workflow_spans"`

**Description**

What type of input to use for model-based scorers (sessions\_normalized, trace\_io\_only, etc..).

###### model\_name?

`null` | `string`

Model Name

###### num\_judges?

`null` | `number`

Num Judges

###### output\_type?

\| `null`
\| `"boolean"`
\| `"categorical"`
\| `"count"`
\| `"discrete"`
\| `"freeform"`
\| `"percentage"`
\| `"multilabel"`

**Description**

What type of output to use for model-based scorers (boolean, categorical, etc.).

###### scoreable\_node\_types?

`null` | `string`\[]

Scoreable Node Types

**Description**

List of node types that can be scored by this scorer. Defaults to llm/chat.

###### modelType?

(Optional) The model type for the scorer.

`"llm"` | `"code"` | `"slm"`

###### defaultVersionId?

`string`

(Optional) The default version ID for the scorer.

###### scoreableNodeTypes?

(`"agent"` | `"llm"` | `"retriever"` | `"tool"` | `"workflow"` | `"trace"` | `"session"`)\[]

(Optional) The node types that can be scored.

###### outputType?

[`OutputType`](/sdk-api/typescript/reference/types/enumerations/OutputType)

(Optional) The output type for the scorer.

###### inputType?

[`InputType`](/sdk-api/typescript/reference/types/enumerations/InputType)

(Optional) The input type for the scorer.

##### Returns

`Promise`\<[`ScorerResponse`](/sdk-api/typescript/reference/types/type-aliases/ScorerResponse)>

A promise that resolves to the created scorer.

***

### createSessionLegacy()

```ts theme={null}
createSessionLegacy(__namedParameters: object): Promise<{
  externalId?: null | string;
  id: string;
  name: null | string;
  previousSessionId?: null | string;
  projectId: string;
  projectName: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### \_\_namedParameters

###### externalId?

`string`

###### name?

`string`

###### previousSessionId?

`string`

#### Returns

`Promise`\<\{
`externalId?`: `null` | `string`;
`id`: `string`;
`name`: `null` | `string`;
`previousSessionId?`: `null` | `string`;
`projectId`: `string`;
`projectName`: `string`;
}>

***

### createUserProjectCollaborators()

```ts theme={null}
createUserProjectCollaborators(collaborators: object[], projectId?: string): Promise<object[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Creates user collaborators for a project.

#### Parameters

##### collaborators

`object`\[]

Collaborator payloads to create.

##### projectId?

`string`

(Optional) Project ID override when not using a scoped client.

#### Returns

`Promise`\<`object`\[]>

A promise that resolves to the created collaborators.

***

### deleteDataset()

```ts theme={null}
deleteDataset(datasetId: string): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Deletes a dataset by ID.

#### Parameters

##### datasetId

`string`

The ID of the dataset to delete.

#### Returns

`Promise`\<`void`>

A promise that resolves when the dataset has been deleted.

***

### deleteGlobalPromptTemplate()

```ts theme={null}
deleteGlobalPromptTemplate(id: string): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Deletes a global prompt template by ID.

#### Parameters

##### id

`string`

Template identifier to delete.

#### Returns

`Promise`\<`void`>

A promise that resolves when the template is removed.

***

### deleteProject()

```ts theme={null}
deleteProject(projectId: string): Promise<{
  message: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Deletes a project by ID.

#### Parameters

##### projectId

`string`

ID of the project to delete.

#### Returns

`Promise`\<\{
`message`: `string`;
}>

A promise that resolves to the delete response payload.

***

### deleteScorer()

```ts theme={null}
deleteScorer(scorerId: string): Promise<DeleteScorerResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Deletes a scorer by its unique identifier.

#### Parameters

##### scorerId

`string`

The unique identifier of the scorer to delete.

#### Returns

`Promise`\<[`DeleteScorerResponse`](/sdk-api/typescript/reference/types/type-aliases/DeleteScorerResponse)>

A promise that resolves to a response containing a success message.

***

### deleteSessions()

```ts theme={null}
deleteSessions(options: object): Promise<{
  message: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Delete sessions matching the provided filter criteria.

#### Parameters

##### options

Delete request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to identify sessions to delete

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

#### Returns

`Promise`\<\{
`message`: `string`;
}>

Promise resolving to a response indicating the deletion operation result

***

### deleteSpans()

```ts theme={null}
deleteSpans(options: object): Promise<{
  message: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Delete spans matching the provided filter criteria.

#### Parameters

##### options

Delete request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to identify spans to delete

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

#### Returns

`Promise`\<\{
`message`: `string`;
}>

Promise resolving to a response indicating the deletion operation result

***

### deleteTraces()

```ts theme={null}
deleteTraces(options: object): Promise<{
  message: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Delete traces matching the provided filter criteria.

#### Parameters

##### options

Delete request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to identify traces to delete

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

#### Returns

`Promise`\<\{
`message`: `string`;
}>

Promise resolving to a response indicating the deletion operation result

***

### deleteUserProjectCollaborator()

```ts theme={null}
deleteUserProjectCollaborator(userId: string, projectId: string): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Removes a user collaborator from a project.

#### Parameters

##### userId

`string`

ID of the collaborator to delete.

##### projectId

`string`

ID of the project the collaborator belongs to.

#### Returns

`Promise`\<`void`>

A promise that resolves when the collaborator is removed.

***

### exportRecords()

```ts theme={null}
exportRecords(options: LogRecordsExportRequest): Promise<AsyncIterable<string | Record<string, unknown>, any, any>>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Stream records from the export endpoint.

Defaults to the first log stream available if `logStreamId` and `experimentId` are not provided.

Setup (validation, log stream resolution) happens immediately when this function is called.
The HTTP request is made immediately when this function is called.
Record streaming and line buffering happen when the returned AsyncIterable is iterated.

#### Parameters

##### options

[`LogRecordsExportRequest`](/sdk-api/typescript/reference/types/type-aliases/LogRecordsExportRequest)

#### Returns

`Promise`\<`AsyncIterable`\<`string` | `Record`\<`string`, `unknown`>, `any`, `any`>>

A Promise that resolves to an AsyncIterable that yields records based on the export format.

* For JSONL format: Each record is a `string` containing a complete JSONL line (JSON object as string with trailing newline)
* For JSON format: Each record is a `Record<string, unknown>` (parsed JSON object)
* For CSV format: Each record is a `string` containing a complete CSV line (with trailing newline)

***

### extendDataset()

```ts theme={null}
extendDataset(params: SyntheticDatasetExtensionRequest): Promise<SyntheticDatasetExtensionResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Extends a dataset with synthetically generated data.

#### Parameters

##### params

[`SyntheticDatasetExtensionRequest`](/sdk-api/typescript/reference/README/type-aliases/SyntheticDatasetExtensionRequest)

Configuration for synthetic dataset generation.

#### Returns

`Promise`\<[`SyntheticDatasetExtensionResponse`](/sdk-api/typescript/reference/types/type-aliases/SyntheticDatasetExtensionResponse)>

A promise that resolves to the synthetic dataset extension response.

***

### getAggregatedTraceView()

```ts theme={null}
getAggregatedTraceView(options: object): Promise<{
  endTime?: null | string;
  graph: {
     edges: object[];
     nodes: object[];
  };
  hasAllTraces: boolean;
  numSessions: number;
  numTraces: number;
  startTime?: null | string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Get an aggregated view of traces, providing a graph representation of trace relationships and patterns.

#### Parameters

##### options

Request object

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to apply (only trace-level filters are supported)

###### logStreamId

`string`

Log stream ID associated with the traces

#### Returns

`Promise`\<\{
`endTime?`: `null` | `string`;
`graph`: \{
`edges`: `object`\[];
`nodes`: `object`\[];
};
`hasAllTraces`: `boolean`;
`numSessions`: `number`;
`numTraces`: `number`;
`startTime?`: `null` | `string`;
}>

Promise resolving to an aggregated trace view with graph data

***

### getApiUrl()

```ts theme={null}
protected getApiUrl(projectType: string): string;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Parameters

##### projectType

`string`

#### Returns

`string`

#### Inherited from

```ts theme={null}
BaseClient.getApiUrl;
```

***

### getAuthHeader()

```ts theme={null}
protected getAuthHeader(token: string): object;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Parameters

##### token

`string`

#### Returns

`object`

##### Authorization

```ts theme={null}
Authorization: string;
```

#### Inherited from

```ts theme={null}
BaseClient.getAuthHeader;
```

***

### getDataset()

```ts theme={null}
getDataset(id: string): Promise<DatasetDBType>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets a dataset by ID.

#### Parameters

##### id

`string`

The ID of the dataset to retrieve.

#### Returns

`Promise`\<[`DatasetDBType`](/sdk-api/typescript/reference/types/type-aliases/DatasetDBType)>

A promise that resolves to the dataset.

***

### getDatasetByName()

```ts theme={null}
getDatasetByName(name: string): Promise<DatasetDBType>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets a dataset by name.

#### Parameters

##### name

`string`

The name of the dataset to retrieve.

#### Returns

`Promise`\<[`DatasetDBType`](/sdk-api/typescript/reference/types/type-aliases/DatasetDBType)>

A promise that resolves to the dataset.

***

### getDatasetContent()

```ts theme={null}
getDatasetContent(datasetId: string): Promise<DatasetRow[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets the content of a dataset.

#### Parameters

##### datasetId

`string`

The ID of the dataset.

#### Returns

`Promise`\<[`DatasetRow`](/sdk-api/typescript/reference/README/type-aliases/DatasetRow)\[]>

A promise that resolves to the rows of the dataset.

***

### getDatasetEtag()

```ts theme={null}
getDatasetEtag(id: string): Promise<string>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets the ETag for a dataset used for optimistic concurrency control.

#### Parameters

##### id

`string`

The ID of the dataset.

#### Returns

`Promise`\<`string`>

A promise that resolves to the dataset ETag.

***

### getDatasets()

```ts theme={null}
getDatasets(limit?: number): Promise<DatasetDBType[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets all datasets visible to the client.

#### Parameters

##### limit?

`number`

#### Returns

`Promise`\<[`DatasetDBType`](/sdk-api/typescript/reference/types/type-aliases/DatasetDBType)\[]>

A promise that resolves to the list of datasets.

***

### getDatasetVersionContent()

```ts theme={null}
getDatasetVersionContent(datasetId: string, versionIndex: number): Promise<DatasetContent>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets the content for a specific version of a dataset.

#### Parameters

##### datasetId

`string`

The ID of the dataset.

##### versionIndex

`number`

The index of the version to retrieve.

#### Returns

`Promise`\<[`DatasetContent`](/sdk-api/typescript/reference/README/type-aliases/DatasetContent)>

A promise that resolves to the dataset content for the specified version.

***

### getDatasetVersionHistory()

```ts theme={null}
getDatasetVersionHistory(datasetId: string): Promise<DatasetVersionHistory>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets the version history for a dataset.

#### Parameters

##### datasetId

`string`

The ID of the dataset.

#### Returns

`Promise`\<[`DatasetVersionHistory`](/sdk-api/typescript/reference/types/type-aliases/DatasetVersionHistory)>

A promise that resolves to the version history.

***

### getExperiment()

```ts theme={null}
getExperiment(id: string): Promise<{
  aggregate_feedback?: {
   [key: string]: object;
  };
  aggregate_metrics?: {
   [key: string]: unknown;
  };
  created_at?: string;
  created_by?: null | string;
  created_by_user?:   | null
     | {
     email: string;
     first_name?: null | string;
     id: string;
     last_name?: null | string;
   };
  dataset?:   | null
     | {
     dataset_id?: null | string;
     name?: null | string;
     version_index?: null | number;
   };
  id: string;
  name?: string;
  num_samples?: null | number;
  playground?:   | null
     | {
     name?: null | string;
     playground_id?: null | string;
   };
  playground_id?: null | string;
  project_id: string;
  prompt?:   | null
     | {
     content?: null | string;
     name?: null | string;
     prompt_template_id?: null | string;
     version_index?: null | number;
   };
  prompt_model?: null | string;
  prompt_run_settings?:   | null
     | {
     deployment_name?: null | string;
     echo?: boolean;
     frequency_penalty?: number;
     known_models?: object[];
     logprobs?: boolean;
     max_tokens?: number;
     model_alias?: string;
     n?: number;
     presence_penalty?: number;
     reasoning_effort?: string;
     response_format?:   | null
        | {
      [key: string]: string;
      };
     stop_sequences?: null | string[];
     temperature?: number;
     tool_choice?:   | null
        | string
        | {
        function: {
           name: string;
        };
        type?: string;
      };
     tools?: null | object[];
     top_k?: number;
     top_logprobs?: number;
     top_p?: number;
     verbosity?: string;
   };
  rank?: null | number;
  ranking_score?: null | number;
  status?: {
     log_generation?: {
        progress_percent?: number;
     };
  };
  tags?: {
   [key: string]: object[];
  };
  task_type: 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18;
  updated_at?: null | string;
  winner?: null | boolean;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### id

`string`

#### Returns

`Promise`\<\{
`aggregate_feedback?`: \{
\[`key`: `string`]: `object`;
};
`aggregate_metrics?`: \{
\[`key`: `string`]: `unknown`;
};
`created_at?`: `string`;
`created_by?`: `null` | `string`;
`created_by_user?`: | `null`
\| \{
`email`: `string`;
`first_name?`: `null` | `string`;
`id`: `string`;
`last_name?`: `null` | `string`;
};
`dataset?`: | `null`
\| \{
`dataset_id?`: `null` | `string`;
`name?`: `null` | `string`;
`version_index?`: `null` | `number`;
};
`id`: `string`;
`name?`: `string`;
`num_samples?`: `null` | `number`;
`playground?`: | `null`
\| \{
`name?`: `null` | `string`;
`playground_id?`: `null` | `string`;
};
`playground_id?`: `null` | `string`;
`project_id`: `string`;
`prompt?`: | `null`
\| \{
`content?`: `null` | `string`;
`name?`: `null` | `string`;
`prompt_template_id?`: `null` | `string`;
`version_index?`: `null` | `number`;
};
`prompt_model?`: `null` | `string`;
`prompt_run_settings?`: | `null`
\| \{
`deployment_name?`: `null` | `string`;
`echo?`: `boolean`;
`frequency_penalty?`: `number`;
`known_models?`: `object`\[];
`logprobs?`: `boolean`;
`max_tokens?`: `number`;
`model_alias?`: `string`;
`n?`: `number`;
`presence_penalty?`: `number`;
`reasoning_effort?`: `string`;
`response_format?`: | `null`
\| \{
\[`key`: `string`]: `string`;
};
`stop_sequences?`: `null` | `string`\[];
`temperature?`: `number`;
`tool_choice?`: | `null`
\| `string`
\| \{
`function`: \{
`name`: `string`;
};
`type?`: `string`;
};
`tools?`: `null` | `object`\[];
`top_k?`: `number`;
`top_logprobs?`: `number`;
`top_p?`: `number`;
`verbosity?`: `string`;
};
`rank?`: `null` | `number`;
`ranking_score?`: `null` | `number`;
`status?`: \{
`log_generation?`: \{
`progress_percent?`: `number`;
};
};
`tags?`: \{
\[`key`: `string`]: `object`\[];
};
`task_type`: `0` | `1` | `2` | `3` | `4` | `5` | `6` | `7` | `8` | `9` | `10` | `11` | `12` | `13` | `14` | `15` | `16` | `17` | `18`;
`updated_at?`: `null` | `string`;
`winner?`: `null` | `boolean`;
}>

***

### getExperiments()

```ts theme={null}
getExperiments(): Promise<object[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Returns

`Promise`\<`object`\[]>

***

### getExtendDatasetStatus()

```ts theme={null}
getExtendDatasetStatus(datasetId: string): Promise<JobProgress>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets the status of a dataset extension job.

#### Parameters

##### datasetId

`string`

The ID of the dataset being extended.

#### Returns

`Promise`\<[`JobProgress`](/sdk-api/typescript/reference/README/type-aliases/JobProgress)>

A promise that resolves to the job progress.

***

### getGlobalProjectByName()

```ts theme={null}
getGlobalProjectByName(name: string, projectType?:
  | "prompt_evaluation"
  | "llm_monitor"
  | "gen_ai"
  | "training_inference"
  | "protect"): Promise<{
  bookmark?: boolean;
  createdAt: string;
  createdBy: string;
  createdByUser: {
     email: string;
     firstName?: null | string;
     id: string;
     lastName?: null | string;
  };
  description?: null | string;
  id: string;
  labels?: "sample"[];
  name?: null | string;
  permissions?: object[];
  runs: object[];
  type?:   | null
     | "prompt_evaluation"
     | "llm_monitor"
     | "gen_ai"
     | "training_inference"
     | "protect";
  updatedAt: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets a project by name.

#### Parameters

##### name

`string`

Name of the project to fetch.

##### projectType?

`"prompt_evaluation"` | `"llm_monitor"` | `"gen_ai"` | `"training_inference"` | `"protect"`

#### Returns

`Promise`\<\{
`bookmark?`: `boolean`;
`createdAt`: `string`;
`createdBy`: `string`;
`createdByUser`: \{
`email`: `string`;
`firstName?`: `null` | `string`;
`id`: `string`;
`lastName?`: `null` | `string`;
};
`description?`: `null` | `string`;
`id`: `string`;
`labels?`: `"sample"`\[];
`name?`: `null` | `string`;
`permissions?`: `object`\[];
`runs`: `object`\[];
`type?`: | `null`
\| `"prompt_evaluation"`
\| `"llm_monitor"`
\| `"gen_ai"`
\| `"training_inference"`
\| `"protect"`;
`updatedAt`: `string`;
}>

A promise that resolves to the matching project.

***

### getGlobalPromptTemplate()

```ts theme={null}
getGlobalPromptTemplate(id: string): Promise<PromptTemplate>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieves a global prompt template by ID.

#### Parameters

##### id

`string`

Template identifier to fetch.

#### Returns

`Promise`\<[`PromptTemplate`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplate)>

A promise that resolves to the prompt template payload.

***

### getGlobalPromptTemplateVersion()

```ts theme={null}
getGlobalPromptTemplateVersion(id: string, version: number): Promise<PromptTemplateVersion>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieves a global prompt template version by ID.

#### Parameters

##### id

`string`

Template identifier to fetch.

##### version

`number`

Version number to retrieve.

#### Returns

`Promise`\<[`PromptTemplateVersion`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplateVersion)>

A promise that resolves to the template version payload.

***

### getJob()

```ts theme={null}
getJob(jobId: string): Promise<{
  completed_at?: null | string;
  created_at: string;
  error_message?: null | string;
  failed_at?: null | string;
  id: string;
  job_name: string;
  migration_name?: null | string;
  monitor_batch_id?: null | string;
  processing_started?: null | string;
  progress_message?: null | string;
  progress_percent?: number;
  project_id: string;
  request_data: {
   [key: string]: unknown;
  };
  retries: number;
  run_id: string;
  status: string;
  steps_completed?: number;
  steps_total?: number;
  updated_at: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### jobId

`string`

#### Returns

`Promise`\<\{
`completed_at?`: `null` | `string`;
`created_at`: `string`;
`error_message?`: `null` | `string`;
`failed_at?`: `null` | `string`;
`id`: `string`;
`job_name`: `string`;
`migration_name?`: `null` | `string`;
`monitor_batch_id?`: `null` | `string`;
`processing_started?`: `null` | `string`;
`progress_message?`: `null` | `string`;
`progress_percent?`: `number`;
`project_id`: `string`;
`request_data`: \{
\[`key`: `string`]: `unknown`;
};
`retries`: `number`;
`run_id`: `string`;
`status`: `string`;
`steps_completed?`: `number`;
`steps_total?`: `number`;
`updated_at`: `string`;
}>

***

### getJobsForProjectRun()

```ts theme={null}
getJobsForProjectRun(projectId: string, runId: string): Promise<object[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### projectId

`string`

##### runId

`string`

#### Returns

`Promise`\<`object`\[]>

***

### getLogStream()

```ts theme={null}
getLogStream(id: string): Promise<{
  created_at: string;
  created_by?: null | string;
  has_user_created_sessions?: boolean;
  id: string;
  name: string;
  project_id: string;
  updated_at: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### id

`string`

#### Returns

`Promise`\<\{
`created_at`: `string`;
`created_by?`: `null` | `string`;
`has_user_created_sessions?`: `boolean`;
`id`: `string`;
`name`: `string`;
`project_id`: `string`;
`updated_at`: `string`;
}>

***

### getLogStreamByName()

```ts theme={null}
getLogStreamByName(name: string): Promise<{
  created_at: string;
  created_by?: null | string;
  has_user_created_sessions?: boolean;
  id: string;
  name: string;
  project_id: string;
  updated_at: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### name

`string`

#### Returns

`Promise`\<\{
`created_at`: `string`;
`created_by?`: `null` | `string`;
`has_user_created_sessions?`: `boolean`;
`id`: `string`;
`name`: `string`;
`project_id`: `string`;
`updated_at`: `string`;
}>

***

### getLogStreams()

```ts theme={null}
getLogStreams(): Promise<object[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Returns

`Promise`\<`object`\[]>

***

### getProject()

```ts theme={null}
getProject(id: string): Promise<{
  bookmark?: boolean;
  createdAt: string;
  createdBy: string;
  createdByUser: {
     email: string;
     firstName?: null | string;
     id: string;
     lastName?: null | string;
  };
  description?: null | string;
  id: string;
  labels?: "sample"[];
  name?: null | string;
  permissions?: object[];
  runs: object[];
  type?:   | null
     | "prompt_evaluation"
     | "llm_monitor"
     | "gen_ai"
     | "training_inference"
     | "protect";
  updatedAt: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets a project by ID.

#### Parameters

##### id

`string`

ID of the project to fetch.

#### Returns

`Promise`\<\{
`bookmark?`: `boolean`;
`createdAt`: `string`;
`createdBy`: `string`;
`createdByUser`: \{
`email`: `string`;
`firstName?`: `null` | `string`;
`id`: `string`;
`lastName?`: `null` | `string`;
};
`description?`: `null` | `string`;
`id`: `string`;
`labels?`: `"sample"`\[];
`name?`: `null` | `string`;
`permissions?`: `object`\[];
`runs`: `object`\[];
`type?`: | `null`
\| `"prompt_evaluation"`
\| `"llm_monitor"`
\| `"gen_ai"`
\| `"training_inference"`
\| `"protect"`;
`updatedAt`: `string`;
}>

A promise that resolves to the matching project.

***

### getProjectByName()

```ts theme={null}
getProjectByName(name: string, options?: object): Promise<{
  bookmark?: boolean;
  createdAt: string;
  createdBy: string;
  createdByUser: {
     email: string;
     firstName?: null | string;
     id: string;
     lastName?: null | string;
  };
  description?: null | string;
  id: string;
  labels?: "sample"[];
  name?: null | string;
  permissions?: object[];
  runs: object[];
  type?:   | null
     | "prompt_evaluation"
     | "llm_monitor"
     | "gen_ai"
     | "training_inference"
     | "protect";
  updatedAt: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets a project by name.

#### Parameters

##### name

`string`

Name of the project to fetch.

##### options?

(Optional) Additional lookup options.

###### projectType?

\| `null`
\| `"prompt_evaluation"`
\| `"llm_monitor"`
\| `"gen_ai"`
\| `"training_inference"`
\| `"protect"`

(Optional) Project type hint to disambiguate by name.

#### Returns

`Promise`\<\{
`bookmark?`: `boolean`;
`createdAt`: `string`;
`createdBy`: `string`;
`createdByUser`: \{
`email`: `string`;
`firstName?`: `null` | `string`;
`id`: `string`;
`lastName?`: `null` | `string`;
};
`description?`: `null` | `string`;
`id`: `string`;
`labels?`: `"sample"`\[];
`name?`: `null` | `string`;
`permissions?`: `object`\[];
`runs`: `object`\[];
`type?`: | `null`
\| `"prompt_evaluation"`
\| `"llm_monitor"`
\| `"gen_ai"`
\| `"training_inference"`
\| `"protect"`;
`updatedAt`: `string`;
}>

A promise that resolves to the matching project.

***

### getProjectIdByName()

```ts theme={null}
getProjectIdByName(name: string, projectType?:
  | "prompt_evaluation"
  | "llm_monitor"
  | "gen_ai"
  | "training_inference"
| "protect"): Promise<string>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Gets a project ID by name.

#### Parameters

##### name

`string`

Name of the project to resolve.

##### projectType?

`"prompt_evaluation"` | `"llm_monitor"` | `"gen_ai"` | `"training_inference"` | `"protect"`

#### Returns

`Promise`\<`string`>

A promise that resolves to the project ID.

***

### getProjects()

```ts theme={null}
getProjects(projectType?:
  | "prompt_evaluation"
  | "llm_monitor"
  | "gen_ai"
  | "training_inference"
| "protect"): Promise<object[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists projects available to the authenticated user.

#### Parameters

##### projectType?

(Optional) Project type filter for the request.

`"prompt_evaluation"` | `"llm_monitor"` | `"gen_ai"` | `"training_inference"` | `"protect"`

#### Returns

`Promise`\<`object`\[]>

A promise that resolves to the accessible projects.

***

### getPromptTemplate()

```ts theme={null}
getPromptTemplate(id: string): Promise<PromptTemplate>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieves a prompt template by ID from the initialized project.

This method retrieves project-scoped templates only. For global templates
(which can also be filtered by project), use `getGlobalPromptTemplate(id)` instead.

#### Parameters

##### id

`string`

The unique identifier of the template to fetch. Must be
a template ID that exists within the initialized project.

#### Returns

`Promise`\<[`PromptTemplate`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplate)>

A promise that resolves to the prompt template payload containing
template metadata, versions, and associated information.

#### Throws

Error if the template is not found in the project, if the client
is not initialized with a project, or if the service is unavailable.

***

### getPromptTemplates()

```ts theme={null}
getPromptTemplates(): Promise<PromptTemplate[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists prompt templates scoped to the initialized project.

These methods operate on project-scoped templates, which are templates
that exist only within a specific project and are not shared across projects.
The client must be initialized with a project (via `init({ projectName })`
or `init({ projectId })`) before using these methods.

**Note:** For global templates (which can be shared across projects but
can also be filtered by project), use the `getGlobalPromptTemplate*` methods
instead. The global methods (`listGlobalPromptTemplates`, `getGlobalPromptTemplate`,
etc.) support optional `projectId` and `projectName` parameters to filter
results.

#### Returns

`Promise`\<[`PromptTemplate`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplate)\[]>

A promise that resolves to an array of prompt templates
associated with the initialized project.

#### Throws

Error if the client is not initialized with a project or if
the prompt template service is not available.

***

### getPromptTemplateVersion()

```ts theme={null}
getPromptTemplateVersion(id: string, version: number): Promise<PromptTemplateVersion>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieves a specific prompt template version by ID and version number.

Templates can have multiple versions. This method fetches a specific
version of a project-scoped template within the initialized project.
For global templates (which can also be filtered by project), use
`getGlobalPromptTemplateVersion(id, version)` instead.

#### Parameters

##### id

`string`

The unique identifier of the template.

##### version

`number`

The version number to retrieve. Version numbers are
typically sequential integers starting from 1.

#### Returns

`Promise`\<[`PromptTemplateVersion`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplateVersion)>

A promise that resolves to the prompt template version payload,
including the template content, settings, and version metadata.

#### Throws

Error if the template or version is not found in the project,
if the client is not initialized with a project, or if the service
is unavailable.

***

### getPromptTemplateVersionByName()

```ts theme={null}
getPromptTemplateVersionByName(name: string, version?: number): Promise<PromptTemplateVersion>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Resolves a prompt template by name and fetches the requested version.

This method first searches for a project-scoped template by name within
the initialized project, then retrieves the specified version. If no version
is provided, it returns the currently selected version of the template.

For global templates (which can be filtered by project using `projectId`
or `projectName` in the options), use `listGlobalPromptTemplates()` with
name filtering and project filtering, then `getGlobalPromptTemplateVersion()`.

#### Parameters

##### name

`string`

The name of the template to search for. The search is
performed within the scope of the initialized project.

##### version?

`number`

(Optional) The version number to fetch. If not provided,
defaults to the template's selected version (typically the latest).

#### Returns

`Promise`\<[`PromptTemplateVersion`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplateVersion)>

A promise that resolves to the prompt template version payload.

#### Throws

Error if no template with the given name is found in the project,
if the specified version doesn't exist, if the client is not initialized
with a project, or if the service is unavailable.

***

### getRunScorerJobs()

```ts theme={null}
getRunScorerJobs(projectId: string, runId: string): Promise<object[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### projectId

`string`

##### runId

`string`

#### Returns

`Promise`\<`object`\[]>

***

### getScorers()

```ts theme={null}
getScorers(options?: object): Promise<ScorerResponse[]>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists scorers with optional filtering (backward compatible, use
getScorersPage for pagination and limit).

#### Parameters

##### options?

(Optional) The filtering options.

###### names?

`string`\[]

(Optional) Filter by multiple scorer names.

###### type?

[`ScorerTypes`](/sdk-api/typescript/reference/types/enumerations/ScorerTypes)

(Optional) Filter by a single scorer type.

#### Returns

`Promise`\<[`ScorerResponse`](/sdk-api/typescript/reference/types/type-aliases/ScorerResponse)\[]>

A promise that resolves to an array of scorers.

***

### getScorersPage()

```ts theme={null}
getScorersPage(options?: object): Promise<ListScorersResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists scorers with pagination support.

#### Parameters

##### options?

(Optional) The filtering and pagination options.

###### limit?

`number`

(Optional) The maximum number of scorers to return.

###### name?

`string`

(Optional) Filter by a single scorer name.

###### names?

`string`\[]

(Optional) Filter by multiple scorer names.

###### startingToken?

`number`

(Optional) The starting token for pagination.

###### types?

[`ScorerTypes`](/sdk-api/typescript/reference/types/enumerations/ScorerTypes)\[]

(Optional) Filter by scorer types.

#### Returns

`Promise`\<[`ListScorersResponse`](/sdk-api/typescript/reference/types/type-aliases/ListScorersResponse)>

A promise that resolves to an object containing scorers and the next starting token.

***

### getScorerVersion()

```ts theme={null}
getScorerVersion(scorerId: string, version: number): Promise<BaseScorerVersionResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieves a specific version of a scorer.

#### Parameters

##### scorerId

`string`

The unique identifier of the scorer.

##### version

`number`

The version number to retrieve.

#### Returns

`Promise`\<[`BaseScorerVersionResponse`](/sdk-api/typescript/reference/types/type-aliases/BaseScorerVersionResponse)>

A promise that resolves to the scorer version.

***

### getSession()

```ts theme={null}
getSession(sessionId: string): Promise<{
  createdAt?: string;
  datasetInput?: null | string;
  datasetMetadata?: {
   [key: Uncapitalize<string>]: string;
  };
  datasetOutput?: null | string;
  externalId?: null | string;
  hasChildren?: null | boolean;
  id: string;
  input?: string | object[];
  metricInfo?:   | null
     | {
   [key: Uncapitalize<string>]:
     | {
     message?: string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "not_computed";
   }
     | {
     scorerType?: null | "Luna" | "Plus";
     statusType: "pending";
   }
     | {
     message?: string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "computing";
   }
     | {
     message?: string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "not_applicable";
   }
     | {
     cost?: null | number;
     critique?:   | null
        | {
        critiqueInfo: {
           critique: string;
           intendedValue: boolean;
           originalExplanation: string;
        };
        id: string;
        isComputed: boolean;
        revisedExplanation: null | string;
      };
     displayValue?: null | string;
     explanation?: null | string;
     modelAlias?: null | string;
     numJudges?: null | number;
     rationale?: null | string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "success";
     value:   | null
        | string
        | number
        | boolean
        | {
        metadata?: {
         [key: string]: ... | ... | ... | ...;
        };
        page_content: string;
      }
        | {
        aggregate:   | {
           dislike_count: number;
           feedback_type: "like_dislike";
           like_count: number;
           unrated_count: number;
         }
           | {
           average: number;
           counts: {
            [key: ...]: ...;
           };
           feedback_type: "star";
           unrated_count: number;
         }
           | {
           average: number;
           feedback_type: "score";
           unrated_count: number;
         }
           | {
           counts: {
            [key: ...]: ...;
           };
           feedback_type: "tags";
           unrated_count: number;
         };
      }
        | {
        created_at: string;
        created_by: null | string;
        explanation?: null | string;
        rating:   | {
           feedback_type: "like_dislike";
           value: boolean;
         }
           | {
           feedback_type: "star";
           value: number;
         }
           | {
           feedback_type: "score";
           value: number;
         }
           | {
           feedback_type: "tags";
           value: ...[];
         }
           | {
           feedback_type: "text";
           value: string;
         };
      }
        | {
        end: number;
        hallucination: number;
        hallucination_severity?: number;
        start: number;
      }
        | {
        end: number;
        prob?: null | number;
        start: number;
        value: string | number;
      }
        | (
        | null
        | string
        | number
        | boolean
        | {
        metadata?: ... | ...;
        page_content: string;
      }
        | {
        aggregate: ... | ... | ... | ...;
      }
        | {
        created_at: string;
        created_by: ... | ...;
        explanation?: ... | ... | ...;
        rating: ... | ... | ... | ... | ...;
      }
        | {
        end: number;
        hallucination: number;
        hallucination_severity?: ... | ...;
        start: number;
      }
        | {
        end: number;
        prob?: ... | ... | ...;
        start: number;
        value: ... | ...;
      })[]
        | (
        | null
        | string
        | number
        | boolean
        | {
        metadata?: ...;
        page_content: ...;
      }
        | {
        aggregate: ...;
      }
        | {
        created_at: ...;
        created_by: ...;
        explanation?: ...;
        rating: ...;
      }
        | {
        end: ...;
        hallucination: ...;
        hallucination_severity?: ...;
        start: ...;
      }
        | {
        end: ...;
        prob?: ...;
        start: ...;
        value: ...;
      })[][]
        | (... | ... | ... | ... | ... | ... | ... | ... | ... | ...)[][][];
   }
     | {
     message?: null | string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "error";
   }
     | {
     message?: null | string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "failed";
   };
   };
  metrics?: {
   [key: Uncapitalize<string>]: unknown;
     durationNs?: null | number;
  };
  metricsBatchId?: null | string;
  name?: string;
  output?:   | null
     | string
     | {
     content: string;
     role:   | "function"
        | "agent"
        | "tool"
        | "user"
        | "assistant"
        | "developer"
        | "system";
     tool_call_id?: null | string;
     tool_calls?: null | object[];
   }
     | object[];
  previousSessionId?: null | string;
  projectId: string;
  redactedInput?: null | string | object[];
  redactedOutput?:   | null
     | string
     | {
     content: string;
     role:   | "function"
        | "agent"
        | "tool"
        | "user"
        | "assistant"
        | "developer"
        | "system";
     tool_call_id?: null | string;
     tool_calls?: null | object[];
   }
     | object[];
  runId: string;
  sessionBatchId?: null | string;
  sessionId?: null | string;
  statusCode?: null | number;
  tags?: string[];
  traceId?: null | string;
  traces?: object[];
  type?: "session";
  updatedAt?: null | string;
  userMetadata?: {
   [key: Uncapitalize<string>]: string;
  };
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieve a session by its ID, including all child traces and spans.

#### Parameters

##### sessionId

`string`

The unique identifier of the session to retrieve

#### Returns

`Promise`\<\{
`createdAt?`: `string`;
`datasetInput?`: `null` | `string`;
`datasetMetadata?`: \{
\[`key`: `Uncapitalize`\<`string`>]: `string`;
};
`datasetOutput?`: `null` | `string`;
`externalId?`: `null` | `string`;
`hasChildren?`: `null` | `boolean`;
`id`: `string`;
`input?`: `string` | `object`\[];
`metricInfo?`: | `null`
\| \{
\[`key`: `Uncapitalize`\<`string`>]:
\| \{
`message?`: `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"not_computed"`;
}
\| \{
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"pending"`;
}
\| \{
`message?`: `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"computing"`;
}
\| \{
`message?`: `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"not_applicable"`;
}
\| \{
`cost?`: `null` | `number`;
`critique?`: | `null`
\| \{
`critiqueInfo`: \{
`critique`: `string`;
`intendedValue`: `boolean`;
`originalExplanation`: `string`;
};
`id`: `string`;
`isComputed`: `boolean`;
`revisedExplanation`: `null` | `string`;
};
`displayValue?`: `null` | `string`;
`explanation?`: `null` | `string`;
`modelAlias?`: `null` | `string`;
`numJudges?`: `null` | `number`;
`rationale?`: `null` | `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"success"`;
`value`: | `null`
\| `string`
\| `number`
\| `boolean`
\| \{
`metadata?`: \{
\[`key`: `string`]: ... | ... | ... | ...;
};
`page_content`: `string`;
}
\| \{
`aggregate`: | \{
`dislike_count`: `number`;
`feedback_type`: `"like_dislike"`;
`like_count`: `number`;
`unrated_count`: `number`;
}
\| \{
`average`: `number`;
`counts`: \{
\[`key`: ...]: ...;
};
`feedback_type`: `"star"`;
`unrated_count`: `number`;
}
\| \{
`average`: `number`;
`feedback_type`: `"score"`;
`unrated_count`: `number`;
}
\| \{
`counts`: \{
\[`key`: ...]: ...;
};
`feedback_type`: `"tags"`;
`unrated_count`: `number`;
};
}
\| \{
`created_at`: `string`;
`created_by`: `null` | `string`;
`explanation?`: `null` | `string`;
`rating`: | \{
`feedback_type`: `"like_dislike"`;
`value`: `boolean`;
}
\| \{
`feedback_type`: `"star"`;
`value`: `number`;
}
\| \{
`feedback_type`: `"score"`;
`value`: `number`;
}
\| \{
`feedback_type`: `"tags"`;
`value`: ...\[];
}
\| \{
`feedback_type`: `"text"`;
`value`: `string`;
};
}
\| \{
`end`: `number`;
`hallucination`: `number`;
`hallucination_severity?`: `number`;
`start`: `number`;
}
\| \{
`end`: `number`;
`prob?`: `null` | `number`;
`start`: `number`;
`value`: `string` | `number`;
}
\| (
\| `null`
\| `string`
\| `number`
\| `boolean`
\| \{
`metadata?`: ... | ...;
`page_content`: `string`;
}
\| \{
`aggregate`: ... | ... | ... | ...;
}
\| \{
`created_at`: `string`;
`created_by`: ... | ...;
`explanation?`: ... | ... | ...;
`rating`: ... | ... | ... | ... | ...;
}
\| \{
`end`: `number`;
`hallucination`: `number`;
`hallucination_severity?`: ... | ...;
`start`: `number`;
}
\| \{
`end`: `number`;
`prob?`: ... | ... | ...;
`start`: `number`;
`value`: ... | ...;
})\[]
\| (
\| `null`
\| `string`
\| `number`
\| `boolean`
\| \{
`metadata?`: ...;
`page_content`: ...;
}
\| \{
`aggregate`: ...;
}
\| \{
`created_at`: ...;
`created_by`: ...;
`explanation?`: ...;
`rating`: ...;
}
\| \{
`end`: ...;
`hallucination`: ...;
`hallucination_severity?`: ...;
`start`: ...;
}
\| \{
`end`: ...;
`prob?`: ...;
`start`: ...;
`value`: ...;
})\[]\[]
\| (... | ... | ... | ... | ... | ... | ... | ... | ... | ...)\[]\[]\[];
}
\| \{
`message?`: `null` | `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"error"`;
}
\| \{
`message?`: `null` | `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"failed"`;
};
};
`metrics?`: \{
\[`key`: `Uncapitalize`\<`string`>]: `unknown`;
`durationNs?`: `null` | `number`;
};
`metricsBatchId?`: `null` | `string`;
`name?`: `string`;
`output?`: | `null`
\| `string`
\| \{
`content`: `string`;
`role`: | `"function"`
\| `"agent"`
\| `"tool"`
\| `"user"`
\| `"assistant"`
\| `"developer"`
\| `"system"`;
`tool_call_id?`: `null` | `string`;
`tool_calls?`: `null` | `object`\[];
}
\| `object`\[];
`previousSessionId?`: `null` | `string`;
`projectId`: `string`;
`redactedInput?`: `null` | `string` | `object`\[];
`redactedOutput?`: | `null`
\| `string`
\| \{
`content`: `string`;
`role`: | `"function"`
\| `"agent"`
\| `"tool"`
\| `"user"`
\| `"assistant"`
\| `"developer"`
\| `"system"`;
`tool_call_id?`: `null` | `string`;
`tool_calls?`: `null` | `object`\[];
}
\| `object`\[];
`runId`: `string`;
`sessionBatchId?`: `null` | `string`;
`sessionId?`: `null` | `string`;
`statusCode?`: `null` | `number`;
`tags?`: `string`\[];
`traceId?`: `null` | `string`;
`traces?`: `object`\[];
`type?`: `"session"`;
`updatedAt?`: `null` | `string`;
`userMetadata?`: \{
\[`key`: `Uncapitalize`\<`string`>]: `string`;
};
}>

Promise resolving to the session record with its children

***

### getSessionsAvailableColumns()

```ts theme={null}
getSessionsAvailableColumns(options: object): Promise<{
  columns?: object[];
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Get the list of available columns for sessions that can be used in queries and filters.

#### Parameters

##### options

Request object

###### endTime?

`null` | `string`

(Optional) End time for filtering columns

###### experimentId?

`null` | `string`

(Optional) Experiment ID to get columns for

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to get columns for

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

###### startTime?

`null` | `string`

(Optional) Start time for filtering columns

#### Returns

`Promise`\<\{
`columns?`: `object`\[];
}>

Promise resolving to a response containing the available columns

***

### getSpan()

```ts theme={null}
getSpan(spanId: string): Promise<ExtendedSpanRecord>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieve a span by its ID.

#### Parameters

##### spanId

`string`

The unique identifier of the span to retrieve

#### Returns

`Promise`\<[`ExtendedSpanRecord`](/sdk-api/typescript/reference/types/type-aliases/ExtendedSpanRecord)>

Promise resolving to the span record

***

### getSpansAvailableColumns()

```ts theme={null}
getSpansAvailableColumns(options: object): Promise<{
  columns?: object[];
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Get the list of available columns for spans that can be used in queries and filters.

#### Parameters

##### options

Request object

###### endTime?

`null` | `string`

(Optional) End time for filtering columns

###### experimentId?

`null` | `string`

(Optional) Experiment ID to get columns for

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to get columns for

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

###### startTime?

`null` | `string`

(Optional) Start time for filtering columns

#### Returns

`Promise`\<\{
`columns?`: `object`\[];
}>

Promise resolving to a response containing the available columns

***

### getTrace()

```ts theme={null}
getTrace(traceId: string): Promise<{
  createdAt?: string;
  datasetInput?: null | string;
  datasetMetadata?: {
   [key: Uncapitalize<string>]: string;
  };
  datasetOutput?: null | string;
  externalId?: null | string;
  feedbackRatingInfo?: {
   [key: Uncapitalize<string>]: object;
  };
  hasChildren?: null | boolean;
  id: string;
  input?: string;
  isComplete?: boolean;
  metricInfo?:   | null
     | {
   [key: Uncapitalize<string>]:
     | {
     message?: string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "not_computed";
   }
     | {
     scorerType?: null | "Luna" | "Plus";
     statusType: "pending";
   }
     | {
     message?: string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "computing";
   }
     | {
     message?: string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "not_applicable";
   }
     | {
     cost?: null | number;
     critique?:   | null
        | {
        critiqueInfo: {
           critique: string;
           intendedValue: boolean;
           originalExplanation: string;
        };
        id: string;
        isComputed: boolean;
        revisedExplanation: null | string;
      };
     displayValue?: null | string;
     explanation?: null | string;
     modelAlias?: null | string;
     numJudges?: null | number;
     rationale?: null | string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "success";
     value:   | null
        | string
        | number
        | boolean
        | {
        metadata?: {
         [key: string]: ... | ... | ... | ...;
        };
        page_content: string;
      }
        | {
        aggregate:   | {
           dislike_count: number;
           feedback_type: "like_dislike";
           like_count: number;
           unrated_count: number;
         }
           | {
           average: number;
           counts: {
            [key: ...]: ...;
           };
           feedback_type: "star";
           unrated_count: number;
         }
           | {
           average: number;
           feedback_type: "score";
           unrated_count: number;
         }
           | {
           counts: {
            [key: ...]: ...;
           };
           feedback_type: "tags";
           unrated_count: number;
         };
      }
        | {
        created_at: string;
        created_by: null | string;
        explanation?: null | string;
        rating:   | {
           feedback_type: "like_dislike";
           value: boolean;
         }
           | {
           feedback_type: "star";
           value: number;
         }
           | {
           feedback_type: "score";
           value: number;
         }
           | {
           feedback_type: "tags";
           value: ...[];
         }
           | {
           feedback_type: "text";
           value: string;
         };
      }
        | {
        end: number;
        hallucination: number;
        hallucination_severity?: number;
        start: number;
      }
        | {
        end: number;
        prob?: null | number;
        start: number;
        value: string | number;
      }
        | (
        | null
        | string
        | number
        | boolean
        | {
        metadata?: ... | ...;
        page_content: string;
      }
        | {
        aggregate: ... | ... | ... | ...;
      }
        | {
        created_at: string;
        created_by: ... | ...;
        explanation?: ... | ... | ...;
        rating: ... | ... | ... | ... | ...;
      }
        | {
        end: number;
        hallucination: number;
        hallucination_severity?: ... | ...;
        start: number;
      }
        | {
        end: number;
        prob?: ... | ... | ...;
        start: number;
        value: ... | ...;
      })[]
        | (
        | null
        | string
        | number
        | boolean
        | {
        metadata?: ...;
        page_content: ...;
      }
        | {
        aggregate: ...;
      }
        | {
        created_at: ...;
        created_by: ...;
        explanation?: ...;
        rating: ...;
      }
        | {
        end: ...;
        hallucination: ...;
        hallucination_severity?: ...;
        start: ...;
      }
        | {
        end: ...;
        prob?: ...;
        start: ...;
        value: ...;
      })[][]
        | (... | ... | ... | ... | ... | ... | ... | ... | ... | ...)[][][];
   }
     | {
     message?: null | string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "error";
   }
     | {
     message?: null | string;
     scorerType?: null | "Luna" | "Plus";
     statusType: "failed";
   };
   };
  metrics?: {
   [key: Uncapitalize<string>]: unknown;
     durationNs?: null | number;
  };
  metricsBatchId?: null | string;
  name?: string;
  output?: null | string;
  projectId: string;
  redactedInput?: null | string;
  redactedOutput?: null | string;
  runId: string;
  sessionBatchId?: null | string;
  sessionId: string;
  spans?: object[] | object[] | object[] | object[] | object[];
  statusCode?: null | number;
  tags?: string[];
  traceId: string;
  type?: "trace";
  updatedAt?: null | string;
  userMetadata?: {
   [key: Uncapitalize<string>]: string;
  };
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Retrieve a trace by its ID, including all child spans.

#### Parameters

##### traceId

`string`

The unique identifier of the trace to retrieve

#### Returns

`Promise`\<\{
`createdAt?`: `string`;
`datasetInput?`: `null` | `string`;
`datasetMetadata?`: \{
\[`key`: `Uncapitalize`\<`string`>]: `string`;
};
`datasetOutput?`: `null` | `string`;
`externalId?`: `null` | `string`;
`feedbackRatingInfo?`: \{
\[`key`: `Uncapitalize`\<`string`>]: `object`;
};
`hasChildren?`: `null` | `boolean`;
`id`: `string`;
`input?`: `string`;
`isComplete?`: `boolean`;
`metricInfo?`: | `null`
\| \{
\[`key`: `Uncapitalize`\<`string`>]:
\| \{
`message?`: `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"not_computed"`;
}
\| \{
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"pending"`;
}
\| \{
`message?`: `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"computing"`;
}
\| \{
`message?`: `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"not_applicable"`;
}
\| \{
`cost?`: `null` | `number`;
`critique?`: | `null`
\| \{
`critiqueInfo`: \{
`critique`: `string`;
`intendedValue`: `boolean`;
`originalExplanation`: `string`;
};
`id`: `string`;
`isComputed`: `boolean`;
`revisedExplanation`: `null` | `string`;
};
`displayValue?`: `null` | `string`;
`explanation?`: `null` | `string`;
`modelAlias?`: `null` | `string`;
`numJudges?`: `null` | `number`;
`rationale?`: `null` | `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"success"`;
`value`: | `null`
\| `string`
\| `number`
\| `boolean`
\| \{
`metadata?`: \{
\[`key`: `string`]: ... | ... | ... | ...;
};
`page_content`: `string`;
}
\| \{
`aggregate`: | \{
`dislike_count`: `number`;
`feedback_type`: `"like_dislike"`;
`like_count`: `number`;
`unrated_count`: `number`;
}
\| \{
`average`: `number`;
`counts`: \{
\[`key`: ...]: ...;
};
`feedback_type`: `"star"`;
`unrated_count`: `number`;
}
\| \{
`average`: `number`;
`feedback_type`: `"score"`;
`unrated_count`: `number`;
}
\| \{
`counts`: \{
\[`key`: ...]: ...;
};
`feedback_type`: `"tags"`;
`unrated_count`: `number`;
};
}
\| \{
`created_at`: `string`;
`created_by`: `null` | `string`;
`explanation?`: `null` | `string`;
`rating`: | \{
`feedback_type`: `"like_dislike"`;
`value`: `boolean`;
}
\| \{
`feedback_type`: `"star"`;
`value`: `number`;
}
\| \{
`feedback_type`: `"score"`;
`value`: `number`;
}
\| \{
`feedback_type`: `"tags"`;
`value`: ...\[];
}
\| \{
`feedback_type`: `"text"`;
`value`: `string`;
};
}
\| \{
`end`: `number`;
`hallucination`: `number`;
`hallucination_severity?`: `number`;
`start`: `number`;
}
\| \{
`end`: `number`;
`prob?`: `null` | `number`;
`start`: `number`;
`value`: `string` | `number`;
}
\| (
\| `null`
\| `string`
\| `number`
\| `boolean`
\| \{
`metadata?`: ... | ...;
`page_content`: `string`;
}
\| \{
`aggregate`: ... | ... | ... | ...;
}
\| \{
`created_at`: `string`;
`created_by`: ... | ...;
`explanation?`: ... | ... | ...;
`rating`: ... | ... | ... | ... | ...;
}
\| \{
`end`: `number`;
`hallucination`: `number`;
`hallucination_severity?`: ... | ...;
`start`: `number`;
}
\| \{
`end`: `number`;
`prob?`: ... | ... | ...;
`start`: `number`;
`value`: ... | ...;
})\[]
\| (
\| `null`
\| `string`
\| `number`
\| `boolean`
\| \{
`metadata?`: ...;
`page_content`: ...;
}
\| \{
`aggregate`: ...;
}
\| \{
`created_at`: ...;
`created_by`: ...;
`explanation?`: ...;
`rating`: ...;
}
\| \{
`end`: ...;
`hallucination`: ...;
`hallucination_severity?`: ...;
`start`: ...;
}
\| \{
`end`: ...;
`prob?`: ...;
`start`: ...;
`value`: ...;
})\[]\[]
\| (... | ... | ... | ... | ... | ... | ... | ... | ... | ...)\[]\[]\[];
}
\| \{
`message?`: `null` | `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"error"`;
}
\| \{
`message?`: `null` | `string`;
`scorerType?`: `null` | `"Luna"` | `"Plus"`;
`statusType`: `"failed"`;
};
};
`metrics?`: \{
\[`key`: `Uncapitalize`\<`string`>]: `unknown`;
`durationNs?`: `null` | `number`;
};
`metricsBatchId?`: `null` | `string`;
`name?`: `string`;
`output?`: `null` | `string`;
`projectId`: `string`;
`redactedInput?`: `null` | `string`;
`redactedOutput?`: `null` | `string`;
`runId`: `string`;
`sessionBatchId?`: `null` | `string`;
`sessionId`: `string`;
`spans?`: `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[];
`statusCode?`: `null` | `number`;
`tags?`: `string`\[];
`traceId`: `string`;
`type?`: `"trace"`;
`updatedAt?`: `null` | `string`;
`userMetadata?`: \{
\[`key`: `Uncapitalize`\<`string`>]: `string`;
};
}>

Promise resolving to the trace record with its children

***

### getTracesAvailableColumns()

```ts theme={null}
getTracesAvailableColumns(options: object): Promise<{
  columns?: object[];
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Get the list of available columns for traces that can be used in queries and filters.

#### Parameters

##### options

Request object

###### endTime?

`null` | `string`

(Optional) End time for filtering columns

###### experimentId?

`null` | `string`

(Optional) Experiment ID to get columns for

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to get columns for

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

###### startTime?

`null` | `string`

(Optional) Start time for filtering columns

#### Returns

`Promise`\<\{
`columns?`: `object`\[];
}>

Promise resolving to a response containing the available columns

***

### healthCheck()

```ts theme={null}
protected healthCheck(): Promise<boolean>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Returns

`Promise`\<`boolean`>

#### Inherited from

```ts theme={null}
BaseClient.healthCheck;
```

***

### ingestSpans()

```ts theme={null}
ingestSpans(options: object): Promise<{
  experimentId?: null | string;
  logStreamId?: null | string;
  metricsTestingId?: null | string;
  parentId: string;
  projectId: string;
  projectName: string;
  recordsCount: number;
  sessionId: string;
  traceId: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Ingest spans into a trace. Spans represent individual operations or steps within a trace.

#### Parameters

##### options

Ingest request object

###### clientVersion?

`null` | `string`

(Optional) Client version identifier

###### experimentId?

`null` | `string`

(Optional) Experiment ID associated with the spans

###### loggingMethod?

`"playground"` | `"python_client"` | `"typescript_client"` | `"api_direct"`

(Optional) Logging method to use (default: 'api\_direct')

###### logStreamId?

`null` | `string`

(Optional) Log stream ID associated with the spans

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID associated with the spans

###### parentId

`string`

The unique identifier of the parent trace or span

###### reliable?

`boolean`

(Optional) Whether to use reliable logging (default: false)

###### spans

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

Array of span objects to ingest (AgentSpan, WorkflowSpan, LlmSpan, RetrieverSpan, or ToolSpan)

###### traceId

`string`

The unique identifier of the trace to attach spans to

#### Returns

`Promise`\<\{
`experimentId?`: `null` | `string`;
`logStreamId?`: `null` | `string`;
`metricsTestingId?`: `null` | `string`;
`parentId`: `string`;
`projectId`: `string`;
`projectName`: `string`;
`recordsCount`: `number`;
`sessionId`: `string`;
`traceId`: `string`;
}>

Promise resolving to a response indicating the ingestion result

***

### ingestTraces()

```ts theme={null}
ingestTraces(options: object): Promise<{
  experimentId?: null | string;
  logStreamId?: null | string;
  metricsTestingId?: null | string;
  projectId: string;
  projectName: string;
  recordsCount: number;
  sessionId: string;
  traceIds?: string[];
  tracesCount: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### options

###### clientVersion?

`null` | `string`

###### experimentId?

`null` | `string`

###### includeTraceIds?

`boolean`

###### isComplete?

`boolean`

###### loggingMethod?

`"playground"` | `"python_client"` | `"typescript_client"` | `"api_direct"`

###### logStreamId?

`null` | `string`

###### metricsTestingId?

`null` | `string`

###### reliable?

`boolean`

###### sessionId?

`null` | `string`

###### traces

`object`\[]

#### Returns

`Promise`\<\{
`experimentId?`: `null` | `string`;
`logStreamId?`: `null` | `string`;
`metricsTestingId?`: `null` | `string`;
`projectId`: `string`;
`projectName`: `string`;
`recordsCount`: `number`;
`sessionId`: `string`;
`traceIds?`: `string`\[];
`tracesCount`: `number`;
}>

***

### ingestTracesLegacy()

```ts theme={null}
ingestTracesLegacy(traces: any[]): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### traces

`any`\[]

#### Returns

`Promise`\<`void`>

***

### init()

```ts theme={null}
init(params: Partial<GalileoApiClientParams>): Promise<void>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### params

`Partial`\<`GalileoApiClientParams`> = `{}`

#### Returns

`Promise`\<`void`>

***

### initializeClient()

```ts theme={null}
protected initializeClient(): void;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Returns

`void`

#### Inherited from

```ts theme={null}
BaseClient.initializeClient;
```

***

### listDatasetProjects()

```ts theme={null}
listDatasetProjects(datasetId: string, limit: number): Promise<ListDatasetProjectsResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists all projects that use a dataset.

#### Parameters

##### datasetId

`string`

The ID of the dataset.

##### limit

`number` = `100`

(Optional) The maximum number of projects to return.

#### Returns

`Promise`\<[`ListDatasetProjectsResponse`](/sdk-api/typescript/reference/types/type-aliases/ListDatasetProjectsResponse)>

A promise that resolves to the list of projects that use the dataset.

***

### listGlobalPromptTemplates()

#### Call Signature

```ts theme={null}
listGlobalPromptTemplates(
   nameFilter: string,
   limit: number,
startingToken: number): Promise<ListPromptTemplateResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists global prompt templates using name filter, limit, and pagination token.

##### Parameters

###### nameFilter

`string`

Template name filter. Filters templates by name containing this string.

###### limit

`number`

Maximum number of templates to fetch per page.

###### startingToken

`number`

Pagination starting token (default: 0 for first page).

##### Returns

`Promise`\<[`ListPromptTemplateResponse`](/sdk-api/typescript/reference/types/type-aliases/ListPromptTemplateResponse)>

A promise that resolves to the list response payload containing templates and pagination info.

#### Call Signature

```ts theme={null}
listGlobalPromptTemplates(options: GlobalPromptTemplateListOptions): Promise<ListPromptTemplateResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists global prompt templates using optional filters and pagination.

##### Parameters

###### options

[`GlobalPromptTemplateListOptions`](/sdk-api/typescript/reference/types/type-aliases/GlobalPromptTemplateListOptions)

(Optional) Options for the list call.

##### Returns

`Promise`\<[`ListPromptTemplateResponse`](/sdk-api/typescript/reference/types/type-aliases/ListPromptTemplateResponse)>

A promise that resolves to the list response payload.

***

### listUserProjectCollaborators()

```ts theme={null}
listUserProjectCollaborators(options?: object): Promise<{
  collaborators: object[];
  limit?: number;
  nextStartingToken?: null | number;
  paginated?: boolean;
  startingToken?: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Lists project collaborators with optional pagination controls.

#### Parameters

##### options?

(Optional) Options for the list operation.

###### limit?

`number`

(Optional) Maximum collaborators to return per page.

###### projectId?

`string`

(Optional) Explicit project ID override.

###### startingToken?

`number`

(Optional) Pagination token to start from.

#### Returns

`Promise`\<\{
`collaborators`: `object`\[];
`limit?`: `number`;
`nextStartingToken?`: `null` | `number`;
`paginated?`: `boolean`;
`startingToken?`: `number`;
}>

A promise that resolves to the collaborators list payload.

***

### makeRequest()

```ts theme={null}
makeRequest<T>(
   request_method: Method,
   endpoint: Routes,
   data?: null | string | Record<string, any>,
   params?: Record<string, unknown>,
extraHeaders?: Record<string, string>): Promise<T>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Type Parameters

##### T

`T`

#### Parameters

##### request\_method

`Method`

##### endpoint

`Routes`

##### data?

`null` | `string` | `Record`\<`string`, `any`>

##### params?

`Record`\<`string`, `unknown`>

##### extraHeaders?

`Record`\<`string`, `string`>

#### Returns

`Promise`\<`T`>

#### Inherited from

```ts theme={null}
BaseClient.makeRequest;
```

***

### makeRequestRaw()

```ts theme={null}
makeRequestRaw<T>(
   request_method: Method,
   endpoint: Routes,
   data?: null | string | Record<string, any>,
   params?: Record<string, unknown>,
   extraHeaders?: Record<string, string>): Promise<AxiosResponse<T, any, {
}>>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

Make an HTTP request to the Galileo API and return the raw Axios response.

#### Type Parameters

##### T

`T`

#### Parameters

##### request\_method

`Method`

##### endpoint

`Routes`

##### data?

`null` | `string` | `Record`\<`string`, `any`>

##### params?

`Record`\<`string`, `unknown`>

##### extraHeaders?

`Record`\<`string`, `string`>

#### Returns

`Promise`\<`AxiosResponse`\<`T`, `any`, \{
}>>

#### Inherited from

```ts theme={null}
BaseClient.makeRequestRaw;
```

***

### makeRequestWithConversion()

```ts theme={null}
makeRequestWithConversion<SourceCamelType, SourceSnakeType, ResponseSnakeType, ResponseCamelType>(
   request_method: Method,
   endpoint: Routes,
   data: SourceCamelType,
params?: Record<string, unknown>): Promise<ValidatedCamelCase<ResponseSnakeType, ResponseCamelType>>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Type Parameters

##### SourceCamelType

`SourceCamelType` *extends* `object`

##### SourceSnakeType

`SourceSnakeType` *extends* `object`

##### ResponseSnakeType

`ResponseSnakeType` *extends* `object`

##### ResponseCamelType

`ResponseCamelType` *extends* `object`

#### Parameters

##### request\_method

`Method`

##### endpoint

`Routes`

##### data

`SourceCamelType`

##### params?

`Record`\<`string`, `unknown`>

#### Returns

`Promise`\<`ValidatedCamelCase`\<`ResponseSnakeType`, `ResponseCamelType`>>

#### Inherited from

```ts theme={null}
BaseClient.makeRequestWithConversion;
```

***

### makeStreamingRequest()

```ts theme={null}
makeStreamingRequest(
   request_method: Method,
   endpoint: Routes,
   data?: null | string | Record<string, any>,
   params?: Record<string, unknown>,
extraHeaders?: Record<string, string>): Promise<Readable>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Parameters

##### request\_method

`Method`

##### endpoint

`Routes`

##### data?

`null` | `string` | `Record`\<`string`, `any`>

##### params?

`Record`\<`string`, `unknown`>

##### extraHeaders?

`Record`\<`string`, `string`>

#### Returns

`Promise`\<`Readable`>

#### Inherited from

```ts theme={null}
BaseClient.makeStreamingRequest;
```

***

### processResponse()

```ts theme={null}
protected processResponse<T>(data: undefined | T, error: unknown): T;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Type Parameters

##### T

`T`

#### Parameters

##### data

`undefined` | `T`

##### error

`unknown`

#### Returns

`T`

#### Inherited from

```ts theme={null}
BaseClient.processResponse;
```

***

### queryDatasets()

```ts theme={null}
queryDatasets(params: ListDatasetParams, query?: object): Promise<ListDatasetResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Queries datasets with filters and pagination options.

#### Parameters

##### params

[`ListDatasetParams`](/sdk-api/typescript/reference/types/type-aliases/ListDatasetParams)

The list dataset parameters used to filter datasets.

##### query?

(Optional) Pagination options for the query.

###### limit?

`number`

(Optional) The maximum number of datasets to return.

###### startingToken?

`number`

(Optional) The starting token for pagination.

#### Returns

`Promise`\<[`ListDatasetResponse`](/sdk-api/typescript/reference/README/type-aliases/ListDatasetResponse)>

A promise that resolves to the list dataset response.

***

### recomputeMetrics()

```ts theme={null}
recomputeMetrics(options: object): Promise<unknown>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Recompute metrics for log records (traces, sessions, or spans) based on the provided filters and scorer IDs.
This triggers a background job to recalculate metrics for matching records.

#### Parameters

##### options

Request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to identify records for recomputation

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### limit?

`number`

(Optional) Maximum number of records to process (default: 100)

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

###### previousLastRowId?

`null` | `string`

(Optional) Previous last row ID for pagination

###### scorerIds

`string`\[]

Array of scorer IDs for which metrics should be recomputed

###### sort?

\{
`ascending?`: `boolean`;
`columnId`: `string`;
`sortType?`: `"column"`;
}

(Optional) Sort clause for ordering results

###### sort.ascending?

`boolean`

###### sort.columnId

`string`

###### sort.sortType?

`"column"`

###### startingToken?

`number`

(Optional) Starting token for pagination (default: 0)

###### truncateFields?

`boolean`

(Optional) Whether to truncate fields (default: false)

#### Returns

`Promise`\<`unknown`>

Promise resolving to the recomputation job result

***

### refreshTokenIfNeeded()

```ts theme={null}
protected refreshTokenIfNeeded(endpoint: Routes): Promise<void>;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Parameters

##### endpoint

`Routes`

#### Returns

`Promise`\<`void`>

#### Inherited from

```ts theme={null}
BaseClient.refreshTokenIfNeeded;
```

***

### renderPromptTemplate()

```ts theme={null}
renderPromptTemplate(
   request: RenderTemplateRequest,
   startingToken?: number,
limit?: number): Promise<RenderTemplateResponse>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Renders a global prompt template using dataset or string inputs.

#### Parameters

##### request

[`RenderTemplateRequest`](/sdk-api/typescript/reference/types/type-aliases/RenderTemplateRequest)

Render template request payload.

##### startingToken?

`number`

(Optional) Pagination starting token (default: 0).

##### limit?

`number`

(Optional) Maximum records per page (default: 100).

#### Returns

`Promise`\<[`RenderTemplateResponse`](/sdk-api/typescript/reference/types/type-aliases/RenderTemplateResponse)>

A promise that resolves to the render response payload.

***

### searchMetrics()

```ts theme={null}
searchMetrics(options: object): Promise<{
  aggregateMetrics: {
   [key: Uncapitalize<string>]: number;
  };
  bucketedMetrics: {
   [key: Uncapitalize<string>]: object[];
  };
  groupByColumns: string[];
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### options

###### endTime

`string`

###### experimentId?

`null` | `string`

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

###### groupBy?

`null` | `string`

###### interval?

`number`

###### logStreamId?

`null` | `string`

###### metricsTestingId?

`null` | `string`

###### startTime

`string`

#### Returns

`Promise`\<\{
`aggregateMetrics`: \{
\[`key`: `Uncapitalize`\<`string`>]: `number`;
};
`bucketedMetrics`: \{
\[`key`: `Uncapitalize`\<`string`>]: `object`\[];
};
`groupByColumns`: `string`\[];
}>

***

### searchSessions()

```ts theme={null}
searchSessions(request: object): Promise<{
  lastRowId?: null | string;
  limit?: number;
  nextStartingToken?: null | number;
  paginated?: boolean;
  records?: object[] | object[] | object[] | object[] | object[] | object[] | object[];
  startingToken?: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Search for sessions matching the provided query criteria.

#### Parameters

##### request

Query request object

###### experimentId?

`null` | `string`

(Optional) Experiment ID to filter by

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

(Optional) Array of filter objects to apply

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

(Optional) Complex filter tree structure

###### limit?

`number`

(Optional) Maximum number of records to return (default: 100)

###### logStreamId?

`null` | `string`

(Optional) Log stream ID to filter by

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID to filter by

###### previousLastRowId?

`null` | `string`

(Optional) Previous last row ID for pagination

###### sort?

\{
`ascending?`: `boolean`;
`columnId`: `string`;
`sortType?`: `"column"`;
}

(Optional) Sort clause for ordering results

###### sort.ascending?

`boolean`

###### sort.columnId

`string`

###### sort.sortType?

`"column"`

###### startingToken?

`number`

(Optional) Starting token for pagination (default: 0)

###### truncateFields?

`boolean`

#### Returns

`Promise`\<\{
`lastRowId?`: `null` | `string`;
`limit?`: `number`;
`nextStartingToken?`: `null` | `number`;
`paginated?`: `boolean`;
`records?`: `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[];
`startingToken?`: `number`;
}>

Promise resolving to a query response containing matching session records

***

### searchSpans()

```ts theme={null}
searchSpans(options: object): Promise<{
  lastRowId?: null | string;
  limit?: number;
  nextStartingToken?: null | number;
  paginated?: boolean;
  records?: object[] | object[] | object[] | object[] | object[] | object[] | object[];
  startingToken?: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### options

###### experimentId?

`null` | `string`

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

###### limit?

`number`

###### logStreamId?

`null` | `string`

###### metricsTestingId?

`null` | `string`

###### previousLastRowId?

`null` | `string`

###### sort?

\{
`ascending?`: `boolean`;
`columnId`: `string`;
`sortType?`: `"column"`;
}

###### sort.ascending?

`boolean`

###### sort.columnId

`string`

###### sort.sortType?

`"column"`

###### startingToken?

`number`

###### truncateFields?

`boolean`

#### Returns

`Promise`\<\{
`lastRowId?`: `null` | `string`;
`limit?`: `number`;
`nextStartingToken?`: `null` | `number`;
`paginated?`: `boolean`;
`records?`: `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[];
`startingToken?`: `number`;
}>

***

### searchTraces()

```ts theme={null}
searchTraces(options: object): Promise<{
  lastRowId?: null | string;
  limit?: number;
  nextStartingToken?: null | number;
  paginated?: boolean;
  records?: object[] | object[] | object[] | object[] | object[] | object[] | object[];
  startingToken?: number;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### options

###### experimentId?

`null` | `string`

###### filters?

`object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[]

###### filterTree?

\| `null`
\| \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| `object`\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| `object`\[];
}
\| \{
`not`: | \{
`filter`: | \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"`;
`value`: `boolean`;
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"contains"` | `"not_in"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `boolean`;
}
\| \{
`name`: `null` | `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"` | `"between"`;
`value`: `number` | `number`\[];
}
\| \{
`name`: `null` | `string`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"gt"` | `"gte"` | `"lt"` | `"lte"`;
`value`: `string`;
}
\| \{
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`caseSensitive?`: `boolean`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`name`: `null` | `string`;
`operator?`: `"eq"` | `"ne"` | `"contains"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
}
\| \{
`key`: `string`;
`name`: `null` | `string`;
`operator`: `"eq"` | `"ne"` | `"not_in"` | `"one_of"`;
`value`: `string` | `string`\[];
};
}
\| \{
`and`: | `object`\[]
\| \{ and: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | ...\[] | \{ ...; }\[] | \{ ...; }\[]; }\[]
\| `object`\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{
`or`: | `object`\[]
\| `object`\[]
\| \{ or: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; }\[] | \{ ...; }\[] | ...\[] | \{ ...; }\[]; }\[]
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; }\[];
}
\| \{ not: \{ filter: \{ name: string | null; operator: "eq" | "ne"; value: boolean; } | \{ name: string | null; operator: "eq" | "contains" | "not\_in"; value: string | string\[]; caseSensitive?: boolean | undefined; } | ... 8 more ... | \{ ...; }; } | \{ ...; } | \{ ...; } | ...; };
}

###### limit?

`number`

###### logStreamId?

`null` | `string`

###### metricsTestingId?

`null` | `string`

###### previousLastRowId?

`null` | `string`

###### sort?

\{
`ascending?`: `boolean`;
`columnId`: `string`;
`sortType?`: `"column"`;
}

###### sort.ascending?

`boolean`

###### sort.columnId

`string`

###### sort.sortType?

`"column"`

###### startingToken?

`number`

###### truncateFields?

`boolean`

#### Returns

`Promise`\<\{
`lastRowId?`: `null` | `string`;
`limit?`: `number`;
`nextStartingToken?`: `null` | `number`;
`paginated?`: `boolean`;
`records?`: `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[] | `object`\[];
`startingToken?`: `number`;
}>

***

### updateGlobalPromptTemplate()

```ts theme={null}
updateGlobalPromptTemplate(templateId: string, name: string): Promise<PromptTemplate>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Renames a global prompt template.

#### Parameters

##### templateId

`string`

Template identifier to update.

##### name

`string`

New template name.

#### Returns

`Promise`\<[`PromptTemplate`](/sdk-api/typescript/reference/types/type-aliases/PromptTemplate)>

A promise that resolves to the updated template payload.

***

### updateSpan()

```ts theme={null}
updateSpan(options: object): Promise<{
  experimentId?: null | string;
  logStreamId?: null | string;
  metricsTestingId?: null | string;
  projectId: string;
  projectName: string;
  recordsCount: number;
  sessionId: string;
  spanId: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Update a span with new data.

#### Parameters

##### options

Update request object

###### clientVersion?

`null` | `string`

(Optional) Client version identifier

###### durationNs?

`null` | `number`

###### experimentId?

`null` | `string`

(Optional) Experiment ID associated with the span

###### input?

`null` | `string` | `object`\[]

(Optional) New input value to overwrite existing input (string or Message array)

###### loggingMethod?

`"playground"` | `"python_client"` | `"typescript_client"` | `"api_direct"`

(Optional) Logging method to use (default: 'api\_direct')

###### logStreamId?

`null` | `string`

(Optional) Log stream ID associated with the span

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID associated with the span

###### output?

\| `null`
\| `string`
\| \{
`content`: `string`;
`role`: | `"function"`
\| `"agent"`
\| `"tool"`
\| `"user"`
\| `"assistant"`
\| `"developer"`
\| `"system"`;
`tool_call_id?`: `null` | `string`;
`tool_calls?`: `null` | `object`\[];
}
\| `object`\[]

(Optional) New output value to overwrite existing output (string, Message, or Document array)

###### reliable?

`boolean`

(Optional) Whether to use reliable logging (default: false)

###### spanId

`string`

The unique identifier of the span to update

###### statusCode?

`null` | `number`

(Optional) Status code to overwrite existing status code

###### tags?

`string`\[]

(Optional) Tags to add to the span

#### Returns

`Promise`\<\{
`experimentId?`: `null` | `string`;
`logStreamId?`: `null` | `string`;
`metricsTestingId?`: `null` | `string`;
`projectId`: `string`;
`projectName`: `string`;
`recordsCount`: `number`;
`sessionId`: `string`;
`spanId`: `string`;
}>

Promise resolving to the updated span record

***

### updateTrace()

```ts theme={null}
updateTrace(options: object): Promise<{
  experimentId?: null | string;
  logStreamId?: null | string;
  metricsTestingId?: null | string;
  projectId: string;
  projectName: string;
  recordsCount: number;
  sessionId: string;
  traceId: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Update a trace with new data.

#### Parameters

##### options

Update request object

###### clientVersion?

`null` | `string`

(Optional) Client version identifier

###### durationNs?

`null` | `number`

###### experimentId?

`null` | `string`

(Optional) Experiment ID associated with the trace

###### input?

`null` | `string`

(Optional) New input value to overwrite existing input

###### isComplete?

`null` | `boolean`

###### loggingMethod?

`"playground"` | `"python_client"` | `"typescript_client"` | `"api_direct"`

(Optional) Logging method to use (default: 'api\_direct')

###### logStreamId?

`null` | `string`

(Optional) Log stream ID associated with the trace

###### metricsTestingId?

`null` | `string`

(Optional) Metrics testing ID associated with the trace

###### output?

`null` | `string`

(Optional) New output value to overwrite existing output

###### reliable?

`boolean`

(Optional) Whether to use reliable logging (default: false)

###### statusCode?

`null` | `number`

(Optional) Status code to overwrite existing status code

###### tags?

`string`\[]

(Optional) Tags to add to the trace

###### traceId

`string`

The unique identifier of the trace to update

#### Returns

`Promise`\<\{
`experimentId?`: `null` | `string`;
`logStreamId?`: `null` | `string`;
`metricsTestingId?`: `null` | `string`;
`projectId`: `string`;
`projectName`: `string`;
`recordsCount`: `number`;
`sessionId`: `string`;
`traceId`: `string`;
}>

Promise resolving to the updated trace record

***

### updateUserProjectCollaborator()

```ts theme={null}
updateUserProjectCollaborator(
   userId: string,
   update: object,
   projectId?: string): Promise<{
  createdAt: string;
  email: string;
  firstName: null | string;
  id: string;
  lastName: null | string;
  permissions?: object[];
  role: "owner" | "editor" | "annotator" | "viewer";
  userId: string;
}>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

Updates a user collaborator.

#### Parameters

##### userId

`string`

ID of the collaborator to update.

##### update

Update payload describing the collaborator changes.

###### role

`"owner"` | `"editor"` | `"annotator"` | `"viewer"`

##### projectId?

`string`

(Optional) Project ID override when not using a scoped client.

#### Returns

`Promise`\<\{
`createdAt`: `string`;
`email`: `string`;
`firstName`: `null` | `string`;
`id`: `string`;
`lastName`: `null` | `string`;
`permissions?`: `object`\[];
`role`: `"owner"` | `"editor"` | `"annotator"` | `"viewer"`;
`userId`: `string`;
}>

A promise that resolves to the updated collaborator.

***

### validateCodeScorerAndWait()

```ts theme={null}
validateCodeScorerAndWait(
   codeContent: string,
   scoreableNodeTypes: ("agent" | "llm" | "retriever" | "tool" | "workflow" | "trace" | "session")[],
   timeoutMs?: number,
   pollIntervalMs?: number,
requiredScorers?: string[]): Promise<ValidateRegisteredScorerResult>;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Parameters

##### codeContent

`string`

##### scoreableNodeTypes

(`"agent"` | `"llm"` | `"retriever"` | `"tool"` | `"workflow"` | `"trace"` | `"session"`)\[]

##### timeoutMs?

`number`

##### pollIntervalMs?

`number`

##### requiredScorers?

`string`\[]

#### Returns

`Promise`\<[`ValidateRegisteredScorerResult`](/sdk-api/typescript/reference/types/interfaces/ValidateRegisteredScorerResult)>

***

### validateResponse()

```ts theme={null}
protected validateResponse(response: AxiosResponse): void;
```

Defined in: [src/api-client/base-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/base-client.ts)

#### Parameters

##### response

`AxiosResponse`

#### Returns

`void`

#### Inherited from

```ts theme={null}
BaseClient.validateResponse;
```

***

### getTimestampRecord()

```ts theme={null}
static getTimestampRecord(): Date;
```

Defined in: [src/api-client/galileo-client.ts](https://github.com/rungalileo/galileo-js/blob/main/src/api-client/galileo-client.ts)

#### Returns

`Date`