#banner {
  background-color: #fef1d7;

  p {
    color: #383645;
  }

  a {
    color: #383645;
    border-bottom: 1px solid #383645;
  }

  button {
    color: #9b98ae;
  }
}


// REO script
!(function () {
  var e, t, n;
  (e = "638190bf025179e"),
    (t = function () {
      Reo.init({ clientID: "638190bf025179e" });
    }),
    ((n = document.createElement("script")).src = "https://static.reo.dev/" + e + "/reo.js"),
    (n.async = !0),
    (n.onload = t),
    document.head.appendChild(n);
})();

// Hubspot script
const script = document.createElement("script");
script.type = "text/javascript";
script.id = "hs-script-loader";
script.async = true;
script.defer = true;
script.src = "//js.hs-scripts.com/23114811.js";
document.head.appendChild(script);

// RB2B script.
!(function () {
  var reb2b = (window.reb2b = window.reb2b || []);
  if (reb2b.invoked) return;
  reb2b.invoked = true;
  reb2b.methods = ["identify", "collect"];
  reb2b.factory = function (method) {
    return function () {
      var args = Array.prototype.slice.call(arguments);
      args.unshift(method);
      reb2b.push(args);
      return reb2b;
    };
  };
  for (var i = 0; i < reb2b.methods.length; i++) {
    var key = reb2b.methods[i];
    reb2b[key] = reb2b.factory(key);
  }
  reb2b.load = function (key) {
    var script = document.createElement("script");
    script.type = "text/javascript";
    script.async = true;
    script.src = "https://s3-us-west-2.amazonaws.com/b2bjsstore/b/" + key + "/8XOE9GH5EDOM.js.gz";
    var first = document.getElementsByTagName("script")[0];
    first.parentNode.insertBefore(script, first);
  };
  reb2b.SNIPPET_VERSION = "1.0.1";
  reb2b.load("8XOE9GH5EDOM");
})();


Get Span

Content

Document

Aggregate

FeedbackAggregate

Created At

Created By

Explanation

Rating

FeedbackRatingDB

Hallucination

Hallucination Severity

Start

HallucinationSegment

Dislike Count

Feedback Type

Like Count

Unrated Count

LikeDislikeAggregate

Value

LikeDislikeRating

Duration of the trace or span in nanoseconds.  Displayed as 'Latency' in Galileo.

Duration Ns

Num Input Tokens

Num Output Tokens

Num Total Tokens

Time until the first token was generated in nanoseconds.

Time To First Token Ns

LlmMetrics

Timestamp of the trace or span's creation.

Created

Input to the dataset associated with this trace

Dataset Input

Metadata from the dataset associated with this trace

Dataset Metadata

Output from the dataset associated with this trace

Dataset Output

A user-provided session, trace or span ID.

External Id

Finish Reason

Whether or not this trace or span has child spans

Has Children

Input

Detailed information about the metrics associated with this trace or span

Metric Info

Metrics associated with this trace or span.

Galileo ID of the metrics batch associated with this trace or span

Metrics Batch Id

Model

Name

Parent ID

Galileo ID of the project associated with this trace or span

Project ID

Galileo ID of the run (log stream or experiment) associated with this trace or span

Run ID

Status code of the trace or span. Used for logging failure or error states.

Status Code

Temperature

List of available tools passed to the LLM on invocation.

Tools

Galileo ID of the trace containing the span (or the same value as id for a trace)

Trace ID

Type

Timestamp of the trace or span's last update

Last Updated

Metadata associated with this trace or span.

User Metadata

LlmSpanRecord

Message

Status Type

MetricComputing

Is Computed

Revised Explanation

MetricCritiqueColumnar

Critique

Intended Value

Original Explanation

MetricCritiqueContent

MetricError

MetricFailed

MetricNotApplicable

MetricNotComputed

MetricPending

Cost

Display Value

Model Alias

Num Judges

Rationale

MetricSuccess

Metrics

Output

RetrieverSpanRecord

Average

ScoreAggregate

ScoreRating

ScorerType

Prob

Segment

Counts

StarAggregate

StarRating

TagsAggregate

TagsRating

TextRating

ToolCall

Arguments

ToolCallFunction

Tool Call Id

ToolSpanRecord

Location

Error Type

ValidationError

Spans

WorkflowSpanRecordWithChildren

Tool Calls

MessageRole

APIKeyHeader

OAuth2PasswordBearer

HTTPBasic

HTTPValidationError

ℹ️ These docs are for current Galileo customers. Docs for the free version of Galileo, can be found [here](https://v2docs.galileo.ai/).

Galileo

Evaluate, Observe, and Protect your GenAI applications

What is Galileo?

Stop experimenting in spreadsheets and notebooks. Use Evaluate’s powerful insights to build GenAI systems that just work.

Overview of Galileo Evaluate

Monitor and analyze generative AI models with Galileo Observe, using real-time data insights to maintain performance and ensure quality outputs.

Overview of Galileo Observe

How to monitor your apps with Galileo Observe

Getting Started | Galileo Observe

Explore Galileo Protect to safeguard AI applications with customizable rulesets, error detection, and robust metrics for enhanced AI governance.

Overview of Galileo Protect

Get started with Galileo Protect using this quickstart guide, covering setup, ruleset creation, and integration into AI workflows for secure operations.

Quickstart Guide | Galileo Protect

Utilize Galileo's Guardrail Metrics to monitor generative AI models, ensuring adherence to quality, correctness, and alignment with project goals.

Overview of Galileo Guardrail Metrics

Fine-tune large language models with Galileo's LLM Fine-Tune tools, enabling precise adjustments for optimized AI performance and output quality.

Overview of Galileo LLM Fine-Tune

file

Galileo NLP Studio supports Natural Language Processing Tasks across the life-cycle of your model development.

Training High-Quality Supervised NLP Models | Galileo

You have questions, we have (some) answers!

FAQs

Explore Galileo's client references, including Python and TypeScript integrations, to streamline Evaluate, Observe, and Protect module implementations.

Client References

Api reference

Healthcheck

Get Token

Create a new Evaluate run with workflows.

Use this endpoint to create a new Evaluate run with workflows. The request body should contain the `workflows` to be ingested and evaluated.

Additionally, specify the `project_id` or `project_name` to which the workflows should be ingested. If the project does not exist, it will be created. If the project exists, the workflows will be logged to it. If both `project_id` and `project_name` are provided, `project_id` will take precedence. The `run_name` is optional and will be auto-generated (timestamp-based) if not provided.

The body is also expected to include the configuration for the scorers to be used in the evaluation. This configuration will be used to evaluate the workflows and generate the results.

Create a new Evaluate Run

Fetch evaluation results for a specific run including rows and aggregate information.

Get Evaluate Run Results

Log workflows to an Observe project.

Use this endpoint to log workflows to an Observe project. The request body should contain the
`workflows` to be ingested.

Additionally, specify the `project_id` or `project_name` to which the workflows should be ingested.
If the project does not exist, it will be created. If the project exists, the workflows will be logged to it.
If both `project_id` and `project_name` are provided, `project_id` will take precedence.

Log Workflows to an Observe Project

Get workflows for a specific run in an Observe project.

Get Workflows

Learn how to use the 'Invoke Protect' API endpoint in Galileo's Protect module to process payloads with specified rulesets effectively.

Invoke Protect

Log Traces

Traces Available Columns

Spans Available Columns

Query Traces

Query Spans

Get Trace

List Log Streams

Create Log Stream

Get Log Stream

Update Log Stream

Delete Log Stream

List Experiments

Create Experiment

Get Experiment

Update Experiment

Delete Experiment

Procures the column information for experiments.

Experiments Available Columns

List Feedback Templates

Create Feedback Template V2

Get Feedback Template

Delete Feedback Template

Update Feedback Template

Reorder Feedback Templates

Get Feedback Rating V2

Create Feedback Rating V2

Delete Feedback Rating V2

Apply Bulk Feedback V2

When a Protect execution completes with the status specified in the configuration, the webhook specified is
triggered with this payload.

Protect notification

Explore Galileo's practical examples covering real-world use cases and workflows for Evaluate, Observe, and Protect modules across AI projects.

Examples

Galileo AI Research

This page provides a brief overview of the research behind Galileo's RAG Quality Metrics.

Rag Quality Metrics Using Luna

ChainPoll is a powerful, flexible technique for LLM-based evaluation that is unique to Galileo. It is used to power multiple metrics across the Galileo platform.

Chainpoll

Learn how ChainPoll metrics assess retrieval-augmented generation (RAG) system quality, improving accuracy and performance of generative AI models.

Rag Quality Metrics Using Chainpoll

Learn about Galileo's Data Error Potential (DEP) score, a metric to identify and categorize machine learning data errors, enhancing data quality and model performance.

API Reference

health

auth

evaluate

observe

protect

trace

log_stream

experiment

feedback

API Reference

Get Span

Authorizations

Path Parameters

Response