Skip to main content
Use this tutorial when your metric depends on multiple text fields, but not on retrieved document context. A common example is instruction-following style evaluation where the model sees both an input and an output.

Dataset schema

Typical columns:
  • input: the source prompt, instruction, or user message
  • output: the model response or candidate answer
  • label: the ground-truth class for the metric

Config shape

Use a span-style config with:
  • data_generation.metric.input_format: "tuple"
  • data_generation.source_data.dataset.columns.features: ["input", "output"]
  • training.metric.type: "boolean" for binary metrics

Minimal end-to-end config