Set up Gemini Enterprise credentials

Galileo connects to Google’s Gemini Enterprise Agent Platform (previously known as Vertex AI) using a Google Cloud service account JSON key. Paste the full JSON key file into Galileo to use Gemini models in the Playground, LLM-as-a-Judge metrics, Signals, and more. In the Galileo SDK and API, this integration is stored in the provider ID vertex_ai.

Prerequisites

The instructions on this page assume that you have these prerequisites:

A Google Cloud project with billing enabled
Permission to enable APIs (Service Usage Admin, roles/serviceusage.serviceUsageAdmin)
Permission to create service accounts and keys (Service Account Admin and Service Account Key Admin, or equivalent custom roles)
If your organization enforces iam.disableServiceAccountKeyCreation, an exemption for your project — see Google’s service account key documentation

Create JSON key in Google Cloud

Create or select a project

In the Google Cloud console, select an existing project or create a new one. Verify that billing is enabled for the project.

Enable the Agent Platform API

Galileo calls Gemini models through the Agent Platform API (aiplatform.googleapis.com).

Using the Google Cloud Console:

Open APIs & Services, go to the Agent Platform API, and click the Enable button (if not already enabled).

Using the command-line (gcloud):

gcloud services enable aiplatform.googleapis.com --project=PROJECT_ID

Create a service account

Open IAM & Admin → Service Accounts.
Select your project.
Click Create service account.
Enter a service account name, required service account ID (for example, galileo-integration), and optional description. Click Create and continue.

Grant permissions

Assign at least Agent Platform User (roles/aiplatform.user) so Galileo can invoke Gemini models.

Role	Purpose
Agent Platform User (`roles/aiplatform.user`)	Required for model inference
Storage Object Admin (or a narrower bucket role)	Optional — only if you use multimodal observability with GCS file uploads

For more information, see Agent Platform access control with IAM.

Click Done after adding permissions.

Create and download a JSON key

Open the service account you just created (e.g. from the Service accounts page).
Open the Keys tab.
Click Add key → Create new key.
Select JSON and click Create.

The key file downloads immediately. You cannot download it again. Store it securely and do not commit it to source control.

The file looks similar to below:

{
  "type": "service_account",
  "project_id": "your-project-id",
  "private_key_id": "key-id",
  "private_key": "-----BEGIN PRIVATE KEY-----\n...\n-----END PRIVATE KEY-----\n",
  "client_email": "galileo-integration@your-project-id.iam.gserviceaccount.com",
  "client_id": "123456789",
  "auth_uri": "https://accounts.google.com/o/oauth2/auth",
  "token_uri": "https://oauth2.googleapis.com/token",
  "auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
  "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/..."
}

Create credentials with gcloud

export PROJECT_ID="your-project-id"

gcloud services enable aiplatform.googleapis.com --project="${PROJECT_ID}"

gcloud iam service-accounts create galileo-integration \
  --project="${PROJECT_ID}" \
  --display-name="Galileo integration"

SA_EMAIL="galileo-integration@${PROJECT_ID}.iam.gserviceaccount.com"
gcloud projects add-iam-policy-binding "${PROJECT_ID}" \
  --member="serviceAccount:${SA_EMAIL}" \
  --role="roles/aiplatform.user"

gcloud iam service-accounts keys create galileo-key.json \
  --iam-account="${SA_EMAIL}"

Add the integration in Galileo

Navigate to Integrations

In the Galileo console, open the user menu (bottom left) and select Integrations, or go to Settings → Integrations.

Add Gemini Enterprise

Locate Gemini Enterprise in the provider list and click + Add Integration.

Paste the service account JSON

In the integration dialog, paste the full contents of the JSON key file you downloaded, then click Save changes.

After saving, Gemini models appear in the Playground and for metrics that use your organization’s LLM integrations.

Optional — Multimodal and GCS

For audio, image, or PDF evaluation in Log streams, you may need a separate Google Cloud Storage bucket and additional credentials. Galileo accepts optional gcs_config when configuring the integration via API. See Multimodal observability.

Configure via API

You can create or update the integration with a PUT request. Set token to the JSON key file contents as a string (escape newlines in the private_key field when building JSON manually).

if [ -z "$GALILEO_API_KEY" ]; then
  echo "Error: GALILEO_API_KEY environment variable is not set"
  exit 1
fi

if [ -z "$GALILEO_API_URL" ]; then
  echo "Error: GALILEO_API_URL environment variable is not set"
  exit 1
fi

curl "${GALILEO_API_URL}/integrations/vertex_ai" \
  -X PUT \
  -H "Galileo-API-Key: ${GALILEO_API_KEY}" \
  -H "Content-Type: application/json" \
  --data-raw "$(jq -n --rawfile token /path/to/galileo-key.json '{token: $token}')"

A successful response returns integration metadata including id, name, and updated_at. See Create or update Vertex AI integration for optional gcs_config and multi_modal_config fields.

Supported models

Galileo supports the following Gemini model aliases when using this integration:

gemini-2.0-flash
gemini-2.0-flash-lite
gemini-2.0-flash-thinking
gemini-2.0-pro
gemini-2.5-flash
gemini-2.5-flash-lite
gemini-2.5-pro
gemini-3.0-flash-preview
gemini-3.0-pro-image-preview
gemini-3.0-pro-preview
gemini-3.1-flash-image-preview
gemini-3.1-pro-preview
gemini-3.1-pro-preview-customtools

Troubleshooting

Organization policy blocks service account keys

If key creation fails, your organization may enforce iam.disableServiceAccountKeyCreation. Ask an organization policy administrator to exempt your project, or follow Allow service account key creation.

Vertex AI API not enabled or billing missing

Confirm the Vertex AI API is enabled (aiplatform.googleapis.com) and billing is active on the project. Enable the API from APIs & Services.

Permission denied (403) from Google

Ensure the service account has Vertex AI User (roles/aiplatform.user) on the project. Wait a few minutes after granting roles before retrying in Galileo.

Invalid JSON in Galileo

Paste the entire key file, including opening and closing braces. Do not paste only the private_key field or a truncated file. If you edited the file, validate it with jq . galileo-key.json before pasting.

Custom model integrations

Configure other LLM providers or proxies with custom JSON.

Multimodal observability

Log and evaluate image, audio, and PDF content in traces.

Overview

Get Started

Observability

Evaluation Metrics

Signals

AI Assistant

Luna Studio

Experiments

Agent Control

Annotations

Integrations

Security

References

Set up Gemini Enterprise credentials

Prerequisites

Create JSON key in Google Cloud

Add the integration in Galileo

Optional — Multimodal and GCS

Configure via API

Supported models

Troubleshooting

Custom model integrations

Multimodal observability

​Prerequisites

​Create JSON key in Google Cloud

​Add the integration in Galileo

​Optional — Multimodal and GCS

​Configure via API

​Supported models

​Troubleshooting

​Related info

Custom model integrations

Multimodal observability

Prerequisites

Create JSON key in Google Cloud

Add the integration in Galileo

Optional — Multimodal and GCS

Configure via API

Supported models

Troubleshooting

Related info