Skip to main content

​
Prerequisites

  • Python 3.12
If you plan to fine-tune on GPU, you’ll also need a compatible CUDA environment (for example, 1x H100-class GPU). Install the SDK with the extras you need:

​
LLM provider extras (optional)

Pick the provider(s) you use for generation/labeling:
Available LLM provider extras are:
  • llm-anthropic
  • llm-openai
  • llm-azure-openai
  • llm-groq
  • llm-gemini
  • llm-vertex-ai
These are installation extras, not all accepted values for data_generation.llm.provider. The current provider registry accepts anthropic, azure, gemini, groq, openai, and vegas; see the data-generation config reference.

​
Deployment extras (optional)

Pick the deployment extra for the cloud environment you use:
Available deployment extras include deploy-kubernetes, deploy-vertex-ai, deploy-azureml, deploy-sagemaker.

​
Verify install