This metric is intended for RAG use cases and is only available if you log your retriever’s output.
- Context Adherence answers the question, “is the model’s response consistent with the information in the context?”
- Completeness answers the question, “is the relevant information in the context fully reflected in the model’s response?”
- User query: “Who was Galileo Galilei?”
- Context: “Galileo Galilei was an Italian astronomer.”
- Model response: “Galileo Galilei was Italian.”