This metric is intended for RAG use cases and is only available if you log your retriever’s output.
Luna vs Plus
We offer two ways of calculating Completeness: Luna and Plus. Chunk Utilization Luna is computed using Galileo in-house small language models. They’re free of cost. Completeness Luna is a cost effective way to scale up you RAG evaluation workflows. Chunk Utilization Plus is computed by sending an additional request to your LLM. It relies on OpenAI models so it incurs an additional cost. Chunk Utilization Plus has shown better results in internal benchmarks.Chunk Attribution and Chunk Utilization are closely related and rely on the same models for computation. The “chunk_attribution_utilization_{luna/plus}” scorer will compute both.