Insights Panel
Galileo provides a dynamic Insights Panel that provides a bird’s eye view of your model’s performance on the data currently in scope. Specifically, the Insights Panel contains three sections:
Metrics
Under the “Metrics” tab you can find a number of charts and insights that update dynamically. Through these charts you can get greater insights into the subset of data you’re currently looking at. These content of these charts differ depending on the task type. Generally, they include
-
Overall model and dataset metrics
-
Class level model performance
-
Class level DEP scores
-
Class distributions
-
Top most misclassified pairs
-
Error distributions
-
Class Overlap
The Insights Panel allows you to keep a constant check on model performance as you continue the inspection process (through the Dataset View and Embeddings View).
Model and Dataset Metrics
The top of the Insights Panel displays aggregate model performance (default to F1 for NLP, Accuracy, mAP and IOU for Image Classification, Object Detection or Semantic Segmentation) and allow you to select between Precision, Recall, and F1. Additionally, the Insights Panel shows the number of current data samples in scope along with what % of the total data is represented.
Class Level Model Performance
Based on the model metric selected (F1, Precision, Recall), the “Model performance” bar chart displays class level model performance.
Class Level Model Performance Chart
Class Distribution
The Class Distribution chart shows the breakdown of samples within each class. This insights chart is critical for quickly drawing insights about the class makeup of the data in scope and for detecting issues with class imbalance.
Fig. Class Distribution plot
Top most misclassified pairs
At the bottom of the Insights Panel we show the “Top five 5 most misclassified data label pairs”, where each pair shows a gold label, the incorrect prediction label, and the number of samples falling into this misclassified pairing. This insights chart provides a snapshot into the most common mistakes made by the model (i.e. mistaking ground truth label X for prediction label Y).
Fig. Top 5 misclassified label pairs - surfaces the most common mistakes made by the model
Interacting with Insights Charts
In addition to providing visual insights, each insights chart can also be interacted with. Within the “Model performance”, “Data Error Potential (DEP)”, and “Class distribution” charts selecting one of the bars restricts the data in scope to data with Gold Label equal to the selected bar label.
An even more powerful interaction exists in the “Top 5 most misclassified label pairs” panel. Clicking on a row within this insights chart filters for misclassified data matching the gold label and prediction label of the misclassified label pair.
Fig. Interaction with `Most misclassified label pairs` chart allows for quick dataset filtering
Was this page helpful?