Condition
is a class for building custom data quality checks. Simply create a condition, and after the run is processed your conditions will be evaluated. Integrate with email or slack to have condition results alerting via a Run Report. Use Conditions to answer questions such as “Is the average confidence for my training data below 0.25” or “Has over 20% of my inference data drifted”.
What do I do with Conditions?
You can build aRun Report
that will evaluate all conditions after a run is processed.
How do I build a Condition?
ACondition
is defined as:
- Is the average confidence less than 0.3?
- Is the max DEP greater or equal to 0.45?
- Alert if over 80% of the dataset has confidence under 0.1
- Alert if at least 20% of the dataset has drifted (Inference DataFrames only)
- Alert 5% or more of the dataset contains PII
- Alert if the min confidence of drifted data is less than 0.15
- Alert if over 50% of high DEP (>=0.7) data contains PII:
- Assert that average confidence less than 0.3