Available Statistics and Assertions

Statistics

Statistic	Description
absolute difference of max	-
absolute difference of mean	-
absolute difference of median	-
absolute difference of min	-
absolute difference of percentile	Requires percentage as a parameter.
absolute difference of standard deviation	-
absolute difference of sum	-
Category Rank Discrepancy	Computes the absolute difference in the proportion of the specified category between the experiment and baseline runs. The category is specified by its rank in the baseline run. Requires rankas a parameter: can be one of [most_common, second_most_common, not_top_two].
Chi-squared stat, scaled	Computes a scaled and normalized Chi-squared statistic between two nominal distributions.
Kolmogorov-Smirnov stat, scaled	Computes a scaled and normalized Kolmogorov-Smirnov statistic between two ordinal distributions.
max	-
mean	-
median	-
min	-
mode	-
Null Count	Computes the number of None values in a column.
Null Percentage	Computes the fraction of None values in a column.
percentile	Requires percentage as a parameter.
scalar	Special function for using scalars in tests. Returns the input as a scalar value if it is a scalar and returns an error otherwise.
signed difference of max	-
signed difference of mean	-
signed difference of median	-
signed difference of min	-
signed difference of percentile	Requires percentage as a parameter.
signed difference of standard deviation	-
signed difference of sum	-
standard deviation	-
sum	-

Assertions

Assertion
between
between or equal to
close to
equal to
greater than
greater than or equal to
less than
less than or equal to
not equal to
outside
outside or equal to