create_test_recalibration_session

def create_test_recalibration_session(
  *,
  test_session: TestSession,
  feedback: str,
  test_ids: Optional[list[str]] = None,
) -> 

If a TestSession has completed and some of the generated Tests had incorrect outcomes, you can tell Distributional that these tests should have had different results.

Only applies to Tests generated by Distributional, not custom, user-defined Tests.

Parameters

Arguments
Description

test_session

The TestSession the user wants to recalibrate

feedback

either "PASS" or "FAIL", to redefine the Test outcomes.

test_ids

List of Tests to apply the feedback to. If None, then all generated Tests will be set with the given feedback.

Returns

Type
Description

TestRecalibrationSession

Limitations

If some generated Tests failed when they should have passed, and some passed when they should have failed, the user will need to submit 2 separate calls, for each feedback result.

Last updated

Was this helpful?