All pages
Powered by GitBook
1 of 3

Loading...

Loading...

Loading...

Manually Running Tests Via UI

You can choose to run tests associated with a project by clicking on the Run Tests button on the project details page. This button will open up a modal that allows you to specify the baseline and experiment runs as well as the tags of the tests you would like to include or exclude from the test session.

Executing Tests Via SDK

Tests can also be executed via the SDK after results data has been reported. This requires the following steps.

Report an initial run and set that as a baseline

From the project details page, click configure tests.
Select the baseline run in the dropdown against which you would like new experiment runs to be compared.

Setting baseline in SDK

Alternatively, you can also set a Run as baseline using the function.

Close a new run in that project

Executing the command for a new run in that same project will finalize the data, enabling it for use in Tests.

Create Test Session

Execute the command, providing your new run as the "experiment". Tests will then use the previously-defined baseline for comparisons.

set_run_as_baseline
close_run
create_test_session

Executing Tests

After tests are created for an associated project, there are two ways that they can be executed.

  1. Manually via the UI on the Project Details page

  2. Via the SDK using the create_test_session method