# Knowledge-based test creation

While we expect everyone to use our automated Production test creation capabilities, we also recognize that many users bring significant expertise to their testing experience.  Distributional provides you a suite of test creation tools and patterns that match your needs.

Most tests in dbnl are statistically-motivated to better measure and study fundamentally nondeterministic AI-powered apps.  Means, percentiles, Kolmogorov-Smirnov, and other statistical entities are provided to allow you to study the behavior of your app as you would like.  We provide templates to guide you through our [suggested testing strategies](/v0.23.x/to-be-deleted/testing-strategies.md).

<div align="center" data-full-width="false"><figure><img src="/files/N1EPQapDQLtpcA6AoRje" alt="" width="195"><figcaption><p>Menu of common testing strategies that are supported by templates in dbnl.</p></figcaption></figure></div>

The manual test creation process can be configured in any of three locations: in the main web UI test configuration page, through [shortcuts to the test drawer](/v0.23.x/using-distributional/tests/creating-tests.md#context-driven-test-creation) scattered throughout the web UI, or through the SDK.  This gives you the flexibility to systematically control test generation, or quickly respond to insights for which you would like to test in the future.

The core testing capability is supplemented by the ability to define [filters on tests](/v0.23.x/using-distributional/tests/creating-tests/using-filters-in-tests.md).  These filters empower you to test for consistency within subsets of your user base.  Filtering also allows you to test for bias in your app and help triage cases of undesired behavior.

Learn more about how to create your own tests [here](/v0.23.x/using-distributional/tests/creating-tests.md).


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.dbnl.com/v0.23.x/to-be-deleted/stages-in-the-ai-software-development-lifecycle/defining-tests-in-distributional/knowledge-based-test-creation.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.