Release Notes
Was this helpful?
Was this helpful?
This release includes several new features that allow users to more easily view and diagnose behavioral shifts in their test sessions. Check out , our way of quantifying drift, and create new tests based on the key insights we surface!
Similarity Index: Added initial computation, Likert scale support, history charts, test creation, and UI enhancements.
Metrics System: Introduced metric APIs, creation forms, and computation jobs
UI/UX:
Key Insights and summary detail view improvements
Summary chips, tooltips, sortable tables
Various UI and UX improvements, including column metrics pages and test creation shortcuts
Schema & Typing:
Parametrized type handling in UI
Improved type system: to_json_value, nullability, JSON unnesting
Schema unification
Helm & Dependency Management:
Updated helm charts and lock files
Repinned/upgraded Python and JS dependencies (e.g., alembic, ruff, identify)
UI/UX:
Improved Summary Tab and Test Session views
Fixed overlay defaults, sorted metrics table, and chart tooltips
Responsive layout tweaks and consistent styling
General improvements:
Code quality, cleanup (deprecated / legacy code), and improved organization
UI/UX: Fixed navigation issues, loading states, pagination, and flaky links.
Infrastructure: Resolved Helm/chart/tagging issues, GitHub Actions bugs, and sandbox setup problems.
Testing: Addressed test failures and integration test inconsistencies.
RunConfig or RunSchema for Runs (defaults to RunSchema on infer)
Integrated metrics into the RunSchema object
RunConfigdeprecated for future releases
Enabled metric creation and deletion
Added wait_for_run_close utility (now default behavior)
Improved command-line feedback and error handling (e.g., Docker not running)
Removed support for legacy types and deprecated DBNL_API_HOST
Adjusted version bounds for numpy and spacy
Fixed multiple issues with publishing wheels and builds
Improved SDK integration tests (including wait_for_close)
Cleaned up comments and enhanced docstrings
This patch release adds a critical bug fix to the sandbox authentication flow.
Fix a bug with the sandbox authentication flow that resulted in credentials being considered invalid
This release adds a sandbox environment with the dbnl platform which can be deployed to a single machine. Contact us for access!
New Sandbox deployment option
Support for RunSchema on Run creation in the API
Add install option to set dev tokens expiration policy
Link to versioned documentation from the UI
Terms of service updates
Remove link to "View Test Analysis" page
[UI] Only allow closed runs when selecting a default run for comparison in UI
[UI] Allow selecting more than 10 columns in test session summary page
[SDK] Fixed default namespace in URL for project upon get_or_create
New SDK CLI interface
Changes in minimum and maximum versions for some libraries (pyarrow, numpy, spacy)
This release adds a number of new features, improvements, and bug fixes.
New Test History feature in Test Spec detail page that enables users to understand a single tests' behavior over time, including its recalibration history
Added support for Slack notifications in UI
Close runs in the UI
Viewable dbnl version in sidebar
UI performance improvements
Update color of links
Preserve input expressions in test spec editor
Extend scope of Project export
Export Tags by name for Project export
Better error messages for Project import
Improve namespace support for multi-org users
Miscellaneous package updates
Validate results on run close
/projects redirects to home page
Fix broken pagination
Fix broken Histogram title
Fix Results Table rendering issue for some Tests
Fix support for decimal values in assertion params
Fix rendering of = and != Assertions
Test spec editor navigation bugfix
Check compatibility with API version
Add support for double and long values
Improved errors for invalid API URL configuration
Remove en-core-web-sm from requirements to enable PyPI support
Updated helm-charts for on-prem
Highlights in this version:
Improvements to the project import/export feature including support for notifications.
Support for new versioning and release process.
Better dependency management.
Too many bug fixes and UX improvements to list in detail.