Predictive Test Selection
Automatically include recently failed tests in subsets
You can now automatically include tests that recently failed in subsets. This helps you verify that you've fixed a failing test. For example, if a test fails...
Automatic Organization Discovery
Automatic Organization Discovery is now available. This feature allows users on the same email domain to automatically join a specified Launchable...
Improved stderr/stdout display for test results
The Launchable CLI now captures and displays stderr/stdout from more test runners. The captured output is shown on the test session details page in the...
Webapp
Predictive Test Selection
Altitude-specific labels for subset inputs/outputs
To run a subset of tests, you pass the returned subset list into your test runner for execution. Each test runner has a distinct method for running a...
The Launchable CLI now supports dotnet test. See https://www.launchableinc.com/docs/resources/integrations/dotnet-test/ for more information.
Webapp
Predictive Test Selection
Updated integration issue rules for non-observation sessions
A PTS integration issue will no longer be shown if extra tests are recorded to a non-observation test session. An integration issue will still be shown if...
Export test session list as CSV
You can now export the test sessions page as a CSV for analysis in other tools. The CSV includes details about the most recent 1,000 recent test sessions....
Webapp
Predictive Test Selection
Navigate directly to the PTS Analyze page for a test session
We've redesigned the Predictive Test Selection summary shown on each test session to include a link to the Analyze page for that test session. You can...
CLI support for the Android Compatibility Test Suite (CTS)
The Launchable CLI now supports the Compatibility Test Suite test runner. Note that this profile only supports Zero Input Subsetting.
Unhealthy Test annotations in Slack messages
The list of failed tests in test session Slack notifications now includes Unhealthy Test Annotations where applicable. You can now quickly see if a failed...
Links to the build details page in CLI output
The CLI now outputs a link to the build details page in the Launchable web app when you record a build. This is handy for navigating to all test sessions...
Unhealthy Test annotations for failed tests
When tests fail against your PR, the results must be triaged. You need to go through each failure, understand what happened, and decide what to do next....
History for Unhealthy Test leaderboards now available
You can now view Unhealthy Test lists for previous weeks in the Launchable web app. Previously, only the most recent week was available. This improvement...
More GitHub Actions for Launchable integration
By default, we suggest using the record build and test results action . However, if your build and test processes don't run in the same workflow, you can now...
New UI for creating notification subscriptions in Slack
The Launchable Slack app sends you notifications about the test sessions you care about. For example, you can create a subscription for all test sessions run...
Webapp
Predictive Test Selection
Quickly view selected tests
You can now navigate directly to the list of tests that Predictive Test Selection selected for a test session. In any test session list view, open the...
Give names to your test sessions
Sometimes you want to correlate the data you see in Launchable with the CI process that it came from. Usually, this involves navigating your CI system, which...
CLI
Predictive Test Selection
Insights
Support for the prove test runner for Perl
The Launchable CLI now supports prove, a Perl test runner. See https://www.launchableinc.com/docs/resources/integrations/prove/ for more info.
CLI
Predictive Test Selection
Insights
Record test results and request subsets without recording builds
With the new --no-build option available on the launchable record tests , launchable subset , and launchable subset commands , you can now record test...
Webapp
CLI
Predictive Test Selection
Link builds and test sessions to your existing tools
Launchable's object model -- specifically "builds" and "test sessions" -- map to concepts in your existing tools. For example, both builds and test sessions...