Unhealthy Test annotations for failed tests
When tests fail against your PR, the results must be triaged. You need to go through each failure, understand what happened, and decide what to do next....
History for Unhealthy Test leaderboards now available
You can now view Unhealthy Test lists for previous weeks in the Launchable web app. Previously, only the most recent week was available. This improvement...
New UI for creating notification subscriptions in Slack
The Launchable Slack app sends you notifications about the test sessions you care about. For example, you can create a subscription for all test sessions run...
Webapp
Predictive Test Selection
Quickly view selected tests
You can now navigate directly to the list of tests that Predictive Test Selection selected for a test session. In any test session list view, open the...
Give names to your test sessions
Sometimes you want to correlate the data you see in Launchable with the CI process that it came from. Usually, this involves navigating your CI system, which...
Webapp
CLI
Predictive Test Selection
Link builds and test sessions to your existing tools
Launchable's object model -- specifically "builds" and "test sessions" -- map to concepts in your existing tools. For example, both builds and test sessions...
Webapp
CLI
Predictive Test Selection
Insights
New: Keep flaky tests out of your test runs
If you use Predictive Test Selection to intelligently shorten your developers' test sessions and provide faster feedback but flaky tests are slowing them...
More Insights on the Unhealthy Tests page: Longest Tests and Most Failed Tests
Following on from our previous announcement of the new Unhealthy Tests page, we've added two new Insight tables to the page: Longest Tests and Most Failed...
Webapp
Predictive Test Selection
Higher resolution Confidence curves
We recently increased the data resolution of Confidence curves in the Launchable webapp. This makes it easier to choose the ideal optimization target for...
Introducing "Unhealthy Tests" insights, including Never Failing Tests
Tests are hard to maintain. Once you write them, they have tendency to stick around, even when it’s no longer clear what value they provide, or when they are...
New: GitHub Action for sending data to your Launchable workspace
Sending your build and test info to your Launchable workspace unlocks all of Launchable's benefits. If you use GitHub Actions, the new Record build and test...
Webapp
CLI
Predictive Test Selection
Insights
View recorded builds in Launchable
Recording builds is one of the two key steps in sending your test data to Launchable. To support this process you can now view all your recorded builds in...
Webapp
Predictive Test Selection
View which tests Predictive Test Selection chose for a test session
You can now view the input test list and output subset/rest test lists for your test sessions on the Predictive Test Selection - Analyze Test Session page....
CLI
Predictive Test Selection
Insights
Support for recording JUnit XML reports with the CLI's "raw" profile
CLI v1.55.0 introduces the ability for the raw profile to accept JUnit XML reports as input for launchable record tests . This change removes the requirement...
Webapp
Predictive Test Selection
View monthly time savings from Predictive Test Selection
Predictive Test Selection is all about saving time without introducing risk. To that end, you can now see how much test time Predictive Test Selection saves...
Webapp
Predictive Test Selection
View input test lists for test sessions with subset requests
You can now view the combined input test lists for test sessions with subset requests. This list is shown on the Predictive Test Selection - Analyze Test...
Webapp
Predictive Test Selection
View time savings for Predictive Test Selection test sessions
You can now view time savings values for every test session that used Predictive Test Selection (subsets). The value is shown in the Subset Impact section of...
Webapp
Predictive Test Selection
Observe Predictive Test Selection behavior before you roll out Launchable
Sometimes teams want to observe the potential impact and behavior of running Predictive Test Selection subsets in a real environment before they enable...
Webapp
Predictive Test Selection
Subset impact and integration issues on the Test Sessions page
When we released the Predictive Test Selection - Analyze Test Session page, we introduced a new component called Subset Impact . This component gives you a...
Total duration for flaky tests
Since flaky tests are often retried multiple times, this adds up to lots of extra time running tests. To show this, the Flaky Tests page has a new column...