Changelog

Webapp

Improved stderr/stdout display for test results

The Launchable CLI now captures and displays stderr/stdout from more test runners. The captured output is shown on the test session details page in the...

May 24, 2023

Webapp Predictive Test Selection

Altitude-specific labels for subset inputs/outputs

To run a subset of tests, you pass the returned subset list into your test runner for execution. Each test runner has a distinct method for running a...

May 22, 2023

CLI

Support for dotnet test

The Launchable CLI now supports dotnet test. See https://www.launchableinc.com/docs/resources/integrations/dotnet-test/ for more information.

May 16, 2023

Webapp Predictive Test Selection

Updated integration issue rules for non-observation sessions

A PTS integration issue will no longer be shown if extra tests are recorded to a non-observation test session. An integration issue will still be shown if...

May 12, 2023

Webapp

Export test session list as CSV

You can now export the test sessions page as a CSV for analysis in other tools. The CSV includes details about the most recent 1,000 recent test sessions....

April 27, 2023

Webapp Predictive Test Selection

Navigate directly to the PTS Analyze page for a test session

We've redesigned the Predictive Test Selection summary shown on each test session to include a link to the Analyze page for that test session. You can...

April 26, 2023

CLI

CLI support for the Android Compatibility Test Suite (CTS)

The Launchable CLI now supports the Compatibility Test Suite test runner. Note that this profile only supports Zero Input Subsetting.

April 10, 2023

Notifications

Unhealthy Test annotations in Slack messages

The list of failed tests in test session Slack notifications now includes Unhealthy Test Annotations where applicable. You can now quickly see if a failed...

April 6, 2023

Webapp CLI

Links to the build details page in CLI output

The CLI now outputs a link to the build details page in the Launchable web app when you record a build. This is handy for navigating to all test sessions...

April 4, 2023

Webapp

Unhealthy Test annotations for failed tests

When tests fail against your PR, the results must be triaged. You need to go through each failure, understand what happened, and decide what to do next....

March 21, 2023

Webapp Insights

History for Unhealthy Test leaderboards now available

You can now view Unhealthy Test lists for previous weeks in the Launchable web app. Previously, only the most recent week was available. This improvement...

March 21, 2023

CLI Integrations

More GitHub Actions for Launchable integration

By default, we suggest using the record build and test results action . However, if your build and test processes don't run in the same workflow, you can now...

March 20, 2023

Notifications

New UI for creating notification subscriptions in Slack

The Launchable Slack app sends you notifications about the test sessions you care about. For example, you can create a subscription for all test sessions run...

March 6, 2023

Webapp Predictive Test Selection

Quickly view selected tests

You can now navigate directly to the list of tests that Predictive Test Selection selected for a test session. In any test session list view, open the...

March 6, 2023

Webapp CLI

Give names to your test sessions

Sometimes you want to correlate the data you see in Launchable with the CI process that it came from. Usually, this involves navigating your CI system, which...

March 6, 2023

CLI Predictive Test Selection Insights

Support for the prove test runner for Perl

The Launchable CLI now supports prove, a Perl test runner. See https://www.launchableinc.com/docs/resources/integrations/prove/ for more info.

February 20, 2023

CLI Predictive Test Selection Insights

Record test results and request subsets without recording builds

With the new --no-build option available on the launchable record tests , launchable subset , and launchable subset commands , you can now record test...

February 13, 2023

Webapp CLI Predictive Test Selection

Link builds and test sessions to your existing tools

Launchable's object model -- specifically "builds" and "test sessions" -- map to concepts in your existing tools. For example, both builds and test sessions...

January 31, 2023

Webapp CLI Predictive Test Selection Insights

New: Keep flaky tests out of your test runs

If you use Predictive Test Selection to intelligently shorten your developers' test sessions and provide faster feedback but flaky tests are slowing them...

January 13, 2023

Webapp Insights Beta

More Insights on the Unhealthy Tests page: Longest Tests and Most Failed Tests

Following on from our previous announcement of the new Unhealthy Tests page, we've added two new Insight tables to the page: Longest Tests and Most Failed...

January 13, 2023