Option to selectively re-run only failed tests in CI pipeline

Currently, I haven’t found a way to re-run only the failed spec files (test scenarios) when manually or automatically triggering a test job in the CI pipeline. Here’s the context and the desired behavior:

  1. A branch is created in GitHub. The CI pipeline runs a set of jobs and checks for each pull request. Once Vercel finishes building an instance of the application from that branch, the test job is triggered automatically.

  2. During test execution, some tests may fail. However, these failures don’t always indicate actual issues — sometimes they occur due to temporary latency or environmental instability.

  3. It’s possible to manually re-trigger the test job, but Checkly currently re-runs all tests (spec files) instead of only re-running those that previously failed.

It would be very helpful to have an option or configuration that allows:

  • Re-running only the failed tests from the last execution, or

  • Re-running the full test suite, depending on the user’s preference.

This feature would significantly reduce execution time and improve workflow efficiency when verifying transient or environment-related test failures.

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board

💡 Feature Request

Date

4 months ago

Author

Viktar Zhuk

Subscribe to post

Get notified by email when there are changes.