Cleaner Ava

Runs ava but adds ability to retry, annotations so that the tests are picked up in github ci, and a helpful summary at the end with the test files that broke via github annotations

Note: The tests in this repo are intentionally failing to test failure github annotations.

Because github supports colors, this will also force ava to use colors (normally disabled because of CI=true)

Usage

cleaner-ava [cleaner-ava-options] [ava-options]

Options:
  --help              Show help                                        [boolean]
  --version           Show version number                              [boolean]
  --retryFlakyTests   Should we retry flaky tests?    [boolean] [default: false]
  --failOnFlakyTests  If a test fails, then passes, fail and indicate that a
                      test is flaky                   [boolean] [default: false]
  --summary           Print a summary of failed tests  [boolean] [default: true]
  --maxFlakyTests     How many failed tests until we decide it's not worth it to
                      attempt to retry?                    [number] [default: 5]

Screenshots

Reporting Flaky Tests to Sentry

To report flaky tests to sentry, configure CLEANER_AVA_FLAKY_PROJECT_NAME and CLEANER_AVA_FLAKY_SENTRY_DSN environment variables.