Quality Gate Rules

Quality gate rules use any of these criteria:

• Severity level threshold – If any test with a severity equal to or higher than the threshold fails, the quality gate rule fails. For example, if the severity threshold is set to 3, test failures of severity 1, 2, or 3 cause this quality gate rule to fail.
• Test pass percentage – If the overall test pass rate is below the set percentage, the quality gate rule fails. For example, if the test pass percentage is 90% and fewer than 90% of the tests in the test suite pass, this quality gate rule fails.
• Check for essential test failures – If any test fails that's marked as essential, the quality gate rule fails.

You can assign quality gate rules to each test suite assigned to a pipeline stage. When a work item is promoted, DevOps Testing runs the test suites and evaluates the quality gate rules. If all quality gate criteria are met, the work items containing the changes are moved to the next pipeline stage. If any criterion isn't met, the test suite run automatically fails.

• Create a Quality Gate Rule
  Create a quality gate rule based on your testing goals. We recommend establishing criteria that are realistic yet strict enough to maintain quality.