Organizing Tests

Test Cases & Folders

Create, organize, and manage your test cases

Test cases are the core building blocks of your test suite. Each test case contains a sequence of steps that verify a specific workflow or feature in your application.

Creating a Test Case

  1. Navigate to Test Cases in the sidebar
  2. Click New Test Case
  3. Give it a name that describes the workflow being tested (e.g., "User can complete checkout with credit card")
  4. Add steps to define the test flow

Each test case is automatically assigned a number in the format TC-123. This number is unique within your team and makes it easy to reference test cases in discussions, bug reports, and CI/CD logs.

Folders

Organize test cases into folders to keep your test library manageable as it grows.

  • Create folders from the test cases sidebar
  • Rename or delete folders via the context menu
  • Move test cases between folders using the "Move to Folder" action in the test case menu
  • Nest folders for deeper organization (e.g., Authentication > Social Login)
  • Ungrouped tests appear in a dedicated Ungrouped filter

Test Case Health

QAbyAI automatically tracks the health of each test case based on recent execution history:

Health StatusWhat it means
StableConsistently passing — your test is reliable
FlakyInconsistent results — sometimes passes, sometimes fails
BrokenNo recent passes — needs investigation
RegressingRecently started failing after a period of passing
RecoveringWas broken but has started passing again
NewRecently created, not enough history to classify

Health status helps you prioritize maintenance. Focus on Broken and Regressing tests first, then investigate Flaky tests to improve reliability.

Searching & Filtering

The test cases page provides several ways to find what you need:

  • Search — Find test cases by name or TC number
  • All Tests — View everything
  • Recent — The 10 most recently updated test cases
  • Flaky — Tests with inconsistent results
  • Broken — Tests that are currently failing
  • Regressing — Tests that recently started failing
  • Ungrouped — Tests not assigned to any folder

Adding to Test Suites

Test cases can be added to one or more test suites for organized execution. From a test case, use the "Add to Suite" action to include it in a suite.