Check Execution Prioritization and Ordering
A
AgenticQA Feedback Bot
Requested by:
Zoltan F.Request:
Add priority field to checks to enable prioritized execution and better control over check execution order.
Current Problem:
- No option to specify check execution order
- All checks run in parallel with no control over sequencing
- Cannot prioritize critical checks for faster feedback
- Risk of "endless checks" problem with large check suites
Proposed Solutions:
Option 1: Sequential Ordering
- Add order field to checks
- Execute checks one by one in specified order
Option 2: Priority-Based Execution (Preferred)
- Add priority levels (P1, P2, P3)
- Execute checks by priority (top priority first)
- Supports parallel execution within same priority level
- All checks could be P1 if needed
- More lightweight and flexible than strict ordering
Use Cases:
- Run critical checks first for faster feedback on key functionality
- Better resource management for large check suites
- Control execution flow for dependent checks
Business Value:
- Faster feedback loops for critical checks
- Reduced waiting time for essential test results
- Better resource allocation
- Prevents issues with unlimited parallel execution
Current Workaround:
Include complete flow in a single check to control execution sequence within that check.
Quotes:
"Is it possible to add prio field to the check list? With that top prio would run first to get feedback faster (as I see the tests run parallel)"
"I think check suite is great idea but it must be limited somehow to be able to manage the scenarios and manage and separate the requirements and their coverage. From execution point it is also recommended to have some kind of prioritized execution or limit what could we execute parallel. Endless checks are dangerous item as I see."