Agentic QA

Reported by: Oleh B. Issue: Not all checks from the test suite are executed, and the reason is not displayed. Users are confused about why some checks are skipped. Root Cause: Checks are assigned based on page_type matching. If the identified page type doesn't match the check's page_type, the check is not executed. Current Behavior: Checks require specific page_type to execute If page type doesn't match, check is silently skipped No indication in UI that checks were skipped No explanation of why checks weren't assigned Examples: Check configured for "Login Page" won't run on "Home Page" Check with specific page_type won't run if AI identifies page differently No visibility into the page type matching logic Current Workaround: Set page_type to "Any" for checks that should execute on all pages. Shipped Improvement: Show unassigned checks in the UI User Impact: Better understanding of test coverage Reduced confusion about "missing" checks Use Cases: Verify all intended checks are running Optimize check suite coverage

Requested by: Zoltan F. Request: Show real-time progress and status information during check execution so users know the system is working. User Problem: "Is it possible to see some kind of progress what is happening during the checks? For first I thought something is wrong and the application doing nothing. (Finally I got result)" Previous Behavior: No progress indication during execution Users thought system was frozen or not working Had to wait for completion to see if anything happened Poor user experience for long-running checks What Was Implemented: New design shows: More detailed information for running tests Progress indicators Current execution status Dynamic updates as test progresses Impact: Eliminated confusion about system status Users can see real-time progress Better understanding of what's happening Improved confidence in the system Related Issues: "Session Shows 0 Checks During Execution" (also fixed with new design)

Requested by: Zoltan F. Problem: Current screenshot viewing experience is frustrating and slows down debugging workflow. Current Behavior: Click on "Before" screenshot Opens in new tab Go back to original tab Click on "After" screenshot Opens in another new tab Manually compare between tabs User Feedback: "Is it possible to make the pics bigger without clicking on it and open them in new tab? Sorry to say that but it is frustrating somehow to click on the before pic, go to the new tab, move back and open the after pic etc." User Quote: "Also it would be good if we could go thru on the pictures as a flow with a small description to understand what happened. It would be faster I think." Business Value: Faster debugging workflow Better user experience for test analysis Reduced frustration during check investigation Easier to identify failure points

Issue: "I have installed Agentic QA according to provided instruction and was redirected to the page with login details. But there are valid credentials with mail of another person. Should I use these credentials?" User Confusion: Multiple users were confused when they saw randomly generated credentials that appeared to be another person's real email address (e.g., "eldridge_bauch"). What Was Added: A disclaimer was added to the UI to clarify that the credentials are randomly generated and not associated with any real person. Impact: Eliminated user confusion

Issue: "I cannot create New Check as there is nothing in the drop down. Where can I create new page types for my Check suites?" User Experience Problem: Users spent ~30 minutes trying to figure out that they could type custom values in the page type field, as the dropdown appeared empty and it wasn't clear that manual input was supported. What Was Fixed: Improved field placeholder text Better visual indicators for text input and page type creation capability Page_type any included by default Impact: Reduced user confusion Better user experience for first-time check creation

I would like to have an option to re-run single check executions with or without additional feedback.