agentic-qa · QA report

run #22 · c387b32 · repository

Open the Playwright report →

Release assessment: 🟡 CONDITIONAL GO

164 test runs · 164 passed · 0 failed · 0 flaky · 0 skipped · 1 known-defect tests (expected to fail) · pass rate 100.0 %

Residual risks

Risk Mitigation
Open low defect DEF-001: Checkout refuses a lower-case country code (FEAT-CHECKOUT) Release note / known issue; schedule the fix

Features

Feature Criticality Tests Failed Flaky Open defects Status
FEAT-AUTH: Accounts and sign-in 4 37 0 0 - healthy
FEAT-CART: Shopping cart 4 42 0 0 - healthy
FEAT-CATALOG: Catalog browsing and search 3 25 0 0 - healthy
FEAT-CHECKOUT: Checkout and payment 5 27 0 0 DEF-001 at risk
FEAT-COUPON: Coupons 3 21 0 0 - healthy
FEAT-ORDERS: Order history and cancellation 4 28 0 0 - healthy

Sign-off

Traceability

Item Title Weight Passing Manual cases (last run) Open defects
✅ FEAT-AUTH Accounts and sign-in criticality 4 37/37 TC-AUTH-001, TC-AUTH-002, TC-AUTH-003, TC-AUTH-004 (not run) -
✅ FEAT-CART Shopping cart criticality 4 42/42 TC-CART-001, TC-CART-002 (not run) -
✅ FEAT-CATALOG Catalog browsing and search criticality 3 25/25 TC-CAT-001, TC-CAT-002 (not run) -
✅ FEAT-CHECKOUT Checkout and payment criticality 5 26/26 TC-CHK-001, TC-CHK-002, TC-CHK-003 (not run) DEF-001
✅ FEAT-COUPON Coupons criticality 3 21/21 TC-COUP-001, TC-COUP-002, TC-COUP-003 (not run) -
✅ FEAT-ORDERS Order history and cancellation criticality 4 28/28 TC-ORD-001, TC-ORD-002 (not run) -
✅ BR-CART-02 Never more than the stock critical 7/7 TC-CAT-002 (not run) -
✅ BR-ORD-03 Customers see only their own orders critical 5/5 - -
✅ BR-PAY-01 Card validation critical 7/7 TC-CHK-001, TC-CHK-003 (not run) -
✅ BR-AUTH-01 Password policy high 9/9 TC-AUTH-002 (not run) -
✅ BR-AUTH-02 Lockout after five failed sign-ins high 2/2 TC-AUTH-003 (not run) -
✅ BR-CART-01 1 to 10 units per cart line high 9/9 TC-CART-001 (not run) -
✅ BR-COUP-04 Discount caps high 3/3 - -
✅ BR-ORD-01 Only placed orders can be cancelled high 11/11 TC-ORD-001, TC-ORD-002 (not run) -
✅ BR-ORD-02 Cancelling restocks the items high 3/3 TC-ORD-001 (not run) -
✅ BR-SHIP-01 Free shipping from $50 high 7/7 TC-CHK-002 (not run) -
✅ BR-COUP-01 One coupon per cart medium 1/1 - -
✅ BR-COUP-02 Coupon minimum subtotal medium 4/4 TC-COUP-001, TC-COUP-002 (not run) -
✅ BR-COUP-03 Expired coupons are refused medium 4/4 TC-COUP-003 (not run) -

✅ Every business rule is verified.

Defect triage

Defect Status Severity Priority (suggested / recorded) Blocker Age Duplicates? Pinned by Next
DEF-001: Checkout refuses a lower-case country code confirmed low P3 / P3 no 2 d - tests/api/endpoints/orders.spec.ts › POST /api/orders › DEF-001 accepts a lower-case country code Fix

Metrics