Phase 6 — Master Test Plan + Defect Log

Field Value
Project Nova — NovaEnergy HR Virtual Assistant
Owner Dmtrii Drugov — Chatbot PO
Phase UAT prep (Sprint 3) + production audit (post-launch)
Test scenarios in scope 87
Status v1.0 — ready for execution

1. Test strategy

1.1 Layered approach

Three layers, each with different goals.

Layer Goal Owner Frequency Pass bar
Unit tests (intent-level) Each intent answers correctly in isolation AI Engineer Per build 100%
Cross-intent tests System behavior — routing, fallbacks, language switching, classifier ordering Chatbot PO + QA Pre-UAT, weekly post-launch ≥95%
End-to-end UAT Real-world conversations from Bence and Katalin perspective HR Ops + 2 pilot users Sprint 3 + post-launch weekly sample CSAT ≥4.0

1.2 Out of scope

1.3 Test data strategy

Two test user profiles in dev tenant (TD-02 from backlog):

Mock user Maps to persona Profile attributes
[email protected] Bence — new hire Department: Commercial · Probation: true · Manager: assigned · Lang: HU primary
[email protected] Katalin — line manager Department: Operations · Probation: false · Direct reports: 6 · Lang: HU only

Edge profiles for specific tests:


2. Master test scenarios (87 total)