2026-02-14 15:26:42 +01:00
|
|
|
# Test Matrix
|
|
|
|
|
|
|
|
|
|
All IDs are mandatory unless explicitly marked non-blocking with sign-off.
|
|
|
|
|
|
|
|
|
|
## Unit Tests
|
|
|
|
|
|
|
|
|
|
| ID | Area | Scenario | Expected |
|
|
|
|
|
|---|---|---|---|
|
|
|
|
|
| U-001 | Transition Engine | legal transition | persisted with audit event |
|
|
|
|
|
| U-002 | Transition Engine | illegal transition | typed validation error |
|
|
|
|
|
| U-003 | Routing | multiple rule match | deterministic priority winner |
|
|
|
|
|
| U-004 | Filtering Gates | missing required docs | blocked before AI pass |
|
|
|
|
|
| U-005 | AI Banding | uncertain confidence band | routed to manual queue |
|
|
|
|
|
| U-006 | Assignment | COI conflict | excluded from pool |
|
|
|
|
|
| U-007 | Assignment | insufficient capacity | overflow flagged + coverage preserved |
|
|
|
|
|
| U-008 | Override | missing reason fields | mutation rejected |
|
|
|
|
|
| U-009 | Live Cursor | concurrent cursor update | conflict handled and retried |
|
|
|
|
|
| U-010 | Award Governance | `AWARD_MASTER` on unauthorized award | forbidden |
|
|
|
|
|
|
|
|
|
|
## Integration Tests
|
|
|
|
|
|
|
|
|
|
| ID | Area | Scenario | Expected |
|
|
|
|
|
|---|---|---|---|
|
|
|
|
|
| I-001 | Pipeline CRUD | create/update/publish | graph integrity maintained |
|
|
|
|
|
| I-002 | Stage Config | invalid config schema | rejected |
|
|
|
|
|
| I-003 | Transition + Routing | filter pass to main + award parallel | dual states created |
|
|
|
|
|
| I-004 | Award Exclusive Routing | exclusive route | removed from main continuation |
|
|
|
|
|
| I-005 | Assignment API | preview vs execute parity | same constraints and outcomes |
|
|
|
|
|
| I-006 | Live Runtime | jump + reorder + open/close windows | consistent cursor state |
|
|
|
|
|
| I-007 | Cohort Voting | closed window submit | vote rejected |
|
|
|
|
|
| I-008 | Decision Audit | override applied | complete immutable timeline |
|
|
|
|
|
|
|
|
|
|
## End-to-End Tests
|
|
|
|
|
|
|
|
|
|
| ID | Persona | Scenario | Expected |
|
|
|
|
|
|---|---|---|---|
|
|
|
|
|
| E-001 | Admin | complete setup via wizard | no hidden edit-only blockers |
|
|
|
|
|
| E-002 | Applicant | upload intake requirements | status and deadlines enforced |
|
|
|
|
|
| E-003 | Admin | run filtering stage | gates + AI + manual queue behave |
|
|
|
|
|
| E-004 | Jury | complete evaluation workflow | criteria and lock policy enforced |
|
|
|
|
|
| E-005 | Admin | selection + override | finalists and audit aligned |
|
|
|
|
|
| E-006 | Live Admin | advance/back/jump + reorder | jury and audience sync realtime |
|
|
|
|
|
| E-007 | Audience | vote by cohort on mobile | visibility and dedupe enforced |
|
|
|
|
|
| E-008 | Admin | finalize results | ranking and publish outputs valid |
|
|
|
|
|
|
|
|
|
|
## Performance and Resilience
|
|
|
|
|
|
|
|
|
|
| ID | Area | Scenario | Threshold |
|
|
|
|
|
|---|---|---|---|
|
|
|
|
|
| P-001 | Assignment | 1000+ project batch | under agreed SLA |
|
|
|
|
|
| P-002 | Filtering | large AI queue | deterministic retry, no dropped jobs |
|
|
|
|
|
| P-003 | Live Voting | peak audience burst | acceptable p95 and no data loss |
|
|
|
|
|
| P-004 | Reconnect | disconnect/reconnect | state converges quickly |
|
|
|
|
|
|
|
|
|
|
## Release Block Rule
|
|
|
|
|
|
|
|
|
|
Any failing `U-*`, `I-*`, `E-*`, or `P-*` is release-blocking unless signed waiver exists.
|
