bbeee18b68
## Vision Update
- Shift from "code-level truth linter" to "self-learning institutional knowledge"
- Evidence-based authority model: merit over titles
- ProductSpec → 0.95 authority, 1 usage to graduate
- Standard (RFC) → 0.85 authority, 3 usages
- Research (ADR) → 0.70 authority, 5 usages
- Commit only → 0.40 authority, 10 usages
- Three-tier knowledge: Policies → Conventions → Observations
- Knowledge compounds with every commit
## Gap Analysis
- Documented missing features for enterprise pilot
- Phases 11-15 spec with implementation details
- Evidence detection, scope hierarchy, lifecycle management
## Roadmap Additions
- Phase 11: Evidence-Based Authority (🎯 current)
- Phase 12: Knowledge Scope Hierarchy
- Phase 13: Knowledge Lifecycle Management
- Phase 14: Governance Workflows
- Phase 15: Evidence Source Integration
## Enterprise Simulation UAT
- 6-month simulation: 3 teams, 19 contributors
- Month-by-month scenarios with expected outcomes
- Success metrics for 90-day and 180-day milestones
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
|
||
|---|---|---|
| .. | ||
| fixtures | ||
| scripts | ||
| 2026-02-03-benchmark-aphoria-vs-semgrep.md | ||
| 2026-02-03-citadel-scan-v1.md | ||
| 2026-02-03-federated-policy-proposal.md | ||
| 2026-02-03-lessons-learned.md | ||
| 2026-02-03-vulnbank-benchmark.md | ||
| 2026-02-04-full-cycle-precommit-vision.md | ||
| 2026-02-04-masq-unreal-audit.md | ||
| 2026-02-04-uat-plan-unreal.md | ||
| 2026-02-04-uat-policy-source-results.md | ||
| 2026-02-04-uat-policy-source-tracking.md | ||
| 2026-02-04-uat-real-world-policy-source.md | ||
| citadel-scan-v1.md | ||
| comprehensive-vision-uat.md | ||
| enterprise-simulation-uat.md | ||
| future-scenarios.md | ||
| gap-analysis-2026-02-06.md | ||
| README.md | ||
Aphoria User Acceptance Testing
End-to-end validation of Aphoria workflows.
Quick Start
# Run the enterprise workflow UAT
./scripts/test-enterprise-workflow.sh
Comprehensive Vision UAT
Comprehensive Vision UAT Plan - The master plan for validating Aphoria's complete vision:
| Category | Tests | Priority | Status |
|---|---|---|---|
| 1. Core Detection | 10 tests | P0 | In Progress |
| 2. Enterprise Policy | 13 tests | P0-P2 | PASS (existing scripts) |
| 3. Pre-Commit Integration | 11 tests | P0-P1 | Partial |
| 4. LLM Extraction | 8 tests | P1-P2 | Planned |
| 5. Declarative Extractors | 7 tests | P0-P2 | Planned |
| 6. Output Formats | 8 tests | P0 | Partial |
| 7. Domain-Specific Audits | 6 tests | P1-P2 | PASS (Masq) |
| 8. Protocol Vision | 3 tests | P3 | Future |
UAT Reports
| Report | Status | Description |
|---|---|---|
| Comprehensive Vision UAT | Draft | Master plan for full vision validation |
| Gap Analysis | Complete | Code vs UAT gap analysis |
| Policy Source Tracking | PASS | Trust Pack workflow validation |
| Masq Unreal Audit | PASS | Domain-specific (Unreal Engine) |
| Future Scenarios | Planned | Deferred scenarios awaiting enterprise feedback |
Scripts
Existing (Passing)
| Script | Purpose | Status |
|---|---|---|
| test-enterprise-workflow.sh | Full Trust Pack round-trip test | PASS (12/12) |
| test-multi-pack-conflict.sh | Multiple packs, same concept | PASS (7/7) |
| test-pack-version-update.sh | Pack version supersession | PASS (6/6) |
New (Comprehensive Vision)
| Script | Purpose | Category | Priority |
|---|---|---|---|
| test-core-detection.sh | Cross-language detection tests | Cat 1 | P0 |
| test-exit-codes.sh | Exit code validation | Cat 3 | P0 |
CI Integration
The UAT is integrated into CI via .github/workflows/ci.yml:
aphoria-uat:
name: Aphoria Enterprise UAT
runs-on: ubuntu-latest
needs: [check, test]
steps:
- name: Build Aphoria
run: cargo build --release --package aphoria
- name: Run Enterprise Workflow UAT
run: ./applications/aphoria/uat/scripts/test-enterprise-workflow.sh
Adding New UAT Scenarios
- Create
YYYY-MM-DD-uat-{scenario}.mdwith test plan - Add automated script in
scripts/ - Update this README
- Add to CI workflow if needed
Structure
uat/
├── README.md # This file
├── 2026-02-04-uat-real-world-policy-source.md # Policy source tracking UAT
├── future-scenarios.md # Tested & deferred scenarios
└── scripts/
├── test-enterprise-workflow.sh # Basic Trust Pack workflow
├── test-multi-pack-conflict.sh # Multi-pack behavior
└── test-pack-version-update.sh # Version supersession