85 lines
2.7 KiB
Markdown
85 lines
2.7 KiB
Markdown
# QA Results: Agent Capability Boundaries
|
|
|
|
## Summary
|
|
|
|
All QA pass criteria met. Zero failures.
|
|
|
|
## Results
|
|
|
|
### Library Unit Tests
|
|
|
|
```
|
|
cargo test --manifest-path tidal/Cargo.toml --lib
|
|
test result: ok. 1367 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 4.90s
|
|
```
|
|
|
|
### New Integration Tests
|
|
|
|
```
|
|
cargo test --manifest-path tidal/Cargo.toml --test m10_agent_capability
|
|
running 17 tests
|
|
test schema_build_fails_read_signal_conflict ... ok
|
|
test schema_build_fails_unknown_read_signal ... ok
|
|
test schema_build_fails_unknown_profile_override ... ok
|
|
test profile_override_disallowed_fails ... ok
|
|
test read_allowed_signal_succeeds ... ok
|
|
test overrides_rejected_incremented ... ok
|
|
test read_without_session_unrestricted ... ok
|
|
test read_disallowed_signal_fails_not_allowed ... ok
|
|
test audit_log_records_read_denial ... ok
|
|
test attribute_read_disallowed_fails ... ok
|
|
test empty_policy_no_regression ... ok
|
|
test attribute_read_denied_by_deny_list ... ok
|
|
test attribute_read_allowed_succeeds ... ok
|
|
test signals_rejected_incremented_on_read_denial ... ok
|
|
test read_denied_signal_fails_denied ... ok
|
|
test profile_override_allowed_proceeds ... ok
|
|
test schema_sentinel_star_allows_all_profiles ... ok
|
|
test result: ok. 17 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s
|
|
```
|
|
|
|
### Format Check
|
|
|
|
```
|
|
cargo fmt --manifest-path tidal/Cargo.toml --check
|
|
(no output — format is clean)
|
|
```
|
|
|
|
### Clippy
|
|
|
|
```
|
|
cargo clippy --manifest-path tidal/Cargo.toml -- -D warnings
|
|
Finished `dev` profile [unoptimized + debuginfo] target(s) in 2.34s
|
|
(no warnings — clean)
|
|
```
|
|
|
|
### Prior UAT Suites (Regression)
|
|
|
|
```
|
|
cargo test --manifest-path tidal/Cargo.toml --test m5_uat
|
|
test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.27s
|
|
|
|
cargo test --manifest-path tidal/Cargo.toml --test m6_uat
|
|
test result: ok. 9 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.14s
|
|
|
|
cargo test --manifest-path tidal/Cargo.toml --test m7_uat --features test-utils
|
|
test result: ok. 10 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 6.86s
|
|
```
|
|
|
|
## Pass/Fail Against QA Plan Criteria
|
|
|
|
| Criterion | Result |
|
|
|---|---|
|
|
| All unit tests in `session/policy.rs` pass | PASS |
|
|
| All 17 integration tests in `m10_agent_capability.rs` pass | PASS |
|
|
| Full library test suite (1367 tests) passes with no regressions | PASS |
|
|
| `cargo clippy -D warnings` clean | PASS |
|
|
| `cargo fmt --check` clean | PASS |
|
|
| M5 UAT suite green (9 tests) | PASS |
|
|
| M6 UAT suite green (9 tests) | PASS |
|
|
| M7 UAT suite green (10 tests) | PASS |
|
|
|
|
## Verdict
|
|
|
|
**PASSED** — all 1367 lib tests, 17 new integration tests, 28 UAT regression tests. No failures, no warnings.
|