5.3 KiB
5.3 KiB
Test Ready Report
Test Runner
- Command:
.venv/bin/pytest tests/ - Expected: All tests pass with exit code 0
Coverage Summary
- 1. Feature Coverage (Tier 1): 29 tests
- 2. Boundary & Corner (Tier 2): 26 tests
- 3. Cross-Feature (Tier 3): 5 tests
- 4. Real-World Application (Tier 4): 5 tests
- Sanity Checks: 2 tests
- Challenger/M2 Unit: 7 tests
- Total: 74 tests
Feature Checklist
1. Create Session
- Tier 1 (Unit Checks)
derive_session_nameslug generation checks- Workspace-to-slug character translation
- Invalid workspace path filtering
- Role parameter sanity validations
- Session override string generation
- Tier 2 (Component Checks)
- Verification of state serialization to YAML schema
- Isolation home directory structure validation
- SQLite DB connection verification
- Concurrency check for database registration lock
- Database schema validation on write
- Tier 3 (Integration Checks)
- Spawn session execution with mock
herdrand mock agent - TUI readiness wait check
- Cleanup trap execution on crash
- Argument validation logic verification
- Isolation directory creation checks
- Spawn session execution with mock
- Tier 4 (Real-World Application Scenarios)
- Standard Agent Session Lifecycle E2E test (Scenario 1)
- Parallel Session Operations with flock Locking E2E test (Scenario 4)
2. Resume Session
- Tier 1 (Unit Checks)
- Workspace UUID resolution order unit tests
- CLI session ID parser validations
- Check prioritization (yaml file -> disk scan -> cache)
- Workspace path boundary check
- Empty UUID handling logic
- Tier 2 (Component Checks)
- Configuration restore verification
- Environment overrides assertion
- Integrity check on retrieved SQLite metadata
- Validation of session ownership verification
- Config parsing for resume options
- Tier 3 (Integration Checks)
- Run
resume_session.shwith mock agents - Intercept agent command structure inside mock
herdr - Verify agent receives correct conversation UUID flag
- Invalid/missing UUID recovery path test
- Workspace resume CLI args verification
- Run
- Tier 4 (Real-World Application Scenarios)
- Session Disconnect and Resume E2E test (Scenario 2)
3. Stop Session
- Tier 1 (Unit Checks)
- Session name verification check
- Purge verification confirmations logic
- Command derivation format validation
- Timeout calculation helper tests
- Reason logging serializer test
- Tier 2 (Component Checks)
- Safe folder path validation (shutil protection)
- Database status field mutation serialization
- Isolation folder cleanup check
- Lock file release checks on stop
- Concurrency handling of stop mutations
- Tier 3 (Integration Checks)
- Execute
stop_session.shwith graceful key delivery (/exit) - Fallback to forcible termination (
herdr kill-session) check - Fallback to PID termination (
kill -9) verify - Purge files verification on disk (
--purge-conversation) - CLI flag verification with yes/no confirmation
- Execute
- Tier 4 (Real-World Application Scenarios)
- Standard Agent Session Lifecycle E2E test (Scenario 1)
- Parallel Session Operations with flock Locking E2E test (Scenario 4)
4. Status Query
- Tier 1 (Unit Checks)
- JSON converter unit tests
- Diff formatter text generators
- Output alignment tests
- Table grid column math verify
- CLI status argument parse tests
- Tier 2 (Component Checks)
- Status read locks verification
- Parsing of drift status classifications
- Concurrency read protection test
- Registry YAML-to-JSON structural translation
- Verification of database read access checks
- Tier 3 (Integration Checks)
- Running
status.shwith--json - Verify console output match formatting rules
- Verify exit status codes on different states
- Integration test with
reconcile.shread-only diff emission - Verify status command doesn't trigger side effects
- Running
- Tier 4 (Real-World Application Scenarios)
- Standard Agent Session Lifecycle E2E test (Scenario 1)
- Drift Detection and Auto-Reconciliation E2E test (Scenario 3)
5. Monitor/Reconcile
- Tier 1 (Unit Checks)
- Drift state classification unit tests
- Signature verification checks
- Subscription topic parsing tests
- MQTT message structure validator
- HMAC validation logic tests
- Tier 2 (Component Checks)
- Concurrency lock checks (
.mam/monitor.lock) - Verify YAML and SQLite database reconciliation logic
- DB validation on drift updates
- HMAC signature signature verification
- SQLite journal mode fallback check (WAL vs DELETE)
- Concurrency lock checks (
- Tier 3 (Integration Checks)
- Execute
reconcile.shin single-pass mode (--once) - MQTT subscription execution with mock messages
- Verify auto-termination of orphaned herdr sessions
- Verify auto-registration of untracked herdr sessions
- Lock contention handling testing
- Execute
- Tier 4 (Real-World Application Scenarios)
- Drift Detection and Auto-Reconciliation E2E test (Scenario 3)