Files

5.3 KiB

Test Ready Report

Test Runner

  • Command: .venv/bin/pytest tests/
  • Expected: All tests pass with exit code 0

Coverage Summary

  • 1. Feature Coverage (Tier 1): 29 tests
  • 2. Boundary & Corner (Tier 2): 26 tests
  • 3. Cross-Feature (Tier 3): 5 tests
  • 4. Real-World Application (Tier 4): 5 tests
  • Sanity Checks: 2 tests
  • Challenger/M2 Unit: 7 tests
  • Total: 74 tests

Feature Checklist

1. Create Session

  • Tier 1 (Unit Checks)
    • derive_session_name slug generation checks
    • Workspace-to-slug character translation
    • Invalid workspace path filtering
    • Role parameter sanity validations
    • Session override string generation
  • Tier 2 (Component Checks)
    • Verification of state serialization to YAML schema
    • Isolation home directory structure validation
    • SQLite DB connection verification
    • Concurrency check for database registration lock
    • Database schema validation on write
  • Tier 3 (Integration Checks)
    • Spawn session execution with mock herdr and mock agent
    • TUI readiness wait check
    • Cleanup trap execution on crash
    • Argument validation logic verification
    • Isolation directory creation checks
  • Tier 4 (Real-World Application Scenarios)
    • Standard Agent Session Lifecycle E2E test (Scenario 1)
    • Parallel Session Operations with flock Locking E2E test (Scenario 4)

2. Resume Session

  • Tier 1 (Unit Checks)
    • Workspace UUID resolution order unit tests
    • CLI session ID parser validations
    • Check prioritization (yaml file -> disk scan -> cache)
    • Workspace path boundary check
    • Empty UUID handling logic
  • Tier 2 (Component Checks)
    • Configuration restore verification
    • Environment overrides assertion
    • Integrity check on retrieved SQLite metadata
    • Validation of session ownership verification
    • Config parsing for resume options
  • Tier 3 (Integration Checks)
    • Run resume_session.sh with mock agents
    • Intercept agent command structure inside mock herdr
    • Verify agent receives correct conversation UUID flag
    • Invalid/missing UUID recovery path test
    • Workspace resume CLI args verification
  • Tier 4 (Real-World Application Scenarios)
    • Session Disconnect and Resume E2E test (Scenario 2)

3. Stop Session

  • Tier 1 (Unit Checks)
    • Session name verification check
    • Purge verification confirmations logic
    • Command derivation format validation
    • Timeout calculation helper tests
    • Reason logging serializer test
  • Tier 2 (Component Checks)
    • Safe folder path validation (shutil protection)
    • Database status field mutation serialization
    • Isolation folder cleanup check
    • Lock file release checks on stop
    • Concurrency handling of stop mutations
  • Tier 3 (Integration Checks)
    • Execute stop_session.sh with graceful key delivery (/exit)
    • Fallback to forcible termination (herdr kill-session) check
    • Fallback to PID termination (kill -9) verify
    • Purge files verification on disk (--purge-conversation)
    • CLI flag verification with yes/no confirmation
  • Tier 4 (Real-World Application Scenarios)
    • Standard Agent Session Lifecycle E2E test (Scenario 1)
    • Parallel Session Operations with flock Locking E2E test (Scenario 4)

4. Status Query

  • Tier 1 (Unit Checks)
    • JSON converter unit tests
    • Diff formatter text generators
    • Output alignment tests
    • Table grid column math verify
    • CLI status argument parse tests
  • Tier 2 (Component Checks)
    • Status read locks verification
    • Parsing of drift status classifications
    • Concurrency read protection test
    • Registry YAML-to-JSON structural translation
    • Verification of database read access checks
  • Tier 3 (Integration Checks)
    • Running status.sh with --json
    • Verify console output match formatting rules
    • Verify exit status codes on different states
    • Integration test with reconcile.sh read-only diff emission
    • Verify status command doesn't trigger side effects
  • Tier 4 (Real-World Application Scenarios)
    • Standard Agent Session Lifecycle E2E test (Scenario 1)
    • Drift Detection and Auto-Reconciliation E2E test (Scenario 3)

5. Monitor/Reconcile

  • Tier 1 (Unit Checks)
    • Drift state classification unit tests
    • Signature verification checks
    • Subscription topic parsing tests
    • MQTT message structure validator
    • HMAC validation logic tests
  • Tier 2 (Component Checks)
    • Concurrency lock checks (.mam/monitor.lock)
    • Verify YAML and SQLite database reconciliation logic
    • DB validation on drift updates
    • HMAC signature signature verification
    • SQLite journal mode fallback check (WAL vs DELETE)
  • Tier 3 (Integration Checks)
    • Execute reconcile.sh in single-pass mode (--once)
    • MQTT subscription execution with mock messages
    • Verify auto-termination of orphaned herdr sessions
    • Verify auto-registration of untracked herdr sessions
    • Lock contention handling testing
  • Tier 4 (Real-World Application Scenarios)
    • Drift Detection and Auto-Reconciliation E2E test (Scenario 3)