conductor(tracks): Add Test Regression Verification track
This commit is contained in:
@@ -86,6 +86,9 @@ This file tracks all major tracks for the project. Each track has its own detail
|
||||
|
||||
### Misc Side-tracks
|
||||
|
||||
21. [~] **Track: Test Regression Verification**
|
||||
*Link: [./tracks/test_regression_verification_20260307/](./tracks/test_regression_verification_20260307/)*
|
||||
|
||||
20. [x] **Track: Enhanced Context Control & Cache Awareness**
|
||||
*Link: [./tracks/enhanced_context_control_20260307/](./tracks/enhanced_context_control_20260307/)*
|
||||
|
||||
|
||||
@@ -0,0 +1,36 @@
|
||||
# Implementation Plan: Test Regression Verification (test_regression_verification_20260307)
|
||||
|
||||
> **Reference:** [Spec](./spec.md)
|
||||
|
||||
## Phase 1: Test Discovery
|
||||
Focus: Find all test files
|
||||
|
||||
- [ ] Task 1.1: List all test files
|
||||
- Run: `pytest --collect-only`
|
||||
- Document test count
|
||||
|
||||
## Phase 2: Run Tests
|
||||
Focus: Execute full test suite
|
||||
|
||||
- [ ] Task 2.1: Run unit tests (models, conductor)
|
||||
- [ ] Task 2.2: Run GUI tests
|
||||
- [ ] Task 2.3: Run integration tests
|
||||
|
||||
## Phase 3: Analyze Results
|
||||
Focus: Review test outcomes
|
||||
|
||||
- [ ] Task 3.1: Document pass/fail counts
|
||||
- [ ] Task 3.2: Identify any failures
|
||||
- [ ] Task 3.3: Determine if regressions or pre-existing
|
||||
|
||||
## Phase 4: Fix Failures (if any)
|
||||
Focus: Resolve test issues
|
||||
|
||||
- [ ] Task 4.1: Fix regressions from recent changes
|
||||
- [ ] Task 4.2: Document pre-existing failures
|
||||
|
||||
## Phase 5: Verification
|
||||
Focus: Confirm 0 regressions
|
||||
|
||||
- [ ] Task 5.1: Re-run tests after fixes
|
||||
- [ ] Task 5.2: Final verification
|
||||
@@ -0,0 +1,47 @@
|
||||
# Track Specification: Test Regression Verification (test_regression_verification_20260307)
|
||||
|
||||
## Overview
|
||||
Verify that all existing tests pass with 0 regressions after recent track implementations (Kill/Abort, Block/Unblock, Pause/Resume, Per-Ticket Model Override).
|
||||
|
||||
## Recent Changes
|
||||
|
||||
### Tracks Implemented Recently
|
||||
1. **Kill/Abort Running Workers** - Added worker termination with abort events
|
||||
2. **Manual Block/Unblock Control** - Added manual block with cascade
|
||||
3. **Pipeline Pause/Resume** - Added global pause/resume
|
||||
4. **Per-Ticket Model Override** - Added model selection per ticket
|
||||
|
||||
## Current Test Status
|
||||
|
||||
### Known Test Files
|
||||
- tests/test_conductor_engine_abort.py
|
||||
- tests/test_conductor_abort_event.py
|
||||
- tests/test_run_worker_lifecycle_abort.py
|
||||
- tests/test_gui_kill_button.py
|
||||
- tests/test_manual_block.py
|
||||
- tests/test_pipeline_pause.py
|
||||
- tests/test_per_ticket_model.py
|
||||
- And many more in tests/
|
||||
|
||||
## Requirements
|
||||
|
||||
### FR1: Full Test Suite Run
|
||||
- Run ALL tests in tests/ directory
|
||||
- Verify no regressions introduced
|
||||
|
||||
### FR2: Test Categories
|
||||
- Unit tests for models, conductor, gui
|
||||
- Integration tests (if any)
|
||||
- Simulation tests
|
||||
|
||||
### FR3: Fix Any Failures
|
||||
- If tests fail, investigate and fix
|
||||
- Document any pre-existing failures
|
||||
|
||||
### FR4: Test Coverage Verification
|
||||
- Ensure new features have test coverage
|
||||
|
||||
## Acceptance Criteria
|
||||
- [ ] All tests pass
|
||||
- [ ] No new regressions
|
||||
- [ ] Test results documented
|
||||
Reference in New Issue
Block a user