chore(conductor): Update test stabilization track based on deep audit
This commit is contained in:
@@ -1,7 +1,7 @@
|
||||
# Specification: Test Suite Stabilization & Consolidation (test_stabilization_20260302)
|
||||
|
||||
## Overview
|
||||
The goal of this track is to stabilize and unify the project's test suite. This involves resolving pervasive `asyncio` lifecycle errors, consolidating redundant testing paradigms (specifically manual GUI subprocesses), ensuring artifact isolation in `./tests/artifacts/`, and implementing functional assertions for currently mocked-out tests.
|
||||
The goal of this track is to stabilize and unify the project's test suite. This involves resolving pervasive `asyncio` lifecycle errors, consolidating redundant testing paradigms (specifically manual GUI subprocesses), ensuring artifact isolation in `./tests/artifacts/`, implementing functional assertions for currently mocked-out tests, and updating documentation to reflect the finalized verification framework.
|
||||
|
||||
## Functional Requirements
|
||||
- **Asyncio Lifecycle Stabilization:**
|
||||
@@ -11,19 +11,25 @@ The goal of this track is to stabilize and unify the project's test suite. This
|
||||
- **Paradigm Consolidation (from testing_consolidation_20260302):**
|
||||
- Refactor integration/visual tests to exclusively use the `live_gui` pytest fixture.
|
||||
- Eliminate all manual `subprocess.Popen` calls to `gui_2.py` in the `tests/` and `simulation/` directories.
|
||||
- Update legacy tests (e.g., `test_gui_events.py`, `test_gui_diagnostics.py`) that still import the deprecated `gui_legacy.py` to use `gui_2.py`.
|
||||
- **Artifact Isolation & Discipline:**
|
||||
- All test-generated files (temporary projects, mocks, sessions) MUST be isolated in `./tests/artifacts/`.
|
||||
- Prevent leakage into `conductor/tracks/` or project root.
|
||||
- **Enhanced Test Reporting:**
|
||||
- Implement structured, sectioned logging in `./tests/logs/` with timestamps.
|
||||
- Implement structured, sectioned logging in `./tests/logs/` with timestamps (consolidating `VerificationLogger` outputs).
|
||||
- **Assertion Implementation:**
|
||||
- Replace `pytest.fail` placeholders with full functional implementation.
|
||||
- **Simulation Regression Fixes:**
|
||||
- Debug and resolve `test_context_sim_live` entry count issues.
|
||||
- **Documentation Updates:**
|
||||
- Update `Readme.md` (Testing section) to explain the new log/artifact locations and the `--enable-test-hooks` requirement.
|
||||
- Update `docs/guide_simulations.md` to document the centralized `pytest` usage instead of standalone simulator scripts.
|
||||
|
||||
## Acceptance Criteria
|
||||
- [ ] Full suite run completes without `RuntimeError: Event loop is closed` warnings.
|
||||
- [ ] No `subprocess.Popen` calls to `gui_2.py` exist in the test codebase.
|
||||
- [ ] No test files import `gui_legacy.py`.
|
||||
- [ ] All test artifacts are isolated in `./tests/artifacts/`.
|
||||
- [ ] All tests previously marked with `pytest.fail` now have passing functional assertions.
|
||||
- [ ] Simulation tests pass with correct entry counts.
|
||||
- [ ] `Readme.md` and `docs/guide_simulations.md` accurately reflect the new testing infrastructure.
|
||||
|
||||
Reference in New Issue
Block a user