Commit Graph
100 Commits
Author SHA1 Message Date
ed 0553983ce9 conductor(spec): Clarify --audit --strict semantics in Section 4.3
Default --audit exits non-zero on hard errors only. --strict adds the
'multiple subsystems = probably cross-cutting' heuristic from Section 9
as a CI gate. Two modes, one flag.
2026-06-06 14:16:13 -04:00
ed cbfd78c51d conductor(tracks): Register test_batching_refactor_20260606 in registry 2026-06-06 14:14:11 -04:00
ed b7a9737443 conductor(track): Initialize test_batching_refactor_20260606 spec
Three-tier batching refactor: replace alphabetical 4-at-a-time batching with
fixture-class-isolated tiers (0 opt-in, 1 unit/xdist, 2 mock_app, 3 live_gui
in one session, H headless, P performance).

Hybrid classification: auto-infer from filename + AST fixture scan; hand-curated
tests/test_categories.toml overrides for cross-cutting and ambiguous files.

Opt-in per-test order control via [[files.X.test_order]] sub-tables, gated on
a conftest-loaded pytest plugin (no-op without entries).

Priority order: B (process isolation) > A (subsystem diagnostic) > C (speed).
2026-06-06 14:12:14 -04:00
ed 96158edd97 conductor(plan): mark T1.3 StartupProfiler complete (5a856536) 2026-06-06 13:59:02 -04:00
ed 5a85653654 feat(startup_profiler): add StartupProfiler for per-phase init timing
Lightweight, in-memory profiler for AppController init phases. Used by
the startup_speedup_20260606 track to measure where the time goes
during boot (config hydration, hook server start, subsystem init, etc.).

The profiler is exposed via /api/startup_profile (Phase 8 work) and
the Diagnostics panel so the user can see the exact per-phase cost.

Public API:
  StartupProfiler() - create
  .phase(name) - context manager
  .snapshot() - {phases: {name: {start_ts, duration_ms}}, total_ms, count}
  .reset() - clear recorded phases
  .enable() / .disable() - toggle recording

Implementation:
  - dataclass with list of _Phase(name, start_ts, end_ts)
  - @contextmanager records wall-clock via time.perf_counter
  - records duration even if the body raises (try/finally)
  - snapshot is a copy, so consumers can't mutate the live state

TDD: 5 tests in tests/test_startup_profiler.py cover: basic
recording, total math, snapshot isolation, exception safety, empty
state.
2026-06-06 13:57:26 -04:00
ed f2f5ee1197 conductor(plan): flip track from lazy-loading to proactive warmup
Architectural shift driven by user clarification: lazy-loading on first
use causes user-perceptible lag when the user-triggered action (e.g.
provider switch) propagates to a controller method that triggers the
first import. The fix is to pre-import heavy modules on a bg thread
at startup and have functions access them via _require_warmed().

Old design (rejected):
  - from google import genai inside _send_gemini (lazy on first call)
  - First user action that triggers this pays the cost; UI feels laggy

New design (this commit):
  - Top-level heavy imports REMOVED from main-thread-reachable files
  - AppController.__init__ submits warmup jobs to _io_pool (4 threads,
    named 'controller-io-N')
  - Each warmup worker imports its module and updates a thread-safe
    warmup_status dict
  - Functions access modules via _require_warmed(name), which assumes
    the module is in sys.modules (warmed at startup)
  - When all jobs complete, _warmup_done_event is set and registered
    on_warmup_complete callbacks fire
  - GUI shows status indicator + toast when warmup completes
  - Hook API exposes /api/warmup_status and /api/warmup_wait
  - Tests can call controller.wait_for_warmup() before exercising
    warmup-dependent functionality

Phase 2 now bundles job pool + warmup (T2.3+T2.4 add warmup tests +
implementation). Phases 3-5 do 'remove top-level imports' instead of
'lazy-load'. Phase 7 is the notification surface (Hook API + GUI).
Definition of Done includes warmup-completion criteria, the
'no function-body imports' check, and an end-to-end 'provider switch
is INSTANT' smoke test.

No code changes; this is a planning update only.
2026-06-06 13:45:05 -04:00
ed ca254bac41 fix(imports): break models<->dag_engine circular dependency
Track.get_executable_tickets (in models.py) called TrackDAG at
runtime, forcing a top-level import of src.dag_engine into models.py
and creating a 2-cycle that broke whichever module loaded second
(Ticket was not yet defined when models.py loaded first; TrackDAG
was not yet defined when dag_engine.py loaded first).

Fix: hoist the method out of the Track dataclass and into a free
function get_executable_tickets(track) in dag_engine.py. models.py
no longer needs TrackDAG at all, so the cycle is one-directional
(models -> dag_engine) and resolves cleanly in any import order.

Tests updated:
- tests/test_mma_models.py: import get_executable_tickets and call
  it instead of track.get_executable_tickets() (4 call sites)
- tests/test_conductor_engine_v2.py: comment update

Verified both import orders resolve cleanly:
  forward:  import src.models; import src.dag_engine  -> OK
  reverse:  import src.dag_engine; import src.models  -> OK
34 tests pass (test_mma_models, test_dag_engine, test_execution_engine,
test_arch_boundary_phase3, test_track_state_schema).
2026-06-06 13:30:18 -04:00
ed 32e633b3ec conductor(plan): mark startup_speedup_20260606 track creation committed (cd4fb045) 2026-06-06 13:01:32 -04:00
ed cd4fb04541 conductor(track): create startup_speedup_20260606 track for sloppy.py startup latency
Fulfills the existing backlog entry at conductor/tracks.md:152
(2026-06-05 root-cause analysis of live_gui wait_for_server timeouts).

Main Thread Purity Invariant: the main thread (entering immapp.run())
must never import a module heavier than imgui_bundle and the lean
gui_2 skeleton. Enforced by:
  - static gate: scripts/audit_main_thread_imports.py (CI)
  - runtime hook: tests/test_main_thread_purity.py (sys.addaudithook)

Threading constraint: no new threading.Thread(...) calls in src/.
All background work goes through AppController._io_pool
(ThreadPoolExecutor, max_workers=4, thread_name_prefix='controller-io').

9 phases, 57 tasks: audit+baseline, job pool, lazy-load SDKs, lazy-load
FastAPI, lazy-load feature-gated GUI, migrate ad-hoc threads, runtime
enforcement, hook API + diagnostics, verify+checkpoint.

Expected savings: ~2000-2400ms off main-thread import cost.
Target: import src.ai_client < 50ms (from ~1800ms), live_gui fixtures
no longer time out at wait_for_server(timeout=15).
2026-06-06 12:57:20 -04:00
ed 2adf3274af add benchmark scriptr 2026-06-06 12:47:41 -04:00
ed 311fde9a8b fixes 2026-06-06 12:44:07 -04:00
ed 9ccaf0594c some org on ai_client 2026-06-06 11:35:20 -04:00
ed 9d72d98b50 conductor(tracks): mark rag_phase4_stress_test_flake resolved (commit 16412ad5) 2026-06-06 11:29:03 -04:00
ed 16412ad5f9 fix(rag): detect ChromaDB dim mismatch and recreate collection on provider switch 2026-06-06 11:26:47 -04:00
ed 339b062913 more organization 2026-06-06 11:08:07 -04:00
ed 7d555361f9 more organization 2026-06-06 10:24:22 -04:00
ed 1c627bcc30 fix(docs): correct section order in guide_testing (patterns before See Also) + fix LF/CRLF 2026-06-06 09:34:38 -04:00
ed 0f742b1d5f conductor(workflow): add Indentation-Driven Class Method Visibility pitfall (2026-06-05) 2026-06-06 02:04:05 -04:00
ed e276bac093 docs(gui_2): add __getattr__/__setattr__ delegation pattern + indentation gotcha 2026-06-06 01:59:20 -04:00
ed 4ee22dedb9 docs(testing): add Narrow Test Paths + Indentation-Driven Method Visibility patterns 2026-06-06 01:53:25 -04:00
ed e7b8877f2a docs(readme): update for v2 completion (24 guides, 273 test files, 98.9% pass rate) 2026-06-06 01:42:45 -04:00
ed 5e0b6bbfd3 conductor(tracks): queue RAG test flake as new backlog item; mark prior_session complete 2026-06-06 01:35:21 -04:00
ed 008179360f conductor(index): v2 recently shipped, all 4 live_gui failures resolved 2026-06-06 01:30:03 -04:00
ed 9a3831897b conductor(tracks): mark live_gui_test_hardening_v2 complete (root cause was indent, not state sync) 2026-06-06 01:28:02 -04:00
ed 26e0ced4d9 test(prior_session): refactor to narrow render_prior_session_view (50+ mocks -> 20) 2026-06-06 01:12:29 -04:00
ed 11f8772401 docs(spec): live_gui_state_sync — REAL root cause is bad indent in _capture_workspace_profile 2026-06-06 01:08:07 -04:00
ed c4691a54b0 fking python 2026-06-06 01:05:00 -04:00
ed 6c541bc788 move track mds to tracks 2026-06-06 00:42:40 -04:00
ed e670fc1c3e more org 2026-06-06 00:40:07 -04:00
ed 053f5d867a some organization pass, still need to review a bunch 2026-06-06 00:21:36 -04:00
ed f8b0a1243d add note aobut hook helpers... 2026-06-05 23:03:45 -04:00
ed 7785f09fa9 Some organizing of the api_hook_client.py 2026-06-05 23:02:41 -04:00
ed 5c23ad190d conductor(tracks): link v2 to 4 sub-track specs and plans 2026-06-05 22:56:55 -04:00
ed 3e52f20d16 docs(spec+plan): undo_redo_lifecycle_fix (3-phase investigation: state-sync vs snapshot vs flake) 2026-06-05 22:49:16 -04:00
ed b692353e98 docs(spec+plan): wait_for_ready_test_pattern (replace time.sleep with polling) 2026-06-05 22:45:14 -04:00
ed 85cd34683a docs(spec+plan): prior_session_test_harden (refactor to narrow render_prior_session_view) 2026-06-05 22:41:46 -04:00
ed 9542c4c750 docs(spec+plan): live-gui state sync (App/Controller single source of truth) 2026-06-05 22:36:55 -04:00
ed aa56981c87 organizing (mostly aggregate.py) 2026-06-05 22:34:26 -04:00
ed 8b83c5d0b7 conductor(index): v2 active, v1 + regression_fixes now in recently-shipped 2026-06-05 22:12:34 -04:00
ed 70c18f92c3 conductor(tracks): mark v1 fragility_fixes complete, queue v2 (state sync + undo_redo + prior_session) 2026-06-05 22:09:30 -04:00
ed 873edf42cf began to go through the files and organize imports and gui_2.py's new context defs
still a bunch to sift through after the last ai passes
2026-06-05 21:44:41 -04:00
ed 1d89fcaf8a update readme 2026-06-05 21:33:06 -04:00
ed ed98481578 update readme with note 2026-06-05 21:32:46 -04:00
ed 1488e71568 docs: add Sentinel type contract note to 3 defer-not-catch sections 2026-06-05 20:31:38 -04:00
ed 0e299140ca conductor(tracks): register live_gui_fragility_fixes + queue prior_session_test_harden follow-up 2026-06-05 20:17:11 -04:00
ed 5692cbef56 test(workspace_profile): add str/bytes TOML serialization contract test 2026-06-05 20:14:39 -04:00
ed cb206b973f docs(spec): defer Change 2 (prior_session test) to separate track; reason + follow-up 2026-06-05 20:12:33 -04:00
ed eb0bd39327 fix(gui_2): use str sentinel not bytes in _capture_workspace_profile 2026-06-05 19:24:12 -04:00
ed 7a0ed74b5c docs(plan): implementation plan for live-gui fragility fixes 2026-06-05 19:20:21 -04:00
ed f6d9c70de8 docs(spec): defer Change 4 doc hardening per user review 2026-06-05 19:15:50 -04:00
ed 0d6dd8dbab docs(spec): design for live-gui fragility fixes (272-file suite: 269/272 -> 272/272) 2026-06-05 19:05:35 -04:00
ed 449a827a82 conductor(tracks): queue sloppy.py startup speedup as new backlog item 2026-06-05 18:53:01 -04:00
ed 9467769260 docs(themes): rewrite authoring guide to match actual API + 8-shipped themes 2026-06-05 18:50:10 -04:00
ed dc691e3de0 docs(workflow): reframe live_gui fragility as authoring-side, not fixture bug 2026-06-05 18:43:58 -04:00
ed 0fec0f4f56 docs(testing): reframe live_gui gotcha as test-authoring contract, not fixture bug 2026-06-05 18:39:33 -04:00
ed 71b0082bbf docs(workflow): add Known Pitfalls section (defer-not-catch, theme bisect anchors, live_gui fragility) 2026-06-05 18:31:14 -04:00
ed 2312965476 docs(gui_2): add Theme Color-Callable Pattern and Workspace Profile Defer-Not-Catch sections 2026-06-05 18:25:29 -04:00
ed 9a6bcb2f34 docs(testing): add Known Gotchas section (live_gui non-determinism + early-render C crash) 2026-06-05 18:21:24 -04:00
ed 2f0c1eb3cc conductor(index): mark regression_fixes active, add multi_themes recently shipped 2026-06-05 18:18:27 -04:00
ed 8663498725 conductor(tracks): register multi_themes ship and regression_fixes checkpoint 2026-06-05 18:12:03 -04:00
ed fcb3f80ac8 docs(root): register guide_themes.md in Documentation and Subsystem tables 2026-06-05 18:09:45 -04:00
ed f63fe68565 docs(index): register guide_themes.md in guides table and file tree 2026-06-05 18:06:12 -04:00
ed db3490a70f conductor(plan): document imgui save_ini crash root cause and fix 2026-06-05 15:12:23 -04:00
ed d7487af424 fix(gui_2): defer save_ini_settings on first capture to avoid early-render crash 2026-06-05 14:57:32 -04:00
ed b0c8589f68 conductor(plan): document root cause - imgui-bundle C-level crash blocks live_gui 2026-06-05 13:47:55 -04:00
ed 1469ecac3a fix(gui_2): call DIR_COLORS/KIND_COLORS entries - they're callable functions 2026-06-05 13:19:48 -04:00
ed 1c6919aafc conductor(plan): update task status - 5 done, 6 deferred pending live_gui 2026-06-05 12:43:33 -04:00
ed c96bdb06ba test(rag_phase4): handle None status before .lower() in error check 2026-06-05 12:38:47 -04:00
ed ac08ee875c fix(log_pruner): shorter retry loop, smaller sleep to avoid blocking startup 2026-06-05 12:26:58 -04:00
ed 970f198ca6 test(view_presets): mock persona_manager in fixture 2026-06-05 11:52:49 -04:00
ed f829d1df17 test(prior_session): mock render_palette_modal, add ui_base_system_prompt fixture 2026-06-05 11:45:42 -04:00
ed df43f158b9 test(gui_phase4): patch markdown_helper imgui/imgui_md to avoid IM_ASSERT 2026-06-05 10:33:38 -04:00
ed 38abf2312f test(gui_progress): adapt to C_LBL/C_VAL function API + theme_2 mock 2026-06-05 10:25:25 -04:00
ed 07d35c9d39 conductor(plan): regression fixes - 21 failures from full suite run 2026-06-05 10:10:29 -04:00
ed a7c4bf01b1 feat(theme): standardize all themes with intelligent row backgrounds and human names 2026-06-05 01:05:17 -04:00
ed 3ed2b3966c fix(theme): robust get_color fallback and Solarized Dark table colors 2026-06-05 01:01:03 -04:00
ed 98acc12811 feat(theme): fix table row backgrounds and hub text contrast 2026-06-05 00:52:28 -04:00
ed e3f8a2b517 fix(theme): correct scope for internal imports in apply function 2026-06-05 00:39:31 -04:00
ed 4041782776 feat(theme): finalize semantic color lift and fix light theme UI elements 2026-06-05 00:29:27 -04:00
ed 7735b6cba7 feat(theme): lift all hardcoded colors and finalize semantic theming 2026-06-05 00:21:19 -04:00
ed 7ea52cbbe8 style(themes): compact TOML formatting and lift semantic colors 2026-06-05 00:02:46 -04:00
ed 06e305aba6 feat(theme): add tone mapping and fix missing palette colors 2026-06-04 23:44:43 -04:00
ed d9d0fea971 refactor(themes): remove hardcoded _PALETTES from theme_2.py 2026-06-04 23:24:19 -04:00
ed ece4d9b5f2 feat(themes): add TOML files for original built-in themes (10x Dark, Nord Dark, Monokai, Binks) 2026-06-04 23:19:12 -04:00
ed 269cdcc365 conductor(checkpoint): Theme & syntax modularization complete 2026-06-04 23:17:23 -04:00
ed 465396675d docs(themes): add authoring guide for TOML theme system 2026-06-04 23:16:21 -04:00
ed 1cb68e4e3f feat(markdown): apply active theme syntax palette to code blocks 2026-06-04 23:13:33 -04:00
ed df2e82a82d feat(themes): add Solarized Dark/Light, Gruvbox Dark, Moss TOML themes 2026-06-04 23:10:16 -04:00
ed dedc66d664 oops 2026-06-04 23:02:49 -04:00
ed e14b3c2ce0 feat(theme): load themes from TOML and apply syntax palette mapping 2026-06-04 22:59:59 -04:00
ed e2f698c4a3 feat(theme-models): add ThemePalette/ThemeFile schema with TOML loader 2026-06-04 22:31:22 -04:00
ed d21e96de8f feat(paths): add global and project theme path helpers 2026-06-04 22:25:29 -04:00
ed cd24c43f8f conductor(plan): theme + syntax modularization - 7-task plan 2026-06-04 22:20:58 -04:00
ed e86dacde8a conductor(plan): theme + syntax modularization plan/spec 2026-06-04 22:09:43 -04:00
ed 8d1fa18785 fix(project): Non-blocking project switch with stale-ui tint
When switching projects, the previous implementation ran the entire
save/load/refresh sequence on the main thread. With large project files
or slow disks, this caused the UI to freeze for several seconds.

Fix:
- _switch_project now returns immediately after setting flags; the
  actual work runs in a daemon thread (_do_project_switch)
- New is_project_stale() property returns True while a switch is queued
  or running; the GUI renders an amber/yellow tint overlay to signal
  the controller state lags the user's last click
- AI ops are gated: _api_generate returns HTTP 409, _handle_generate_send
  and _handle_md_only early-return with ai_status feedback, all when
  is_project_stale() is true
- Queued switches (clicking project A then B in rapid succession) are
  coalesced: B replaces A as the target; once A completes, B is
  triggered automatically via the finally branch in _do_project_switch
- New state fields: _project_switch_in_progress, _project_switch_pending_path,
  _project_switch_thread, _project_switch_lock
- AppController state class attributes use hasattr guard for _app to
  keep the controller usable standalone in tests/headless mode

UX:
- Render loop keeps drawing during the switch
- User can still scroll, switch tabs, browse files
- Amber tint + popup explains what's happening and that AI ops are paused
- ai_status shows the target project name

Tests:
- _wait_for_switch helper added for the new async switch flow
- All 7 existing switch tests updated to call _wait_for_switch
- 2 new tests:
  - test_switch_project_non_blocking: verifies _switch_project returns
    in <0.2s and is_project_stale() is True during the switch
  - test_api_generate_blocked_while_stale: verifies _api_generate
    raises HTTPException(409) while a switch is in progress

All 33 related tests pass.
2026-06-04 21:29:12 -04:00
ed 36f3292249 fix(project): Reload context_files from new project on project switch
When switching projects, the previous project's context_files remained
visible in the Context Composition panel because the controller's
self.context_files list was not reloaded from the new project's TOML
files.paths entry.

Fix in _refresh_from_project:
- After loading self.files from the project TOML, populate
  self.context_files with deep copies of those FileItem objects
- Reset self._app.ui_selected_context_files to match the new project's
  auto_aggregate set
- Guard the _app access with hasattr so the controller is usable
  standalone (in tests, headless mode, etc.) without an attached App

Test: 1 new test in tests/test_project_switch_persona_preset.py
- test_switch_project_resets_context_files: switches from project_a
  (forth + gte_hello files) to project_b (gencpp timing files) and
  asserts context_files contains ONLY project_b's files
2026-06-04 21:03:16 -04:00
ed 7df65dff14 fix(project): Create persona_manager in _load_active_project + handle missing context preset
Two fixes for the regression introduced in b92daef3 (and an additional
hardening for the persona->context_preset stale-reference class of bug):

1. Regression: persona_manager was missing on first project load.
   _load_active_project creates preset_manager and tool_preset_manager
   but did not create persona_manager, so the new
   self.personas = self.persona_manager.load_all() line in
   _refresh_from_project raised AttributeError on app startup before
   the post-_load_active_project persona_manager creation could run.
   Fix: create self.persona_manager in _load_active_project alongside
   the other managers, so the manager is available when
   _refresh_from_project runs.

2. Stale reference: persona's context_preset field pointed to a
   preset (e.g. 'GTE') that no longer exists in the project, causing
   load_context_preset to raise KeyError and crash the persona
   selector panel (which triggered the cascading 'Missing End()' imgui
   assertion).
   Fix: wrap the load_context_preset call in render_persona_selector_panel
   with try/except KeyError, surface the error in app.ai_status, and
   clear app.ui_active_context_preset to keep the GUI state consistent.

Tests: 2 new tests in tests/test_project_switch_persona_preset.py
- test_load_active_project_creates_persona_manager (regression guard)
- test_load_context_preset_missing_raises_keyerror (verifies the
  contract that load_context_preset raises for missing names; the
  GUI layer is now responsible for catching the error)
2026-06-04 20:45:55 -04:00
ed b92daef34f fix(project): Reload personas and validate active AI settings on project switch
When switching projects, the previous project's project-specific persona and
presets remained selected in the AI Settings panel because:
1. self.personas was not reloaded after switching project root
2. self.ui_active_persona / tool_preset / bias_profile / project_preset_name
   were not validated against the newly-loaded personas/presets

Fix:
- Reload self.personas from self.persona_manager in _refresh_from_project
- Validate each active selection and reset to None/empty if it does not
  exist in the newly-loaded manager dictionaries
- Push the active tool preset and bias profile to ai_client after the swap
- Initialize self.ui_active_bias_profile in class attribute block (was only
  set later in __init__, causing AttributeError on direct attribute access)

Tests: 4 new tests in tests/test_project_switch_persona_preset.py verify
the reset behavior for persona, preset, tool preset, and global preset
preservation.
2026-06-04 20:36:59 -04:00
ed ce211e76f8 straggler spec 2026-06-04 19:42:04 -04:00
ed ba7733b365 conductor(plan): Mark context_first_message_fix task complete 2026-06-04 18:47:42 -04:00