ed
0908f8fa28
Scripts + workflow for extracting Twitter/X posts and threads into Markdown with associated media. Mirrors the scripts/video_analysis/ pattern. Standalone requirement: zero imports from src/, conductor/, or scripts.video_analysis — copy-pasteable to another repo with only gallery-dl as the external dep. 5 modules: __init__.py, error_types.py (Result[T, ErrorInfo] + ThreadData/PostData typed dataclasses), fetch_thread.py (gallery-dl subprocess for URLs + html.parser fallback for local HTML), download_media.py (stdlib urllib, idempotent), render_markdown.py (YAML front-matter + per-post sections + ./media/ links). Reference project: C:\projects\forth\bootslop — the corpus feeds bootslop's scripts and reference-generation pipeline. Acceptance corpus: 8 threads (@NOTimothyLottes x6 + @VPCOMPRESSB x2) extracted to tests/artifacts/twitter_threads_corpus/. The ?s=20 quote-share suffix on the @VPCOMPRESSB URLs must be stripped by fetch_thread.py before acquisition (added to FR2 as URL normalization). 5 phases / 23 tasks. 8 verification criteria (VC1-VC8). TDD red-first on the pure-function modules (render_markdown, types, media naming).
7.9 KiB
7.9 KiB
Project Tracks
This file tracks all major tracks for the project. Each track has its own detailed plan in its respective folder (or in ../archive/<track_name>/ for completed tracks).
Structure:
- Active Tracks (Current Queue): In-flight and unblocked work the implementer can pick up today.
- Standby / Pending Spec: Tracks with spec TBD or pending decision.
- Full project history: see
chronology.md(the canonical index of all tracks: active, shipped, superseded, abandoned, sorted newest-first with git-history-evidence-backed status).
Archive directories live at ../archive/<track_name>/ (from this file's location at conductor/tracks.md).
Active Tracks (Current Queue)
Tracks that are unblocked and ready to start. Ordered by dependency (blocked-by first) and priority (A foundational → D forward-looking).
| # | Priority | Track | Status | Blocked By |
|---|---|---|---|---|
| 36 | A (sunset) | MMA Quarantine + RAG Test Decoupling | spec ✓, plan pending | (none) |
| 4 | A | MCP Architecture Refactor (Sub-MCP Extraction) | spec ✓, plan pending | (none) |
| 22b | A | Meta-Tooling Workflow Review | spec ✓, plan ✓, parked | (none) |
| 23 | A | Intent-Based Scripting Languages Survey | spec ✓, plan pending | (none) |
| 30 | A | Twitter/X Thread Extraction Tooling | spec ✓, plan ✓, ready to start | (none) |
| 7 | — | UI Polish (Five Issues) | spec ✓, plan ✓, ready to start | (none) |
| 19 | — | Context First Message Fix | spec TBD | (none) |
Track detail anchors
- MMA Quarantine + RAG Test Decoupling →
conductor/tracks/mma_quarantine_rag_test_decoupling_20260701/ - MCP Architecture Refactor →
conductor/tracks/mcp_architecture_refactor_20260606/ - Meta-Tooling Workflow Review →
conductor/tracks/meta_tooling_workflow_review_20260620/ - Intent-Based Scripting Languages Survey →
conductor/tracks/intent_dsl_survey_20260612/ - Twitter/X Thread Extraction Tooling →
conductor/tracks/twitter_threads_extraction_20260705/ - UI Polish (Five Issues) →
conductor/tracks/(see spec for details) - Context First Message Fix →
conductor/tracks/context_first_message_fix_20260604/
Standby / Pending Spec
| # | Priority | Track | Status | Blocked By |
|---|---|---|---|---|
| 6 | D | Public API Result Migration | Largely Completed (umbrella + 6 sub-tracks shipped per chronology): public_api_migration_and_ui_polish_20260615 ✓, send_result_to_send_20260616 ✓, result_migration_review_pass_20260617 ✓, result_migration_small_files_20260617 ✓, result_migration_app_controller_20260618 ✓, result_migration_gui_2_20260619 ✓, result_migration_baseline_cleanup_20260620 ✓; only result_migration_cruft_removal_20260620 still Active (Round 4 corrections applied; user-confirmed closeout; state.toml stale) |
(none) |
| 8 | — | Bootstrap gencpp Python Bindings | spec TBD | (none) |
| 9 | — | Tree-Sitter Lua MCP Tools | spec TBD | (none) |
| 10 | — | GDScript Language Support Tools | spec TBD | (none) |
| 11 | — | C# Language Support Tools | spec TBD | (none) |
| 12 | — | OpenAI Provider Integration | spec TBD | (none) |
| 13 | — | Zhipu AI (GLM) Provider Integration | spec TBD | (none) |
| 14 | — | AI Provider Caching Optimization | spec TBD | (none) |
| 15 | — | Manual UX Validation & Review | spec TBD | (none) |
| 15a | — | Manual UX Validation — ASCII-Sketch Workflow | spec ✓, plan ✓, ready to start | (none) |
| 15b | — | Chunkification Optimization (Contingency) | spec ✓ (contingency), no plan | hard constraint surface (deferred) |
| 16 | — | GenCpp Dogfood Feedback Loop | spec TBD | (none) |
| 18 | — | GUI Architecture Refinement | no spec.md | (TBD) |
Standby track anchors
- Public API Result Migration → umbrella
result_migration_20260616/(Active; no state.toml) + 8 sub-tracks (7 shipped, 1 Active awaiting user verify of Round 4 closeout):public_api_migration_and_ui_polish_20260615/,send_result_to_send_20260616/,result_migration_review_pass_20260617/,result_migration_small_files_20260617/,result_migration_app_controller_20260618/,result_migration_gui_2_20260619/,result_migration_baseline_cleanup_20260620/,result_migration_cruft_removal_20260620/ - Bootstrap gencpp Python Bindings →
conductor/tracks/gencpp_python_bindings_20260308/ - Tree-Sitter Lua MCP Tools →
conductor/tracks/tree_sitter_lua_mcp_tools_20260310/ - GDScript Language Support Tools →
conductor/tracks/gdscript_godot_script_language_support_tools_20260310/ - C# Language Support Tools →
conductor/tracks/csharp_language_support_tools_20260310/ - OpenAI Provider Integration →
conductor/tracks/openai_integration_20260308/ - Zhipu AI (GLM) Provider Integration →
conductor/tracks/zhipu_integration_20260308/ - AI Provider Caching Optimization →
conductor/tracks/caching_optimization_20260308/ - Manual UX Validation & Review →
conductor/tracks/manual_ux_validation_20260302/ - Manual UX Validation — ASCII-Sketch Workflow →
conductor/tracks/manual_ux_validation_20260608_PLACEHOLDER/ - Chunkification Optimization (Contingency) →
conductor/tracks/chunkification_optimization_20260608_PLACEHOLDER/ - GenCpp Dogfood Feedback Loop →
conductor/tracks/gencpp_dogfood_feedback_20260510/ - GUI Architecture Refinement → (no spec.md)
Full project history: see
chronology.md— the canonical index of all tracks (active, shipped, superseded, abandoned), sorted newest-first, with git-history-evidence-backed status per row. Maintained manually (the generator scripts were deleted 2026-07-05 after repeated corruption incidents).
Notes
Archive link convention: ./archive/... paths resolve to conductor/archive/... (this file is at conductor/tracks.md).
Status legend:
[ ]not started[~]in progress[x]completed (track may still be intracks/or may have been moved toarchive/)~~**...**~~struck-through (renamed/replaced/superseded)
Naming convention: Each track's spec.md and plan.md (where present) follow the project's standard format: spec.md for design intent (the "why"), plan.md for executable tasks (the "how").
Editing this file: When you mark a track as [x] and move its folder to archive/, remove its row from the Active Tracks table (its history is in chronology.md). When you start a new track, create the folder under tracks/ first, then add the entry to the Active Tracks table.
Archiving a track (3 steps): When a track ships and its folder moves from conductor/tracks/<id>/ to conductor/archive/<id>/, complete all 3 steps in order:
- Move the folder:
git mv conductor/tracks/<id> conductor/archive/<id>(preserves history as a rename). - Remove the row from this file (
conductor/tracks.md). - Add a row to
conductor/chronology.md(top of the table, newest-first) summarizing the track: Date, ID, Status, one-line Summary, Folder path, commit Range. Commit withdocs(chronology): add row for <track-id> archive. (Chronology is maintained manually as of 2026-07-05 — the generator scripts were deleted after repeated corruption incidents.)