From 256af96bf348f6081e75d721826ad55584fca7c0 Mon Sep 17 00:00:00 2001 From: Ed_ Date: Tue, 23 Jun 2026 00:08:23 -0400 Subject: [PATCH] conductor(deob_phases): Initialize 3 phase child spec scaffolds Each child spec is lightweight (~120 lines): references the umbrella, gives the deliverable structure, specifies the inputs/outputs, and the 5-phase pipeline. Phase 1 (lexicon): refines the warmup's draft into a codified operational spec (lexicon.md + terms_catalog.md + dedup_map.md) Phase 2 (pilot): applies the lexicon to 2 Pass 1 reports (cs229_building_llms + entropy_epiplexity), captures refinements in pilot_report.md Phase 3 (apply): applies the refined lexicon to 10 remaining Pass 1 reports + 1 cross-cutting synthesis, final apply_report.md 3-layer deliverable per video: translation (side-by-side) + replacement (re-encoded) + decoder (per-term etymology + form anchor + definition history) 4 verification criteria: lossless, bounded, constructively typed, etymology-cited --- .../spec.md | 100 +++++++++++++++++ .../spec.md | 104 ++++++++++++++++++ .../spec.md | 104 ++++++++++++++++++ 3 files changed, 308 insertions(+) create mode 100644 conductor/tracks/video_analysis_deob_apply_20260621/spec.md create mode 100644 conductor/tracks/video_analysis_deob_lexicon_20260621/spec.md create mode 100644 conductor/tracks/video_analysis_deob_pilot_20260621/spec.md diff --git a/conductor/tracks/video_analysis_deob_apply_20260621/spec.md b/conductor/tracks/video_analysis_deob_apply_20260621/spec.md new file mode 100644 index 00000000..d88372ac --- /dev/null +++ b/conductor/tracks/video_analysis_deob_apply_20260621/spec.md @@ -0,0 +1,100 @@ +# Track: Video Analysis De-obfuscation — Apply to 10 + Synthesis (2026-06-21) + +**Status:** Not started (umbrella + warmup + lexicon + pilot published 2026-06-21) +**Type:** Research-only child track (Pass 2 of 3, Phase 3 of 3 within Pass 2) +**Owner:** Tier 2 Tech Lead (execution) +**Priority:** A (user-blocking; the final phase of Pass 2) + +> **Parent:** This is child #3 of the [video_analysis_deob_20260621](../../video_analysis_deob_20260621/) umbrella. See [umbrella spec.md](../../video_analysis_deob_20260621/spec.md) for the full design. + +> **Upstream consumer of:** [video_analysis_deob_pilot_20260621](../../video_analysis_deob_pilot_20260621/) (the `pilot_report.md` captures the refined lexicon from the 2-video pilot). + +--- + +## 1. Inputs + +| Input | Source | +|---|---| +| Refined lexicon (from pilot) | [video_analysis_deob_pilot_20260621/pilot_report.md](../../video_analysis_deob_pilot_20260621/pilot_report.md) | +| Warmup `prompt_template.md` | [video_analysis_deob_warmup_20260621/prompt_template.md](../../video_analysis_deob_warmup_20260621/prompt_template.md) | +| Lexicon child deliverables | [video_analysis_deob_lexicon_20260621/lexicon.md](../../video_analysis_deob_lexicon_20260621/lexicon.md) + `terms_catalog.md` + `dedup_map.md` | +| 10 Pass 1 reports (remaining after pilot) | [video_analysis__20260621/report.md](../../) for the 10 slugs not in the pilot | +| 1 cross-cutting synthesis | [video_analysis_synthesis_20260621/report.md](../../video_analysis_synthesis_20260621/report.md) | + +## 2. The 10 remaining slugs (in execution order, per Pass 1) + +1. `probability_logic` (A — math foundations) +2. `score_dynamics_giorgini` (A — math foundations) +3. `platonic_intelligence_kumar` (B — Platonic AI) +4. `free_lunches_levin` (B — Platonic AI) +5. `generic_systems_fields` (C — biological/cognitive) +6. `brain_counterintuitive` (C — biological/cognitive) +7. `neural_dynamics_miller` (C — biological/cognitive) +8. `multiscale_hoffman` (C — biological/cognitive) +9. `cs336_architectures` (E — Stanford) +10. `creikey_dl_cv` (D — applied) + +Plus the 11th deliverable: the cross-cutting synthesis. + +## 3. Deliverables + +For each of the 10 videos + 1 synthesis, 3 files in `artifacts//`: + +| Artifact | Description | +|---|---| +| `_translation.md` | Side-by-side translation table | +| `_deobfuscated.md` | Re-encoded report (replacement) | +| `_decoder.md` | Per-term decoder | + +Plus: + +| Artifact | Description | +|---|---| +| `apply_report.md` | Final lexicon v2, final process refinements, open questions for Pass 3 | + +**Optional (added per child track execution convention):** `plan.md`, `metadata.json`, `state.toml`. + +**Total deliverable file count:** 11 × 3 + 1 = 34 files (plus the apply report). + +## 4. Pipeline (5 phases) + +Per the umbrella spec §5 (Phase 4 of the umbrella). Each phase commits atomically. + +- [ ] **Phase 1: Init.** Initialize the child track. +- [ ] **Phase 2: Apply to A cluster (2 videos: probability_logic, score_dynamics_giorgini).** 2 × 3-layer deliverables. Commit per video. +- [ ] **Phase 3: Apply to B cluster (2 videos: platonic_intelligence_kumar, free_lunches_levin).** 2 × 3-layer deliverables. Commit per video. +- [ ] **Phase 4: Apply to C cluster (4 videos: generic_systems_fields, brain_counterintuitive, neural_dynamics_miller, multiscale_hoffman).** 4 × 3-layer deliverables. Commit per video. +- [ ] **Phase 5: Apply to E + D + synthesis (cs336_architectures, creikey_dl_cv, synthesis).** 3 × 3-layer deliverables. Commit per video/synthesis. +- [ ] **Phase 6: Refine + user review.** Write `apply_report.md`. User reviews. End-of-track report. + +## 5. Per-deliverable structure + +Same 8-section structure as the pilot. Same 3-layer format (translation + replacement + decoder). Same 4 verification criteria. + +The apply phase uses the **refined lexicon** from the pilot (not the original from the lexicon child). The refinements are in `pilot_report.md`. + +## 6. Connections + +- **Upstream:** consumes the refined lexicon from the pilot child +- **Downstream:** Pass 3 (future) consumes the 11 deliverables as input + +## 7. Verification (4 criteria per deliverable) + +Per the umbrella spec §8 — lossless, bounded, constructively typed, etymology-cited. + +Plus: +- [ ] All 10 videos + 1 synthesis have 3-layer deliverables +- [ ] `apply_report.md` captures the final lexicon v2 +- [ ] User has reviewed and approved +- [ ] `state.toml` updated to `status = "completed"` + +## 8. Pass 3 handoff + +The 11 deliverables + `apply_report.md` are the input to Pass 3 (projection to applied domain). The "lossless preservation" directive carries: Pass 3 has all the bounded, constructive, type-theoretic forms it needs to apply the user's stylistic preferences (handmade/data-oriented/GPGPU + own caveats). + +## 9. See also + +- [Umbrella spec.md](../../video_analysis_deob_20260621/spec.md) +- [Umbrella README.md](../../video_analysis_deob_20260621/README.md) +- [Pilot child spec.md](../../video_analysis_deob_pilot_20260621/spec.md) +- [Pass 1 campaign spec §0, §11](../../video_analysis_campaign_20260621/spec.md) — multi-pass framing diff --git a/conductor/tracks/video_analysis_deob_lexicon_20260621/spec.md b/conductor/tracks/video_analysis_deob_lexicon_20260621/spec.md new file mode 100644 index 00000000..f1d8a5f2 --- /dev/null +++ b/conductor/tracks/video_analysis_deob_lexicon_20260621/spec.md @@ -0,0 +1,104 @@ +# Track: Video Analysis De-obfuscation — Lexicon Refinement (2026-06-21) + +**Status:** Not started (umbrella + warmup published 2026-06-21) +**Type:** Research-only child track (Pass 2 of 3, Phase 1 of 3 within Pass 2) +**Owner:** Tier 2 Tech Lead (execution) +**Priority:** A (user-blocking) + +> **Parent:** This is child #1 of the [video_analysis_deob_20260621](../../video_analysis_deob_20260621/) umbrella (Pass 2 of the 3-pass research campaign). See [umbrella spec.md](../../video_analysis_deob_20260621/spec.md) for the full design. + +> **Upstream consumer of:** [video_analysis_deob_warmup_20260621](../../video_analysis_deob_warmup_20260621/) (the warmup produces the initial `report.md` + `prompt_template.md`). + +> **Downstream consumer:** [video_analysis_deob_pilot_20260621](../../video_analysis_deob_pilot_20260621/) (consumes the refined lexicon). + +--- + +## 1. Inputs + +| Input | Source | +|---|---| +| Warmup `report.md` | [video_analysis_deob_warmup_20260621/report.md](../../video_analysis_deob_warmup_20260621/report.md) | +| Warmup `prompt_template.md` | [video_analysis_deob_warmup_20260621/prompt_template.md](../../video_analysis_deob_warmup_20260621/prompt_template.md) | + +## 2. Deliverables + +| Artifact | Path | Target | +|---|---|---| +| Refined lexicon | `lexicon.md` | The codified operational spec; the "contract" between the warmup and the apply phases | +| Machine-readable terms | `terms_catalog.md` | The lexicon in a structured form (per-term table with: tier, original notation, re-encoded form, form anchor, etymology, definition history) | +| Dedup maps | `dedup_map.md` | The 3+ noise-dedup maps from the warmup, refined with examples | +| Test cases | (5-10 example transformations, embedded in `lexicon.md`) | Each test case: original notation → re-encoded form, with the lexicon terms used | + +**Optional (added per child track execution convention):** `plan.md`, `metadata.json`, `state.toml`. + +## 3. Pipeline (5 phases) + +Per the umbrella spec §5 (Phase 2 of the umbrella). Each phase commits atomically. + +- [ ] **Phase 1: Init.** Initialize the child track (`plan.md` + `metadata.json` + `state.toml` per Tier 2 conventions). +- [ ] **Phase 2: Refine.** Tier 3 worker reads the warmup's `report.md` + `prompt_template.md`. Refines the lexicon by: + - Adding 5-10 test cases drawn from the user's samples + - Adding the "form anchor" requirement to each term + - Adding cross-references to the warmup's report sections + - Formalizing the 4 verification criteria as part of the lexicon spec +- [ ] **Phase 3: Codify.** Produce `lexicon.md` (the operational spec) + `terms_catalog.md` (machine-readable) + `dedup_map.md` (refined maps). +- [ ] **Phase 4: User review.** User reviews the refined lexicon. Approves before the pilot child can start. +- [ ] **Phase 5: Verification.** Idempotency check (the lexicon is consistent across multiple reads), audit, end-of-track report. + +## 4. Lexicon structure (what `lexicon.md` contains) + +```markdown +# De-obfuscation Lexicon (v1, refined from warmup) + +## 1. The 4 Rules (carried from prompt template) +- 1.1 Boundedness +- 1.2 Form anchor +- 1.3 Etymology +- 1.4 Lossless + +## 2. The Tiered Terms +- 2.1 Tier 1: Core concepts (set→kind, ∀→forall, ∃→exists, etc.) +- 2.2 Tier 2: Data-oriented pipeline (filter, map, fold, etc.) +- 2.3 Tier 3: Type-theoretic primitives (proof, program, type, etc.) +- 2.4 Tier 4: AI-fuzzing tolerance (try, recover, sandbox, didyoumean, etc.) + +## 3. The 3+ Noise-Dedup Maps (refined) +- 3.1 Proofs = Programs = Computations +- 3.2 Sets = Kinds = Types +- 3.3 Functions = Procedures = Words +- 3.4 (additional maps discovered) + +## 4. Test Cases (5-10) +- Each: original → re-encoded, with the lexicon terms used +- Drawn from the user's samples + +## 5. Form-Anchor Requirement (formal) +- Every re-encoding must have a form anchor +- Definition: a bounded form that the re-encoding projects from the indefinite + +## 6. Etymology Requirement (formal) +- Every new term: 1-line origin + 1-line definition history +- Examples from the user's samples + +## 7. Cross-References to Warmup Report +- Section mappings: warmup §3 → lexicon §2, etc. +``` + +## 5. Connections + +- **Upstream:** consumes the warmup's `report.md` + `prompt_template.md` +- **Downstream:** the pilot child consumes `lexicon.md` + `terms_catalog.md` + `dedup_map.md` + +## 6. Verification + +- [ ] All 3 deliverables present +- [ ] `lexicon.md` has the 4 rules + tiered terms + dedup maps + test cases +- [ ] At least 5 test cases included (drawn from the user's samples) +- [ ] User has reviewed and approved +- [ ] `state.toml` updated to `status = "completed"` + +## 7. See also + +- [Umbrella spec.md](../../video_analysis_deob_20260621/spec.md) +- [Umbrella README.md](../../video_analysis_deob_20260621/README.md) +- [Warmup spec.md](../../video_analysis_deob_warmup_20260621/spec.md) diff --git a/conductor/tracks/video_analysis_deob_pilot_20260621/spec.md b/conductor/tracks/video_analysis_deob_pilot_20260621/spec.md new file mode 100644 index 00000000..f6dc7135 --- /dev/null +++ b/conductor/tracks/video_analysis_deob_pilot_20260621/spec.md @@ -0,0 +1,104 @@ +# Track: Video Analysis De-obfuscation — Pilot on 2 Videos (2026-06-21) + +**Status:** Not started (umbrella + warmup published 2026-06-21) +**Type:** Research-only child track (Pass 2 of 3, Phase 2 of 3 within Pass 2) +**Owner:** Tier 2 Tech Lead (execution) +**Priority:** A (user-blocking) + +> **Parent:** This is child #2 of the [video_analysis_deob_20260621](../../video_analysis_deob_20260621/) umbrella. See [umbrella spec.md](../../video_analysis_deob_20260621/spec.md) for the full design. + +> **Upstream consumer of:** [video_analysis_deob_lexicon_20260621](../../video_analysis_deob_lexicon_20260621/) (the refined `lexicon.md` + `terms_catalog.md` + `dedup_map.md`). + +> **Downstream consumer:** [video_analysis_deob_apply_20260621](../../video_analysis_deob_apply_20260621/) (consumes the refined lexicon from the pilot's `pilot_report.md`). + +--- + +## 1. Inputs + +| Input | Source | +|---|---| +| Refined `lexicon.md` | [video_analysis_deob_lexicon_20260621/lexicon.md](../../video_analysis_deob_lexicon_20260621/lexicon.md) | +| Refined `terms_catalog.md` | [video_analysis_deob_lexicon_20260621/terms_catalog.md](../../video_analysis_deob_lexicon_20260621/terms_catalog.md) | +| Refined `dedup_map.md` | [video_analysis_deob_lexicon_20260621/dedup_map.md](../../video_analysis_deob_lexicon_20260621/dedup_map.md) | +| Warmup `prompt_template.md` | [video_analysis_deob_warmup_20260621/prompt_template.md](../../video_analysis_deob_warmup_20260621/prompt_template.md) | +| Pass 1 report #1 | [video_analysis_cs229_building_llms_20260621/report.md](../../video_analysis_cs229_building_llms_20260621/report.md) | +| Pass 1 report #2 | [video_analysis_entropy_epiplexity_20260621/report.md](../../video_analysis_entropy_epiplexity_20260621/report.md) | + +## 2. Pilot videos (why these 2) + +1. **`cs229_building_llms`** — Foundational ML/LLM coverage. Wide scope, tests "form projection" across many concepts (sets, functions, optimization, learning). Good test for the lexicon's general applicability. +2. **`entropy_epiplexity`** — Math-heavy, focused on information-theoretic concepts (entropy, mutual information, epiplexity). Good test for "boundedness" + type-theoretic encoding of measure theory (a common bottleneck in de-obfuscation efforts). + +These 2 videos test the lexicon on different shapes: one broad-and-shallow, one narrow-and-deep. The pilot's refinements will inform the apply phase. + +## 3. Deliverables + +For each of the 2 pilot videos, 3 files in `artifacts//`: + +| Artifact | Description | +|---|---| +| `_translation.md` | Side-by-side table: original expression ↔ re-encoded form, with form anchor per row | +| `_deobfuscated.md` | The re-encoded report (replacement; same 8-section structure as Pass 1, but every standard-math expression is replaced with the constructive type-theoretic form) | +| `_decoder.md` | Per-term decoder: form anchor, etymology, definition history, link to original section | + +Plus: + +| Artifact | Description | +|---|---| +| `pilot_report.md` | Lexicon refinements discovered, concepts that didn't fit (gaps), process improvements for the apply phase | + +**Optional (added per child track execution convention):** `plan.md`, `metadata.json`, `state.toml`. + +## 4. Pipeline (5 phases) + +Per the umbrella spec §5 (Phase 3 of the umbrella). Each phase commits atomically. + +- [ ] **Phase 1: Init.** Initialize the child track. +- [ ] **Phase 2: Apply to `cs229_building_llms`.** Tier 3 worker (LLM invoked with the prompt template + the report). Produces 3-layer deliverable in `artifacts/cs229_building_llms/`. +- [ ] **Phase 3: Apply to `entropy_epiplexity`.** Same as above. Produces 3-layer deliverable in `artifacts/entropy_epiplexity/`. +- [ ] **Phase 4: Refine.** Write `pilot_report.md` capturing: lexicon refinements, concepts that didn't fit (gaps), process improvements. +- [ ] **Phase 5: User review + verification.** User reviews the 2 deliverables. Approves before the apply child can start. Idempotency + audit + end-of-track report. + +## 5. Report structure (per pilot video) + +For `_deobfuscated.md`, the structure is the same 8-section structure as Pass 1's report: +1. TL;DR +2. Key Concepts +3. Frame Analysis +4. Transcript Highlights +5. Mathematical / Theoretical Content (re-encoded) +6. Connections to Other Videos in Campaign +7. Open Questions / Follow-up +8. References + +But every standard-math expression in §5 (and anywhere else) is replaced with the constructive type-theoretic form per the lexicon. + +For `_decoder.md`, the per-term format: +```markdown +## Term: +- Original notation: ... +- Re-encoded: ... +- Form anchor: ... +- Etymology: ... +- Definition history: ... +- Source sections in original: ... +``` + +## 6. Connections + +- **Upstream:** consumes the refined lexicon from the lexicon child +- **Downstream:** the apply child consumes the pilot's `pilot_report.md` (refinements) + the (unchanged) lexicon + +## 7. Verification (4 criteria per deliverable) + +- [ ] **Lossless** — every Pass 1 concept is represented in the de-obfuscated form +- [ ] **Bounded** — no `∞_val` or `∞_card`; all values are finite forms +- [ ] **Constructively typed** — every expression has a type +- [ ] **Etymology-cited** — every new term has a 1-line origin + 1-line definition history in the decoder + +## 8. See also + +- [Umbrella spec.md](../../video_analysis_deob_20260621/spec.md) +- [Umbrella README.md](../../video_analysis_deob_20260621/README.md) +- [Lexicon child spec.md](../../video_analysis_deob_lexicon_20260621/spec.md) +- Pass 1 reports: `cs229_building_llms` + `entropy_epiplexity`