ed/manual_slop
Private
Public Access
0
0
Fork 0
Code Activity

conductor(deob_phases): Initialize 3 phase child spec scaffolds

Browse Source 
Each child spec is lightweight (~120 lines): references the umbrella, gives the deliverable structure, specifies the inputs/outputs, and the 5-phase pipeline.

Phase 1 (lexicon): refines the warmup's draft into a codified operational spec (lexicon.md + terms_catalog.md + dedup_map.md)
Phase 2 (pilot): applies the lexicon to 2 Pass 1 reports (cs229_building_llms + entropy_epiplexity), captures refinements in pilot_report.md
Phase 3 (apply): applies the refined lexicon to 10 remaining Pass 1 reports + 1 cross-cutting synthesis, final apply_report.md

3-layer deliverable per video: translation (side-by-side) + replacement (re-encoded) + decoder (per-term etymology + form anchor + definition history)
4 verification criteria: lossless, bounded, constructively typed, etymology-cited
This commit is contained in:
ed
2026-06-23 00:08:23 -04:00
parent f830798822
commit 256af96bf3
3 changed files with 308 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
conductor/tracks/video_analysis_deob_apply_20260621/spec.md
+100
View File
@@ -0,0 +1,100 @@
# Track: Video Analysis De-obfuscation — Apply to 10 + Synthesis (2026-06-21)
**Status:** Not started (umbrella + warmup + lexicon + pilot published 2026-06-21)
**Type:** Research-only child track (Pass 2 of 3, Phase 3 of 3 within Pass 2)
**Owner:** Tier 2 Tech Lead (execution)
**Priority:** A (user-blocking; the final phase of Pass 2)
> **Parent:** This is child #3 of the [video_analysis_deob_20260621](../../video_analysis_deob_20260621/) umbrella. See [umbrella spec.md](../../video_analysis_deob_20260621/spec.md) for the full design.
> **Upstream consumer of:** [video_analysis_deob_pilot_20260621](../../video_analysis_deob_pilot_20260621/) (the `pilot_report.md` captures the refined lexicon from the 2-video pilot).
---
## 1. Inputs
| Input | Source |
|---|---|
| Refined lexicon (from pilot) | [video_analysis_deob_pilot_20260621/pilot_report.md](../../video_analysis_deob_pilot_20260621/pilot_report.md) |
| Warmup `prompt_template.md` | [video_analysis_deob_warmup_20260621/prompt_template.md](../../video_analysis_deob_warmup_20260621/prompt_template.md) |
| Lexicon child deliverables | [video_analysis_deob_lexicon_20260621/lexicon.md](../../video_analysis_deob_lexicon_20260621/lexicon.md) + `terms_catalog.md` + `dedup_map.md` |
| 10 Pass 1 reports (remaining after pilot) | [video_analysis_<slug>_20260621/report.md](../../) for the 10 slugs not in the pilot |
| 1 cross-cutting synthesis | [video_analysis_synthesis_20260621/report.md](../../video_analysis_synthesis_20260621/report.md) |
## 2. The 10 remaining slugs (in execution order, per Pass 1)
1. `probability_logic` (A — math foundations)
2. `score_dynamics_giorgini` (A — math foundations)
3. `platonic_intelligence_kumar` (B — Platonic AI)
4. `free_lunches_levin` (B — Platonic AI)
5. `generic_systems_fields` (C — biological/cognitive)
6. `brain_counterintuitive` (C — biological/cognitive)
7. `neural_dynamics_miller` (C — biological/cognitive)
8. `multiscale_hoffman` (C — biological/cognitive)
9. `cs336_architectures` (E — Stanford)
10. `creikey_dl_cv` (D — applied)
Plus the 11th deliverable: the cross-cutting synthesis.
## 3. Deliverables
For each of the 10 videos + 1 synthesis, 3 files in `artifacts/<slug>/`:
| Artifact | Description |
|---|---|
| `<slug>_translation.md` | Side-by-side translation table |
| `<slug>_deobfuscated.md` | Re-encoded report (replacement) |
| `<slug>_decoder.md` | Per-term decoder |
Plus:
| Artifact | Description |
|---|---|
| `apply_report.md` | Final lexicon v2, final process refinements, open questions for Pass 3 |
**Optional (added per child track execution convention):** `plan.md`, `metadata.json`, `state.toml`.
**Total deliverable file count:** 11 × 3 + 1 = 34 files (plus the apply report).
## 4. Pipeline (5 phases)
Per the umbrella spec §5 (Phase 4 of the umbrella). Each phase commits atomically.
- [ ] **Phase 1: Init.** Initialize the child track.
- [ ] **Phase 2: Apply to A cluster (2 videos: probability_logic, score_dynamics_giorgini).** 2 × 3-layer deliverables. Commit per video.
- [ ] **Phase 3: Apply to B cluster (2 videos: platonic_intelligence_kumar, free_lunches_levin).** 2 × 3-layer deliverables. Commit per video.
- [ ] **Phase 4: Apply to C cluster (4 videos: generic_systems_fields, brain_counterintuitive, neural_dynamics_miller, multiscale_hoffman).** 4 × 3-layer deliverables. Commit per video.
- [ ] **Phase 5: Apply to E + D + synthesis (cs336_architectures, creikey_dl_cv, synthesis).** 3 × 3-layer deliverables. Commit per video/synthesis.
- [ ] **Phase 6: Refine + user review.** Write `apply_report.md`. User reviews. End-of-track report.
## 5. Per-deliverable structure
Same 8-section structure as the pilot. Same 3-layer format (translation + replacement + decoder). Same 4 verification criteria.
The apply phase uses the **refined lexicon** from the pilot (not the original from the lexicon child). The refinements are in `pilot_report.md`.
## 6. Connections
- **Upstream:** consumes the refined lexicon from the pilot child
- **Downstream:** Pass 3 (future) consumes the 11 deliverables as input
## 7. Verification (4 criteria per deliverable)
Per the umbrella spec §8 — lossless, bounded, constructively typed, etymology-cited.
Plus:
- [ ] All 10 videos + 1 synthesis have 3-layer deliverables
- [ ] `apply_report.md` captures the final lexicon v2
- [ ] User has reviewed and approved
- [ ] `state.toml` updated to `status = "completed"`
## 8. Pass 3 handoff
The 11 deliverables + `apply_report.md` are the input to Pass 3 (projection to applied domain). The "lossless preservation" directive carries: Pass 3 has all the bounded, constructive, type-theoretic forms it needs to apply the user's stylistic preferences (handmade/data-oriented/GPGPU + own caveats).
## 9. See also
- [Umbrella spec.md](../../video_analysis_deob_20260621/spec.md)
- [Umbrella README.md](../../video_analysis_deob_20260621/README.md)
- [Pilot child spec.md](../../video_analysis_deob_pilot_20260621/spec.md)
- [Pass 1 campaign spec §0, §11](../../video_analysis_campaign_20260621/spec.md) — multi-pass framing
conductor/tracks/video_analysis_deob_lexicon_20260621/spec.md
+104
View File
@@ -0,0 +1,104 @@
# Track: Video Analysis De-obfuscation — Lexicon Refinement (2026-06-21)
**Status:** Not started (umbrella + warmup published 2026-06-21)
**Type:** Research-only child track (Pass 2 of 3, Phase 1 of 3 within Pass 2)
**Owner:** Tier 2 Tech Lead (execution)
**Priority:** A (user-blocking)
> **Parent:** This is child #1 of the [video_analysis_deob_20260621](../../video_analysis_deob_20260621/) umbrella (Pass 2 of the 3-pass research campaign). See [umbrella spec.md](../../video_analysis_deob_20260621/spec.md) for the full design.
> **Upstream consumer of:** [video_analysis_deob_warmup_20260621](../../video_analysis_deob_warmup_20260621/) (the warmup produces the initial `report.md` + `prompt_template.md`).
> **Downstream consumer:** [video_analysis_deob_pilot_20260621](../../video_analysis_deob_pilot_20260621/) (consumes the refined lexicon).
---
## 1. Inputs
| Input | Source |
|---|---|
| Warmup `report.md` | [video_analysis_deob_warmup_20260621/report.md](../../video_analysis_deob_warmup_20260621/report.md) |
| Warmup `prompt_template.md` | [video_analysis_deob_warmup_20260621/prompt_template.md](../../video_analysis_deob_warmup_20260621/prompt_template.md) |
## 2. Deliverables
| Artifact | Path | Target |
|---|---|---|
| Refined lexicon | `lexicon.md` | The codified operational spec; the "contract" between the warmup and the apply phases |
| Machine-readable terms | `terms_catalog.md` | The lexicon in a structured form (per-term table with: tier, original notation, re-encoded form, form anchor, etymology, definition history) |
| Dedup maps | `dedup_map.md` | The 3+ noise-dedup maps from the warmup, refined with examples |
| Test cases | (5-10 example transformations, embedded in `lexicon.md`) | Each test case: original notation → re-encoded form, with the lexicon terms used |
**Optional (added per child track execution convention):** `plan.md`, `metadata.json`, `state.toml`.
## 3. Pipeline (5 phases)
Per the umbrella spec §5 (Phase 2 of the umbrella). Each phase commits atomically.
- [ ] **Phase 1: Init.** Initialize the child track (`plan.md` + `metadata.json` + `state.toml` per Tier 2 conventions).
- [ ] **Phase 2: Refine.** Tier 3 worker reads the warmup's `report.md` + `prompt_template.md`. Refines the lexicon by:
- Adding 5-10 test cases drawn from the user's samples
- Adding the "form anchor" requirement to each term
- Adding cross-references to the warmup's report sections
- Formalizing the 4 verification criteria as part of the lexicon spec
- [ ] **Phase 3: Codify.** Produce `lexicon.md` (the operational spec) + `terms_catalog.md` (machine-readable) + `dedup_map.md` (refined maps).
- [ ] **Phase 4: User review.** User reviews the refined lexicon. Approves before the pilot child can start.
- [ ] **Phase 5: Verification.** Idempotency check (the lexicon is consistent across multiple reads), audit, end-of-track report.
## 4. Lexicon structure (what `lexicon.md` contains)
```markdown
# De-obfuscation Lexicon (v1, refined from warmup)
## 1. The 4 Rules (carried from prompt template)
- 1.1 Boundedness
- 1.2 Form anchor
- 1.3 Etymology
- 1.4 Lossless
## 2. The Tiered Terms
- 2.1 Tier 1: Core concepts (set→kind, ∀→forall, ∃→exists, etc.)
- 2.2 Tier 2: Data-oriented pipeline (filter, map, fold, etc.)
- 2.3 Tier 3: Type-theoretic primitives (proof, program, type, etc.)
- 2.4 Tier 4: AI-fuzzing tolerance (try, recover, sandbox, didyoumean, etc.)
## 3. The 3+ Noise-Dedup Maps (refined)
- 3.1 Proofs = Programs = Computations
- 3.2 Sets = Kinds = Types
- 3.3 Functions = Procedures = Words
- 3.4 (additional maps discovered)
## 4. Test Cases (5-10)
- Each: original → re-encoded, with the lexicon terms used
- Drawn from the user's samples
## 5. Form-Anchor Requirement (formal)
- Every re-encoding must have a form anchor
- Definition: a bounded form that the re-encoding projects from the indefinite
## 6. Etymology Requirement (formal)
- Every new term: 1-line origin + 1-line definition history
- Examples from the user's samples
## 7. Cross-References to Warmup Report
- Section mappings: warmup §3 → lexicon §2, etc.
```
## 5. Connections
- **Upstream:** consumes the warmup's `report.md` + `prompt_template.md`
- **Downstream:** the pilot child consumes `lexicon.md` + `terms_catalog.md` + `dedup_map.md`
## 6. Verification
- [ ] All 3 deliverables present
- [ ] `lexicon.md` has the 4 rules + tiered terms + dedup maps + test cases
- [ ] At least 5 test cases included (drawn from the user's samples)
- [ ] User has reviewed and approved
- [ ] `state.toml` updated to `status = "completed"`
## 7. See also
- [Umbrella spec.md](../../video_analysis_deob_20260621/spec.md)
- [Umbrella README.md](../../video_analysis_deob_20260621/README.md)
- [Warmup spec.md](../../video_analysis_deob_warmup_20260621/spec.md)
conductor/tracks/video_analysis_deob_pilot_20260621/spec.md
+104
View File
@@ -0,0 +1,104 @@
# Track: Video Analysis De-obfuscation — Pilot on 2 Videos (2026-06-21)
**Status:** Not started (umbrella + warmup published 2026-06-21)
**Type:** Research-only child track (Pass 2 of 3, Phase 2 of 3 within Pass 2)
**Owner:** Tier 2 Tech Lead (execution)
**Priority:** A (user-blocking)
> **Parent:** This is child #2 of the [video_analysis_deob_20260621](../../video_analysis_deob_20260621/) umbrella. See [umbrella spec.md](../../video_analysis_deob_20260621/spec.md) for the full design.
> **Upstream consumer of:** [video_analysis_deob_lexicon_20260621](../../video_analysis_deob_lexicon_20260621/) (the refined `lexicon.md` + `terms_catalog.md` + `dedup_map.md`).
> **Downstream consumer:** [video_analysis_deob_apply_20260621](../../video_analysis_deob_apply_20260621/) (consumes the refined lexicon from the pilot's `pilot_report.md`).
---
## 1. Inputs
| Input | Source |
|---|---|
| Refined `lexicon.md` | [video_analysis_deob_lexicon_20260621/lexicon.md](../../video_analysis_deob_lexicon_20260621/lexicon.md) |
| Refined `terms_catalog.md` | [video_analysis_deob_lexicon_20260621/terms_catalog.md](../../video_analysis_deob_lexicon_20260621/terms_catalog.md) |
| Refined `dedup_map.md` | [video_analysis_deob_lexicon_20260621/dedup_map.md](../../video_analysis_deob_lexicon_20260621/dedup_map.md) |
| Warmup `prompt_template.md` | [video_analysis_deob_warmup_20260621/prompt_template.md](../../video_analysis_deob_warmup_20260621/prompt_template.md) |
| Pass 1 report #1 | [video_analysis_cs229_building_llms_20260621/report.md](../../video_analysis_cs229_building_llms_20260621/report.md) |
| Pass 1 report #2 | [video_analysis_entropy_epiplexity_20260621/report.md](../../video_analysis_entropy_epiplexity_20260621/report.md) |
## 2. Pilot videos (why these 2)
1. **`cs229_building_llms`** — Foundational ML/LLM coverage. Wide scope, tests "form projection" across many concepts (sets, functions, optimization, learning). Good test for the lexicon's general applicability.
2. **`entropy_epiplexity`** — Math-heavy, focused on information-theoretic concepts (entropy, mutual information, epiplexity). Good test for "boundedness" + type-theoretic encoding of measure theory (a common bottleneck in de-obfuscation efforts).
These 2 videos test the lexicon on different shapes: one broad-and-shallow, one narrow-and-deep. The pilot's refinements will inform the apply phase.
## 3. Deliverables
For each of the 2 pilot videos, 3 files in `artifacts/<slug>/`:
| Artifact | Description |
|---|---|
| `<slug>_translation.md` | Side-by-side table: original expression ↔ re-encoded form, with form anchor per row |
| `<slug>_deobfuscated.md` | The re-encoded report (replacement; same 8-section structure as Pass 1, but every standard-math expression is replaced with the constructive type-theoretic form) |
| `<slug>_decoder.md` | Per-term decoder: form anchor, etymology, definition history, link to original section |
Plus:
| Artifact | Description |
|---|---|
| `pilot_report.md` | Lexicon refinements discovered, concepts that didn't fit (gaps), process improvements for the apply phase |
**Optional (added per child track execution convention):** `plan.md`, `metadata.json`, `state.toml`.
## 4. Pipeline (5 phases)
Per the umbrella spec §5 (Phase 3 of the umbrella). Each phase commits atomically.
- [ ] **Phase 1: Init.** Initialize the child track.
- [ ] **Phase 2: Apply to `cs229_building_llms`.** Tier 3 worker (LLM invoked with the prompt template + the report). Produces 3-layer deliverable in `artifacts/cs229_building_llms/`.
- [ ] **Phase 3: Apply to `entropy_epiplexity`.** Same as above. Produces 3-layer deliverable in `artifacts/entropy_epiplexity/`.
- [ ] **Phase 4: Refine.** Write `pilot_report.md` capturing: lexicon refinements, concepts that didn't fit (gaps), process improvements.
- [ ] **Phase 5: User review + verification.** User reviews the 2 deliverables. Approves before the apply child can start. Idempotency + audit + end-of-track report.
## 5. Report structure (per pilot video)
For `<slug>_deobfuscated.md`, the structure is the same 8-section structure as Pass 1's report:
1. TL;DR
2. Key Concepts
3. Frame Analysis
4. Transcript Highlights
5. Mathematical / Theoretical Content (re-encoded)
6. Connections to Other Videos in Campaign
7. Open Questions / Follow-up
8. References
But every standard-math expression in §5 (and anywhere else) is replaced with the constructive type-theoretic form per the lexicon.
For `<slug>_decoder.md`, the per-term format:
```markdown
## Term: <name>
- Original notation: ...
- Re-encoded: ...
- Form anchor: ...
- Etymology: ...
- Definition history: ...
- Source sections in original: ...
```
## 6. Connections
- **Upstream:** consumes the refined lexicon from the lexicon child
- **Downstream:** the apply child consumes the pilot's `pilot_report.md` (refinements) + the (unchanged) lexicon
## 7. Verification (4 criteria per deliverable)
- [ ] **Lossless** — every Pass 1 concept is represented in the de-obfuscated form
- [ ] **Bounded** — no `∞_val` or `∞_card`; all values are finite forms
- [ ] **Constructively typed** — every expression has a type
- [ ] **Etymology-cited** — every new term has a 1-line origin + 1-line definition history in the decoder
## 8. See also
- [Umbrella spec.md](../../video_analysis_deob_20260621/spec.md)
- [Umbrella README.md](../../video_analysis_deob_20260621/README.md)
- [Lexicon child spec.md](../../video_analysis_deob_lexicon_20260621/spec.md)
- Pass 1 reports: `cs229_building_llms` + `entropy_epiplexity`