ed/manual_slop
Private
Public Access
0
0
Fork 0
Code Activity
4,127 Commits 36 Branches 1 Tag
7ea414e988db91e14e7b0a3e41d3058bf2d2593d
Commit Graph
1959 Commits
Author SHA1 Message Date
ed 7ea414e988 conductor(spec): code_path_audit_20260607 v2 - data-pipeline + decomposition-cost lens 
Re-scopes the audit from 'expensive operations per action' (v1) to
'data pipelines per aggregate' (v2). The v1 framing was correct
2026-06-07 (the 4 foundational tracks were future) but is now
stale; v2 also cross-validates the data_structure_strengthening
+ data_oriented_error_handling deductions directly.

10 in-scope aggregates (Metadata, FileItem, FileItems,
CommsLogEntry, CommsLog, HistoryMessage, History, ToolDefinition,
ToolCall, Result[T]) + 3 candidate aggregates (ToolSpec,
ChatMessage, ProviderHistory; forward-compat placeholders for
any_type_componentization_20260621 which is NOT on master).

4 static analyses: PCG (3 AST passes), MemoryDim classifier,
APD (5 access patterns), CFE (7 frequencies). 11 public
functions, all return Result[T] per error_handling.md hard rule.

Decomposition-cost heuristic per aggregate answers: 'should
this data be componentize further (split) or unify further
(wider fat structs)?' 4 directions: componentize, unify, hold,
insufficient_data. 10-phase TDD plan, 69 tests total.

Consumes JSON from 6 existing audit scripts (cross-validates
data_structure_strengthening + data_oriented_error_handling).
Out-of-scope: runtime profiling (deferred to
pipeline_runtime_profiling_20260607), MMA worker spawn (cold).

v1 spec.md + plan.md preserved unchanged.
 2026-06-22 00:03:32 -04:00
ed 74e5521dca conductor(brain_counterintuitive): Phase 5 Verification - end-of-track report + state.toml completed 2026-06-22 00:01:34 -04:00
ed 702a3b649c conductor(brain_counterintuitive): Phase 4 Synthesis - report.md (1241 lines, 77KB) + summary.md (~400 words) 2026-06-22 00:00:10 -04:00
ed 7e61dd7d2f conductor(brain_counterintuitive): Phase 3 OCR - 91 frames OCR'd via winsdk in 14.7s 2026-06-21 23:54:17 -04:00
ed 327fb0d06d conductor(brain_counterintuitive): Phase 2 Keyframes - 91 unique frames (threshold 0.05) 2026-06-21 23:53:05 -04:00
ed 29dd6aa6be conductor(brain_counterintuitive): Phase 1 Acquire - transcript (358 clean segments, 12KB) + 175MB mp4 2026-06-21 23:51:41 -04:00
ed 1e404548e0 conductor(generic_systems_fields): Phase 5 Verification - end-of-track report + state.toml completed 2026-06-21 23:31:03 -04:00
ed 92b2ec4a75 conductor(generic_systems_fields): Phase 4 Synthesis - report.md (1720 lines, 100KB) + summary.md (~410 words) 2026-06-21 23:29:35 -04:00
ed d1d98c85ce conductor(generic_systems_fields): Phase 3 OCR - 33 frames OCR'd via winsdk in 1.9s 2026-06-21 23:21:11 -04:00
ed 3c4dd5c20f conductor(generic_systems_fields): Phase 2 Keyframes - 33 unique frames (threshold 0.05) 2026-06-21 23:18:21 -04:00
ed 99e955795f conductor(generic_systems_fields): Phase 1 Acquire - transcript (885 clean segments, 30KB) + 58MB mp4 2026-06-21 23:16:13 -04:00
ed 900b68009b conductor(free_lunches_levin): Phase 5 Verification - end-of-track report + state.toml completed 2026-06-21 23:07:20 -04:00
ed 35746d59ec conductor(free_lunches_levin): Phase 4 Synthesis - report.md (1628 lines, 105KB) + summary.md (~400 words) 2026-06-21 23:05:51 -04:00
ed 8ff397cfd7 conductor(free_lunches_levin): Phase 3 OCR - 67 frames OCR'd via winsdk in 2.3s 2026-06-21 22:57:26 -04:00
ed 85799bdef1 conductor(free_lunches_levin): Phase 2 Keyframes - 67 unique frames (threshold 0.05) 2026-06-21 22:55:36 -04:00
ed 593da35589 conductor(free_lunches_levin): Phase 1 Acquire - transcript (1539 clean segments, 55KB) + 67MB mp4 2026-06-21 22:54:26 -04:00
ed cbc6592938 conductor(platonic_intelligence_kumar): Phase 5 Verification - end-of-track report + state.toml completed 2026-06-21 22:41:50 -04:00
ed 8bb7bc0b03 conductor(platonic_intelligence_kumar): Phase 4 Synthesis - report.md (1564 lines, 104KB) + summary.md (384 words) 2026-06-21 22:40:27 -04:00
ed 751b94d4e8 Revert "merge: tier2/phase2_4_5_call_site_completion_20260621 (parent + follow-up + Phase 6e analysis)" 
This reverts commit f914b2bcd4, reversing
changes made to 7fef95cc87.
 2026-06-21 22:39:14 -04:00
ed f32e4fd268 conductor(platonic_intelligence_kumar): Phase 3 OCR - 62 frames OCR'd via winsdk in 3.7s 2026-06-21 22:33:09 -04:00
ed f690b4dea4 conductor(platonic_intelligence_kumar): Phase 2 Keyframes - 62 unique frames from 133 raw (threshold 0.05) 2026-06-21 22:30:59 -04:00
ed f914b2bcd4 merge: tier2/phase2_4_5_call_site_completion_20260621 (parent + follow-up + Phase 6e analysis) 
Merges 39 commits from tier2 sandbox:
- any_type_componentization_20260621 parent (48/89 fat-struct sites; Phases 1,2,4,5 complete; Phase 3 deferred)
- phase2_4_5_call_site_completion_20260621 follow-up (Phases 6a broadcast fix + 6b sender migration + 6e Phase 3 cost analysis; Phase 6d was a no-op)
- docs/reports/PHASE3_TIER2_ANALYSIS.md (Tier 2 authoritative cost analysis; supersedes Tier 1's draft)

Unblocks code_path_audit_20260607:
- Phase 6a fixes the broadcast() TypeError that contaminated per-action profiling
- Phase 6e provides the cost hypothesis the audit will quantify
 2026-06-21 22:30:10 -04:00
ed 7fef95cc87 conductor(platonic_intelligence_kumar): Phase 1 Acquire - transcript (1659 clean segments, 61KB) + 89MB mp4 2026-06-21 22:29:25 -04:00
ed c760b8e09d conductor(score_dynamics_giorgini): Phase 5 Verification - end-of-track report + state.toml completed 2026-06-21 22:21:05 -04:00
ed f1d157bf33 conductor(score_dynamics_giorgini): Phase 4 Synthesis - report.md (1325 lines, 93KB) + summary.md (354 words) 2026-06-21 22:19:42 -04:00
ed 077cdf20db conductor(score_dynamics_giorgini): Phase 3 OCR - 31 frames OCR'd via winsdk in 2.3s 2026-06-21 22:13:03 -04:00
ed edd2f181eb conductor(score_dynamics_giorgini): Phase 2 Keyframes - 31 unique frames from 91 raw (threshold 0.05) 2026-06-21 21:45:49 -04:00
ed 16fbf5619f conductor(score_dynamics_giorgini): Phase 1 Acquire - transcript (1485 clean segments, 46.5KB) + 178MB mp4 2026-06-21 20:43:50 -04:00
ed 7c3052c893 conductor(archive): ship phase2_4_5_call_site_completion_20260621 (4 phases + report) 
Updates:
- conductor/tracks.md: entry #27 marked SHIPPED 2026-06-21; BLOCKER
  removed for code_path_audit_20260607 (broadcast() TypeError fixed)
- state.toml: status=completed, current_phase=6, all 4 phases marked
  completed with checkpoint SHAs, all verification booleans true

NOT shipped (per user instruction):
- The git mv to conductor/tracks/archive/ is the USER's responsibility
- Track directory stays at conductor/tracks/phase2_4_5_call_site_completion_20260621/
- tier2/any_type_componentization_20260621 branch NOT merged (reconnaissance framing)
 2026-06-21 20:00:11 -04:00
ed 1dce32037a un-archive data structure strengthening 2026-06-21 19:18:14 -04:00
ed 91775ee391 Merge branch 'master' of C:\projects\manual_slop into tier2/any_type_componentization_20260621 2026-06-21 19:08:35 -04:00
ed 6275c860bf conductor(spec+plan): add Phase 6e to follow-up - Tier 2 authoritative Phase 3 cost deduction 
The follow-up track now includes Phase 6e: Tier 2 produces the authoritative
Phase 3 cost analysis as part of the follow-up work. Tier 2 is in
src/ai_client.py doing Phase 6b/6d anyway; they have full context to produce
the refined cost hypothesis that Tier 1's draft at PHASE3_HYPOTHETICAL_PROMOTION.md
could not (Tier 1 worked without the 6b/6d ground-truth context).

Tier 1's draft STAYS as the hypothesis doc. Tier 2's PHASE3_TIER2_ANALYSIS.md
is the refined version (per-sender cost summary + hidden call sites table
+ recommendations for the future Phase 3 track + cross-reference to Tier 1
explicit).

Phase 6e tasks (5 total, ~2 commits):
- t6e_1: Profile the 6 senders (codepath catalog + hidden cross-refs)
- t6e_2: Qualitative cost estimation per sender
- t6e_3: Identify hot iteration sites needing 'with h.lock:' pattern
- t6e_4: Author PHASE3_TIER2_ANALYSIS.md
- t6e_5: Phase 6e checkpoint commit + git note

Total estimated commits: 16 -> 18 (still within Tier 2 1-4 hour budget).

Files updated:
- conductor/tracks/phase2_4_5_call_site_completion_20260621/spec.md (+50 lines)
- conductor/tracks/phase2_4_5_call_site_completion_20260621/plan.md (+146 lines)
- conductor/tracks/phase2_4_5_call_site_completion_20260621/metadata.json (+13 lines)
- conductor/tracks/phase2_4_5_call_site_completion_20260621/state.toml (+9 lines)
- conductor/tracks.md (track 27 entry expanded with Phase 6e details)
 2026-06-21 18:55:54 -04:00
ed 1a739ecef5 conductor(spec+plan): phase2_4_5_call_site_completion_20260621 + code_path_audit pre-flight adjustments + Phase 3 analysis 
PHASE 2/4/5 FOLLOW-UP TRACK (Tier 1 decided SHINK to 6a + 6b + 6d):
- Phase 6a: Fix HookServer.broadcast() callers (app_controller.py + events.py + gui_2.py)
  Adds tests/test_websocket_broadcast_regression.py with no-TypeError assertion
- Phase 6b: Complete _send_grok/_send_minimax/_send_llama OpenAICompatibleRequest migration
- Phase 6d: Update those 3 senders' NormalizedResponse to use UsageStats

Total: ~16 atomic commits, ~3 hours Tier 2 work. Unblocks code_path_audit_20260607.

CODE_PATH_AUDIT_20260607 PRE-FLIGHT ADJUSTMENTS (per handoffs):
- Add 2 new actions: provider_history_append + websocket_broadcast
- Add 5 micro-benchmarks: NormalizedResponse.__init__, WebSocketMessage.__init__,
  UsageStats.__init__, ProviderHistory.lock, ToolSpec.__init__
- Add no-TypeError-errors-on-any-thread assertion (backs test_websocket_broadcast_regression.py)
- Add 89 fat-struct sites from ANY_TYPE_AUDIT_20260621.md as instrumented targets
- BLOCKER: phase2_4_5_call_site_completion_20260621 (broadcast() TypeError)

PHASE 3 HYPOTHETICAL ANALYSIS (separate doc):
docs/reports/PHASE3_HYPOTHETICAL_PROMOTION.md - dataclass definitions (already on tier2 branch),
per-provider codepath catalog (112 sites), qualitative cost estimation (~+1-2ms per session,
~+8-15us per _send_anthropic turn). Input for the audit; the audit quantifies the cost.

REGISTRATION:
conductor/tracks.md updated: new row 27 (follow-up), new row 28 (parent any_type_componentization),
row 17 (code_path_audit) updated with pre-flight adjustments note.

Files:
- conductor/tracks/phase2_4_5_call_site_completion_20260621/spec.md (NEW; 633 lines)
- conductor/tracks/phase2_4_5_call_site_completion_20260621/plan.md (NEW; 7 phases, 23 tasks)
- conductor/tracks/phase2_4_5_call_site_completion_20260621/metadata.json (NEW; 8.8KB)
- conductor/tracks/phase2_4_5_call_site_completion_20260621/state.toml (NEW; 11.8KB)
- docs/reports/PHASE3_HYPOTHETICAL_PROMOTION.md (NEW; 380 lines; qualitative cost analysis)
- conductor/tracks/code_path_audit_20260607/spec.md (MODIFIED; +93 lines Pre-Flight Adjustments)
- conductor/tracks.md (MODIFIED; +35 lines: 3 new entries + 1 stale row fix)
 2026-06-21 18:32:02 -04:00
ed 3172a6ac1d Merge branch 'master' of C:\projects\manual_slop into tier2/any_type_componentization_20260621 2026-06-21 17:46:57 -04:00
ed ea8bcdf389 conductor(entropy_epiplexity): Phase 5 Verification - end-of-track report + state.toml completed 2026-06-21 17:16:05 -04:00
ed 275f34da6e conductor(entropy_epiplexity): Phase 4 Synthesis - report.md (1,018 lines) + summary.md (341 words) 
Deep-dive report covers all 8 sections per umbrella spec FR6:
- TL;DR: epiplexity as observer-relative information measure
- Key Concepts: 18 numbered concepts
- Frame Analysis: 176 unique frames from research talk
- Transcript Highlights: 10+ verbatim passages with timestamps
- Mathematical Content: 12 derivations (Shannon, Kolmogorov, Levin, sophistication, epiplexity)
- Connections: forward refs to 8 other videos
- Open Questions: 14 questions for Pass 2
- References: people, concepts, resources

Plus 9 appendices: concept map, transcript excerpts (C.1-C.12), math foundations (D.1-D.10), framework connections (E.1-E.7), cross-references (G.1-G.9), resources, final notes.

Lossless preservation per umbrella spec §0.
 2026-06-21 17:15:10 -04:00
ed 4a774eb341 conductor(verify): track completion artifacts - TRACK_COMPLETION + audit baselines + registry 
Phase 6 (verification) artifacts for any_type_componentization_20260621.
The user handles the archive move (NOT done by Tier 2; reverted
a premature git mv per user instruction).

END-OF-TRACK REPORT (NEW):
- docs/reports/TRACK_COMPLETION_any_type_componentization_20260621.md
  (289 lines)
- Per-phase results table (0/1/2/4/5 complete; 3 partial)
- 48 sites promoted (1:8 + 2:17 + 4:7 + 5:16); 41 sites deferred (Phase 3 call-site migration)
- 7 architectural invariants established (frozen=True pattern; TypeAlias;
  JsonValue; ProviderHistory threading; SDK holders stay Any; etc.)
- Deferred-work section: provider_state_migration_2026MMDD follow-up track

STATE.TOML UPDATE:
- status: active -> completed
- current_phase: 2 -> 6
- (track stays at conductor/tracks/any_type_componentization_20260621/;
  archive move is the user's responsibility per Tier 2 conventions)

AUDIT BASELINE REGENERATION:
- scripts/audit_weak_types.baseline.json: 112 -> 115 (regenerated)
- 3 net new sites added by the new src/ files (openai_schemas: 10;
  log_registry: 10; provider_state: ?; api_hooks: ?). The new sites
  are at to_dict() / from_dict() / Optional[tuple[...]] serialization
  boundaries which are Pattern 5 (generic serialization; stay as Any).
- Both CI gates pass: STRICT OK: 115 <= 115; STRICT OK: 200 <= 207

TYPE REGISTRY REGENERATION (NEW/MODIFIED/DELETED):
- index.md: 18 -> 22 .md files
- src_api_hooks.md (NEW; Phase 5 WebSocketMessage)
- src_log_registry.md (NEW; Phase 4 Session + SessionMetadata)
- src_openai_schemas.md (NEW; Phase 2 ToolCall + ChatMessage + UsageStats + NormalizedResponse + OpenAICompatibleRequest)
- src_provider_state.md (NEW; Phase 3 ProviderHistory + _PROVIDER_HISTORIES)
- src_openai_compatible.md (DELETED; dataclasses moved to src_openai_schemas.md)
- src_type_aliases.md (MODIFIED; +JsonPrimitive + JsonValue)
- type_aliases.md (MODIFIED; registry index entry updated)

VERIFICATION COMMANDS (all pass):
  uv run python scripts/audit_weak_types.py --strict
    STRICT OK: 115 weak sites <= baseline 115
  uv run python scripts/audit_dataclass_coverage.py --strict
    STRICT OK: 200 weak sites <= baseline 207
  uv run python scripts/generate_type_registry.py --check
    Registry in sync (22 files checked)
  ~130 targeted tests pass across 13 test files (see TRACK_COMPLETION §4)
 2026-06-21 17:07:22 -04:00
ed 5c5f347cf0 conductor(entropy_epiplexity): Phase 1-3 Acquire+Keyframes+OCR - transcript.json (~5k segments via yt-dlp), 176 unique frames (214 raw), OCR in 30s 
Note: 364MB mp4 video. 176 frames after imagehash dedup (hamming<5).
 2026-06-21 17:07:07 -04:00
ed 901b1b0982 conductor(probability_logic): Phase 5 Verification - end-of-track report + state.toml completed 
TRACK COMPLETE for child #2. All 7 deliverable artifacts present, report.md 1045 lines (within 1000-10000 target), summary.md 333 words (within 200-400 target), no TBDs.

10 children + 1 synthesis remaining in campaign.
 2026-06-21 16:46:19 -04:00
ed cb85591fc8 conductor(probability_logic): Phase 4 Synthesis - report.md (1,045 lines) + summary.md (333 words) 
Deep-dive report covers all 8 sections per umbrella spec FR6:
- TL;DR: probability as extension of logic
- Key Concepts: 32 numbered concepts
- Frame Analysis: 25 frames (12 chat-only, 13 presentation)
- Transcript Highlights: 16 verbatim passages with timestamps
- Mathematical Content: 15 derivations
- Connections: forward refs to 9 other videos
- Open Questions: 14 questions for Pass 2
- References: people, concepts, resources

Plus 6 appendices: concept map, lossless preservation audit, detailed transcript excerpts (sections C.1-C.15), math derivations (D.1-D.8), LLM connections, quick reference formulas.

Lossless preservation per umbrella spec §0.
 2026-06-21 16:45:39 -04:00
ed e19672b2e0 conductor(plan): Phase 3 partial - provider_state + tests; call-site migration deferred 2026-06-21 16:44:28 -04:00
ed ca4826ab31 conductor(probability_logic): transcript_clean.txt (10k words) + presentation frame extractor 2026-06-21 16:41:42 -04:00
ed 4dd373d70d conductor(probability_logic): Phase 3 OCR - 25 frames OCR'd in 1.8s via winsdk 2026-06-21 16:40:04 -04:00
ed f855967bb8 conductor(probability_logic): Phase 2 Keyframes - 25 unique frames (threshold 0.05; low-motion math lecture) 2026-06-21 16:39:43 -04:00
ed 7478090e71 conductor(probability_logic): Phase 1 Acquire - transcript.json (3315 segments via yt-dlp VTT fallback) + video.log (84MB mp4 downloaded) 
Generic reusable drivers added: phase1_acquire.py, phase2_keyframes.py, phase3_ocr.py take slug as arg for batch use across all 12 children.
 2026-06-21 16:32:19 -04:00
ed b942c3f8b9 conductor(plan): fill t2_9 SHA + phase_2 checkpoint 2026-06-21 16:31:19 -04:00
ed 4bfce93105 conductor(plan): mark Phase 2 complete (t2_6 deferred to Phase 3) 
Phase 2 (openai_schemas) progress:
- t2_1-t2_5+t2_7-t2_8 (a96f946b): 19 tests pass; NormalizedResponse +
  OpenAICompatibleRequest refactored to dataclasses
- t2_6 (deferred): _send_grok + _send_minimax + _send_llama in
  src/ai_client.py still use legacy NormalizedResponse(text=..., tool_calls=[], usage_*_tokens=...)
  kwargs. These will be updated in Phase 3 (provider_state) as part of
  the ai_client refactor.
- t2_9: Phase 2 checkpoint (commit hash filled in this commit)

current_phase: 2 -> 3
phase_2.status: pending -> completed

Next: Phase 3 - provider_state (15 tasks; the largest phase).
 2026-06-21 16:30:29 -04:00
ed fd95ea4879 conductor(cs229): Phase 5 Verification - end-of-track report + state.toml completed 2026-06-21 16:28:24 -04:00
ed 1872b66f68 conductor(cs229): Phase 4 Synthesis - report.md (1,157 lines, 100KB) + summary.md (364 words) + transcript_clean.txt 
Deep-dive report covers all 8 sections per umbrella spec FR6:
- TL;DR: 6-pillar LLM training framework
- Key Concepts: 31 numbered concepts
- Frame Analysis: 115 frames organized by topic
- Transcript Highlights: 18 verbatim passages with timestamps
- Mathematical Content: 14 formal derivations
- Connections: forward refs to all 11 other videos
- Open Questions: 14 questions for Pass 2
- References: people, courses, papers, resources

Plus 11 appendices (A-O): full transcript sections, frame inventory, OCR reference, Q&A log, glossary, cross-references, future work.

Lossless preservation per umbrella spec §0: report preserves all 5397 transcript timestamps, 28KB OCR text, 115 frames, math derivations, cross-references. R5 mitigation verified (yt-dlp works despite oEmbed 401).

Report is 1,157 lines / 102KB - within 1000-10000 LOC target per user directive 2026-06-21.
 2026-06-21 16:27:15 -04:00
ed 0318bfe9e2 conductor(plan): fill t1_8 commit_sha + phase_1 checkpoint 2026-06-21 16:16:34 -04:00