Private
Public Access
0
0
Commit Graph

18 Commits

Author SHA1 Message Date
ed 0b79798eaf feat(audit): MVP output - AUDIT_REPORT.md only, move stale to _stale/
MVP pipeline simplification:
- render_rollups() now produces ONLY summary.md + AUDIT_REPORT.md
- run_audit() now produces only per-aggregate .md (no .dsl/.tree)
- New src/code_path_audit_gen.py generates the single coherent report

Stale artifacts moved to _stale/ subdirectory (preserved for history):
- 13 per-aggregate .dsl files (redundant with .md)
- 13 per-aggregate .tree files (redundant with .md)
- 9 old top-level rollups (cross_audit_summary, decomposition_matrix,
  candidates, field_usage, call_graph, hot_paths, dead_fields,
  ssdl_analysis, organization_deductions - all superseded by sections
  inlined in AUDIT_REPORT.md)
- _stale/README.md explains what happened

Meta-audit updated to check .md files (14 required H2 sections per
aggregate) instead of .dsl files. 0 violations on 10 real profiles.

Tests: 131 passing. New MVP report: 5000+ lines.
2026-06-22 13:34:29 -04:00
ed f7f616abb9 feat(audit): alias resolution - all real aggregates now have data 2026-06-22 12:52:22 -04:00
ed 077149011b fix(audit): real line numbers + entry.get() field-access detection + Optional/dict/Union patterns
Three real bugs fixed:
1. FunctionRef always used line=0. Now passes node.lineno from AST.
2. P3_pass results were discarded with bare pass. Now stored in
   ProducerConsumerGraph.field_accesses.
3. Field-access detector only saw entry['key']; missed entry.get('key')
   which is the dominant pattern in this codebase. Now handles both.

Plus _extract_type_name() helper handles Optional[T], dict[str, T],
list[T], Result[T], Union[T, ...], and T | None (PEP 604) so P1/P2
catch more annotation patterns.

Real numbers (Metadata aggregate):
- producers: 77 -> 117
- consumers: 35 -> 66
- field-access sites: 130 -> 173
- line numbers: all real (line 1281, 1746, etc.)

AUDIT_REPORT.md grew 2009 -> 3140 lines with real evidence.
Total audit output: 5176 lines / 50 files (was 2415 / 49).

All 131 tests still passing.
2026-06-22 12:20:32 -04:00
ed 783e5fd9fe feat(audit): SSDL analysis - effective codepaths + nil-sentinel + organization verdict
- src/code_path_audit_ssdl.py: 9 functions translating per-aggregate findings
  into SSDL primitives (compute_effective_codepaths, count_branches_in_function,
  detect_nil_check_pattern, compute_field_access_efficiency,
  suggest_defusing_technique, render_ssdl_sketch/rollup,
  render_organization_deductions).
- src/code_path_audit.py:render_rollups() now emits ssdl_analysis.md
  + organization_deductions.md alongside the existing 8 rollups.
- src/code_path_audit_render.py:render_full_markdown() adds SSDL sketch
  section per profile (effective codepaths + defusing recommendations).

Real findings (Metadata aggregate):
- 35 consumers, 251 total branches, 1.13e18 effective codepaths
- 6 nil-check functions (candidates for [N] sentinel)
- 130 field-access sites, 0% typed (candidates for immediate-mode cache)
- Verdict: needs restructuring

Audit output grew 2136 -> 2415 lines. All 131 tests pass.
Meta-audit clean (0 violations).
2026-06-22 11:44:00 -04:00
ed 558258cffd feat(audit): rich rollups + per-line indentation fix - 2136 total lines
Added 3 new top-level rollups (hot_paths.md, dead_fields.md,
plus enriched summary.md, candidates.md, decomposition_matrix.md):
- summary.md: per-aggregate memory_dim + access pattern tables,
  full cross-validation verdict per aggregate
- decomposition_matrix.md: all 10 aggregates ranked by current cost,
  flagged-for-refactoring section, insufficient_data section
- candidates.md: ranked optimization candidates with detail per step
- hot_paths.md: top 5 hot consumers per aggregate (by field access count)
- dead_fields.md: fields accessed (per-consumer breakdown)

Total report: 2136 lines (was 1814).
2026-06-22 10:29:01 -04:00
ed 59eeee819e feat(audit): enriched markdown renderer - 15 sections per profile + 2 new rollups
render_full_markdown in src/code_path_audit_render.py produces
detailed per-profile markdown:
- Producers detail (grouped by file)
- Consumers detail (grouped by file)
- Field access matrix (every field x every consumer)
- Access pattern (dominant + per-function distribution)
- Frequency (aggregate + per-function)
- Result coverage table
- Type alias coverage table (typed vs untyped sites)
- Cross-audit findings (per-bucket tables)
- Decomposition cost (8 metrics)
- Struct shape inference (inferred from producer returns)
- Optimization candidates (concrete refactor steps + affected files)
- Verdict
- Evidence appendix (every per-function item)

New rollups:
- field_usage.md: cross-aggregate field access frequency
- call_graph.md: producer/consumer tables grouped by aggregate

Total report: 1814 lines (was 1204).
2026-06-22 10:12:48 -04:00
ed 67ca680a05 feat(audit): per-aggregate cross_audit mapping via PCG file-index
The aggregate_findings function now does 3-tier mapping:
1. Function lookup (find_enclosing_function) -> exact match
2. File-level fallback: if the finding's file has any
   producer/consumer of the aggregate, bucket it there
3. Unbucketed (the file has no aggregate refs)

Handles both 'file' and 'filename' keys (v1 audit scripts use
'filename'; spec fixtures use 'file'). Path normalization
for Windows paths.

Generated the 6 real audit_inputs from scripts/audit_*.py
against real src/. The Metadata aggregate now shows:
- 1 unique weak_types finding (1 site, from ai_client.py:159)
- 1 unique exception_handling finding (76 sites from PARAM_OPTIONAL)

mcp_client.py shows 0 because no Metadata producer/consumer
exists in the PCG for mcp_client (P1/P2 only detect typed
parameter signatures, not internal field access). The next
gap is expanding P3 to capture internal field use.
2026-06-22 09:48:56 -04:00
ed 8d2dffd7c5 feat(audit): wire cross_audit_findings aggregator into synthesize
Loops over audit_weak_types + audit_exception_handling from
the 6 audit_inputs, calls aggregate_cross_audit_findings per
audit, sums the buckets per profile.

Cross-audit aggregation is per-aggregate-flat (all findings go
into 1 bucket per audit). The 3-tier finding-to-aggregate
mapping (find_enclosing_function + type registry + file
heuristic) is the next gap - requires per-finding site
classification.
2026-06-22 09:14:40 -04:00
ed 85f5808ae3 feat(audit): real analysis - consumer fields, struct size, decomp 2026-06-22 09:08:41 -04:00
ed c82538474f feat(audit): implement Phase 8 v2 DSL + Phase 9 run_audit + CLI + MCP
Phase 8: to_dsl_v2 (flat-section writer, 14 sections),
to_markdown (10 sections), to_tree (box-drawing prefix tree),
parse_dsl_v2 (round-trip parser).

Phase 9: AGGREGATES_IN_SCOPE (10) + CANDIDATE_AGGREGATES (3),
synthesize_aggregate_profile (per-aggregate builder, candidate
placeholder path), AuditSummary dataclass, run_audit() main
entry, render_rollups() (4 top-level files: summary,
cross_audit_summary, decomposition_matrix, candidates),
code_path_audit_v2() MCP tool wrapper.

13 new unit tests passing. 124 total tests passing.

Phase 10 (integration tests with synthetic src/) next - may be
deferred to next session if context runs low.
2026-06-22 01:59:07 -04:00
ed e59334a303 feat(audit): implement Phase 7 cross-audit integration + Phase 8.1 DSL arity
Phase 7: read_input_json (stdlib I/O boundary), INPUT_JSON_CONTRACTS
(6 input sources), find_enclosing_function (3-tier mapping tier 1),
compute_result_coverage (cross-check of doeh), compute_type_alias_coverage
(cross-check of dss), aggregate_cross_audit_findings (per-aggregate
bucketing), run_all_cross_audit_reads (convenience).

Phase 8 Task 8.1: DSL_WORD_ARITY_V2 (14 new tagged words).

15 new unit tests passing. 111 total tests passing.

Phase 8 Tasks 8.2-8.5 (4 renderers + parser) next.
2026-06-22 01:49:14 -04:00
ed cca59668c8 feat(audit): implement Phase 5 CFE + Phase 6 Decomposition Cost (11 tasks)
Phase 5 CFE: detect_frequency_from_entry_point + 6 caller sets
(INIT/HOT/PER_TURN/COLD/PER_DISCUSSION/PER_REQUEST),
load_frequency_overrides (tomllib), estimate_call_frequency with
3-tier precedence (override > entry-point > unknown).

Phase 6 Decomposition Cost: 6 cost-model constants (per spec 7.5),
per_call_cost_us formula, FREQUENCY_MULTIPLIER (7 frequencies),
current_total_us, componentize_factor lookup, unify_factor lookup,
recommended_direction (5-step precedence with frozen whole_struct
-> hold override), generate_rationale auto-string, and
compute_decomposition_cost main entry.

33 new unit tests passing (Phase 5: 11, Phase 6: 22).
96 total tests passing.

Phase 7 (Cross-audit integration) next.
2026-06-22 01:40:32 -04:00
ed c1d2f0e454 feat(audit): implement Phase 3 MemoryDim + Phase 4 APD (11 tasks)
Phase 3: MemoryDim classifier with canonical mappings (23 entries,
includes ToolSpec/ChatMessage/ProviderHistory now that they're real),
file-of-origin heuristic (5 buckets), TOML override loader,
classify_memory_dim() with 3-tier precedence.

Phase 4: APD with 4 threshold constants, 5 pattern detectors
(whole_struct, field_by_field, hot_cold_split, bulk_batched,
dominant_pattern), detect_access_pattern() main entry.

30 new unit tests passing (Phase 3: 11, Phase 4: 19).
63 total tests passing.

Phase 5 (CFE - Call Frequency Estimator) next.
2026-06-22 01:26:06 -04:00
ed 200396e4a5 feat(audit): implement Phase 2 PCG (5 tasks: skeleton + P1+P2+P3+build_pcg)
Phase 2 PCG: ProducerConsumerGraph (bipartite aggregate<->function)
+ 3 AST passes (P1 return-type, P2 parameter-type, P3 field-access)
+ build_pcg() main entry returning Result[ProducerConsumerGraph].

14 new unit tests passing (2 PCG + 3 P1 + 3 P2 + 3 P3 + 3 build_pcg).

The build_pcg() function tolerates syntax errors per the stdlib
I/O boundary pattern (records ErrorInfo, continues).

Phase 2 complete: 33 unit tests passing. Phase 3 (MemoryDim
classifier with canonical mappings) next.
2026-06-22 01:18:54 -04:00
ed ef207cf684 feat(audit): complete Phase 1 data model (8 dataclasses, 12 new tests)
Tasks 1.3-1.10: AccessPatternEvidence, FrequencyEvidence,
ResultCoverage, TypeAliasCoverage, CrossAuditFinding,
CrossAuditFindings, DecompositionCost, OptimizationCandidate,
AggregateProfile. All frozen dataclasses per error_handling.md
Pattern 1 (immutability for cross-thread safety).

Phase 1 complete: 19 unit tests passing (5 enum tests + 14
dataclass tests). AggregateProfile is the central artifact with
14 required fields + 2 optional (mermaid, markdown).

Phase 2 (PCG - 3 AST passes + build_pcg()) next.
2026-06-22 01:10:57 -04:00
ed 1680182953 feat(audit): add FunctionRef dataclass (frozen, 4 fields)
fqname, file, line, role. Used in ProducerConsumerGraph edges
and per-aggregate producer/consumer lists. Per error_handling.md
Pattern 1 (immutability for cross-thread safety).
2 unit tests passing.
2026-06-22 01:05:17 -04:00
ed 5dca69f0d7 feat(audit): add 5 enums for the v2 data model
AggregateKind (4 values), MemoryDim (7), AccessPattern (5),
Frequency (7), RecommendedDirection (4). All Literal types
for stable postfix DSL output (string-valued, no enum-name
lookup table needed in the parser).

5 unit tests passing. The 9 supporting dataclasses + the
AggregateProfile central artifact go in Tasks 1.2-1.10.
2026-06-22 00:46:00 -04:00
ed e9d1867bbc chore(audit): create empty src/code_path_audit.py v2
Module docstring + from __future__ import annotations. No code
yet; the data model goes in next (Phase 1).
2026-06-22 00:41:33 -04:00