WIP almost done with track planning

This commit is contained in:
2026-03-06 15:00:15 -05:00
parent 2c90020682
commit 3b79f2a4e1
77 changed files with 1186 additions and 674 deletions

View File

@@ -0,0 +1,9 @@
# Tool Usage Analytics
**Track ID:** tool_usage_analytics_20260306
**Status:** Planned
**See Also:**
- [Spec](./spec.md)
- [Plan](./plan.md)

View File

@@ -0,0 +1,9 @@
{
"id": "tool_usage_analytics_20260306",
"name": "Tool Usage Analytics",
"status": "planned",
"created_at": "2026-03-06T00:00:00Z",
"updated_at": "2026-03-06T00:00:00Z",
"type": "feature",
"priority": "medium"
}

View File

@@ -1,16 +1,25 @@
# Implementation Plan: Tool Usage Analytics (tool_usage_analytics)
# Implementation Plan: Tool Usage Analytics (tool_usage_analytics_20260306)
## Phase 1: Research & Design
- [ ] Task: Analyze existing backend implementation
- [ ] Task: Design GUI/UX approach
- [ ] Task: Conductor - User Manual Verification
## Phase 1: Data Collection
- [ ] Task: Initialize MMA Environment
- [ ] Task: Verify tool_log_callback
- WHERE: src/ai_client.py
- WHAT: Check existing logging
## Phase 2: Implementation
- [ ] Task: Implement feature
- [ ] Task: Write tests
- [ ] Task: Conductor - User Manual Verification
## Phase 2: Aggregation
- [ ] Task: Implement usage aggregation
- WHERE: src/gui_2.py or new module
- WHAT: Count tools, avg times, failures
- HOW: Process tool_log entries
- SAFETY: Efficient data structures
## Phase 3: Verification
- [ ] Task: Run test suite
- [ ] Task: Verify coverage
- [ ] Task: Conductor - Phase Completion Verification
## Phase 3: Visualization
- [ ] Task: Render analytics
- WHERE: src/gui_2.py
- WHAT: Charts and tables
- HOW: imgui tables, plot_lines
- SAFETY: Handle empty data
## Phase 4: Verification
- [ ] Task: Test analytics
- [ ] Task: Conductor - Phase Verification

View File

@@ -1,26 +1,21 @@
# Track Specification: Tool Usage Analytics
# Track Specification: Tool Usage Analytics (tool_usage_analytics_20260306)
## Overview
Analytics panel for tool usage patterns.
Analytics panel showing most-used tools, average execution time, and failure rates. Uses existing tool_log_callback data.
## Current State Audit
### Already Implemented
- tool_log_callback
- Tool execution tracking
### Gaps to Fill
- No analytics UI
- No aggregation
## Goals
- Most-used tools ranking
- Average execution time
- Failure rate tracking
## Architectural Constraints
- **Efficient Aggregation**: Analytics MUST use efficient data structures.
- **Memory Bounds**: History MUST be bounded to prevent growth.
## Functional Requirements
- Usage histograms
- Time series data
- Failure logging
- **Usage Ranking**: Show most-used tools ranked by count.
- **Avg Time**: Display average execution time per tool.
- **Failure Rate**: Track and display failure percentage per tool.
- **Time Series**: Show usage over time.
## Non-Functional Requirements
- Efficient data aggregation
## Acceptance Criteria
- [ ] Tool ranking displayed.
- [ ] Average times accurate.
- [ ] Failure rates tracked.
- [ ] Time series visualization works.
- [ ] Uses existing tool_log_callback.