Incomplete MLflow cleanup after PR #1420 migration to OpenTelemetry

[atxtechbro]

Problem

After merging PR #1420 which replaced MLflow with OpenTelemetry observability stack, running source setup.sh still shows MLflow-related messages:

start-mlflow script not found. Skipping MLflow setup.

This indicates incomplete cleanup of MLflow references.

Root Cause Analysis

Found the following MLflow references that need cleanup:

1. Active Code References (need removal)

setup.sh:605-620 - Entire MLflow tracking setup section:

# MLflow tracking setup (self-healing with spilled coffee principle)
echo -e "${DIVIDER}"
echo "Setting up MLflow tracking..."

# Check if start-mlflow script exists
if [[ -x "$DOT_DEN/bin/start-mlflow" ]]; then
  # Use the start-mlflow script which handles all checks
  "$DOT_DEN/bin/start-mlflow" start
  # The script handles:
  # - Installing MLflow via uv if not present (spilled coffee principle)
  # - Checking if already running (idempotent)
  # - Starting in background if needed
  # - Silent operation to avoid noise
else
  echo -e "${YELLOW}start-mlflow script not found. Skipping MLflow setup.${NC}"
fi

README.md:72 - Reference to MLflow tracking in features list:

- **Telemetry and Feedback**: `bin/claude-with-tracking` wraps agent sessions with MLflow tracking for performance analysis and continuous improvement

knowledge/principles/snowball-method.md:11 - Reference to MLflow tracking:

With MLflow tracking, we transform ephemeral Claude sessions into queryable history.

2. Leftover Artifact Directory

mlruns/ - Untracked directory with MLflow artifacts (visible in git status)

3. Documentation (OK to keep)

observability/README.md - Contains appropriate historical context about migration from MLflow to OpenTelemetry. These references are intentional documentation and should remain.

Recommended Fix

1. Remove lines 605-620 from setup.sh
2. Update README.md:72 to reference the new OpenTelemetry observability stack instead
3. Update knowledge/principles/snowball-method.md:11 to reference OpenTelemetry instead of MLflow
4. Add mlruns/ to .gitignore if not already present, or delete the directory

Impact

• Minor: Users see confusing error message about removed feature
• The setup still completes successfully (non-blocking)
• No functional impact since MLflow is no longer used

Related

• PR feat: Replace MLflow with OpenTelemetry observability stack #1420: Replace MLflow with OpenTelemetry observability stack