Repository navigation
chore(roadmap): add token-bench and tool-graph epics - #1047
Merged
Merged
Conversation
Deploying mcpproxy-docs with
|
| Latest commit: |
d4fa1c1
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://c2306fe2.mcpproxy-docs.pages.dev |
| Branch Preview URL: | https://chore-roadmap-token-bench-to.mcpproxy-docs.pages.dev |
|
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Contributor
📦 Build ArtifactsWorkflow Run: View Run Available Artifacts
How to DownloadOption 1: GitHub Web UI (easiest)
Option 2: GitHub CLI gh run download 32816870910 --repo smart-mcp-proxy/mcpproxy-go
|
Two new backlog epics: - token-bench (P1): measure real token cost across every routing/savings mode combo (baseline, compact 085, deferred schemas 102, optimistic calling, code_execution 096, stored scripts 097) on replayed sessions and public suites, then publish the numbers on mcpproxy.app/blog. Absorbs the standalone discovery-eval-harness epic, which is now marked SUPERSEDED and points at token-bench-harness. - tool-graph (P2): experimental, flag-gated local co-occurrence graph mined from the activity log — next-tool hints, session-aware ranking, workflow mining and usage-chain analytics. Stacks on #1041 (chore/roadmap-truth-sync); token-bench depends on the schema-deferred epic added there. Merge after #1041. ROADMAP.md regenerated; gen-roadmap.py --check passes.
Dumbris
force-pushed
the
chore/roadmap-token-bench-tool-graph
branch
from
August 25, 2026 11:20
126cc05 to
d4fa1c1
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacks on #1041 (
chore/roadmap-truth-sync) — merge this after #1041. Branched off that PR's head, so until #1041 lands GitHub shows its commit in this diff too. Onlyroadmap.yaml+ROADMAP.mdchange here.Adds two backlog epics:
token-bench(P1, depends onschema-deferredfrom chore(roadmap): sync statuses — QA-gate T2 done, mcp-2026 unblocked, specs 101/102 tracked #1041) — measure the real token cost of every routing/savings mode combination (baseline, compact signatures 085, deferred schemas 102, optimistic calling via self-healing pre-dispatch validation,code_execution096, stored scripts 097) on replayed real sessions and public suites, then publish results + methodology on mcpproxy.app/blog. Tasks: replay harness → public suites → blog post, plus a heartbeat v10 per-tool_response_modetoken counter for real-world cohort validation.tool-graph(P2) — experimental, flag-gated (experimental.tool_graph, off by default) local-only co-occurrence graph mined from the activity log:related_toolshints, session-aware rank boost inretrieve_tools, workflow mining into suggested stored scripts (097 synergy), and usage-chain analytics.The standalone
discovery-eval-harnessepic is folded intotoken-bench-harness: the file has no superseded/tombstone convention, so the epic is kept as a pointer with aSUPERSEDED — folded into token-bench-harness … do not build standalonenote anddepends_on: [token-bench-harness]. That keeps the id resolvable as adepends_ontarget and leaves the eventual archive sweep unchanged.tool-graph-analyticsexpresses its cross-epic dependency the way the schema supports —depends_on: [tool-graph-core, analytics-default-landing], a task-level edge into theanalytics-dashboardepic, which the overview graph renders asanalytics_dashboard --> tool_graph.python3 scripts/gen-roadmap.py --checkpasses;ROADMAP.mdregenerated in the same commit.