Skip to content

Commit 54c1864

Browse files
committed
docs(eval-plan): stop the kept daemon before its root is removed
§7 step 8 removed the kept runtime root while the graph session of steps 4-7 may still have a daemon running under it; stop that daemon under the sourced CBM_RUNTIME_DIR first. §13 Reproducibility still cleared ~/.cache/codebase-memory-mcp/*.db and called the harness unflagged, which no longer describes what the harness does: it indexes into a run-private root, and only CBM_BENCH_KEEP_RUNTIME=1 hands that root, via runtime-root.txt, to the graph phase. Signed-off-by: Anton Standrik <astandrik@yandex-team.ru>
1 parent a2ac054 commit 54c1864

1 file changed

Lines changed: 8 additions & 2 deletions

File tree

‎docs/EVALUATION_PLAN.md‎

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -298,6 +298,9 @@ for lang in $ALL_LANGS; do # ALL_LANGS = full 159-name list
298298
# + per-language report + (deferred, blind) judge ---
299299

300300
# --- step 8: delete THIS language's index so the next is cold, then mark done ---
301+
# The graph session (steps 4-7) may still have a daemon running under the kept
302+
# CBM_RUNTIME_DIR (exported above); stop it before its root goes away.
303+
~/.local/bin/codebase-memory-mcp daemon stop || true
301304
rm -rf -- "$CBM_BENCH_RUNTIME_ROOT"
302305
manifest_mark_done "$lang" "$index_ms"
303306
done
@@ -865,10 +868,13 @@ Deep-Dive section.
865868
# 1. Clone all 159 repos (shallow; skip existing)
866869
scripts/clone-bench-repos.sh /tmp/bench
867870

868-
# 2. Cold index all 159 (LSP cohort in full mode)
869-
rm -f ~/.cache/codebase-memory-mcp/*.db
871+
# 2. Cold index all 159 (LSP cohort in full mode). Each language is indexed into a run-private
872+
# runtime and cache (#1696); CBM_BENCH_KEEP_RUNTIME=1 keeps that root after a successful
873+
# index and records its paths in /tmp/eval-results/<lang>/runtime-root.txt. Source it
874+
# before the graph phase, then stop the daemon and remove the root, as in §7 step 8.
870875
mkdir -p /tmp/eval-results
871876
for lang in $ALL_LANGS; do
877+
CBM_BENCH_KEEP_RUNTIME=1 \
872878
scripts/benchmark-index.sh ~/.local/bin/codebase-memory-mcp "$lang" /tmp/bench/"$lang" /tmp/eval-results
873879
done
874880

0 commit comments

Comments
 (0)