Skip to content

Commit 17d0c72

Browse files
committed
docs: Avengers architecture — automated team assembly, divergence search, capability routing
Full pipeline: goal spec → divergence search → team selection → substrate training → VRAM pruning → eval → iterate. First measured divergence: Qwen3-4B + Phi-3-mini have 11 complementary problems on GSM8K (74% → 82% combined potential). Scaling: router + capability centroids for N-model populations. Experiential plasticity: centroids update through use.
1 parent 5b133c8 commit 17d0c72

1 file changed

Lines changed: 96 additions & 1 deletion

File tree

docs/papers/_draft_v2_30b_a3b_section.md

Lines changed: 96 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -316,7 +316,102 @@ soft_tokens (16, target_embed_dim) — each is a "mixture word"
316316

317317
**The thesis in one sentence:** Don't retrain, translate. The substrate converts between models' internal representations. The Q-Former translates into each model's native vocabulary. The models do what they already know how to do. The knowledge was free. The translation is cheap.
318318

319-
## 11. Next Experiment Design — The Right Team for the Right Benchmark
319+
## 11. The Avengers Architecture — Automated Team Assembly
320+
321+
### The Full Pipeline
322+
323+
The Many-Worlds forge recipe automates the entire team assembly process:
324+
325+
```json
326+
{
327+
"type": "many-worlds",
328+
"target_benchmark": "leaderboard_math",
329+
"vram_budget_gb": 8,
330+
"search_pool": "huggingface:Qwen/*,huggingface:microsoft/phi-*,...",
331+
"max_team_size": 4,
332+
"substrate_dim": 256,
333+
"optimization": "maximize_complementary_coverage"
334+
}
335+
```
336+
337+
**Steps (all automated):**
338+
339+
1. **Goal specification** — target benchmark + VRAM budget + search pool
340+
2. **Divergence search** — scan candidate models, run samples from target benchmark, build divergence matrix showing which pairs disagree the most
341+
3. **Team selection** — algorithm picks the roster with maximum complementary coverage under the VRAM budget. The divergence matrix is the Many-Worlds equivalent of the activation profile in pruning: one tells you which experts to keep, the other tells you which models to combine.
342+
4. **Substrate training** — Q-Former bridge trained on calibration corpus matched to the target benchmark. Both source and target models frozen.
343+
5. **VRAM pruning** — if combined VRAM exceeds target, the divergence matrix identifies the most redundant member (lowest complementary contribution). Remove and retrain one adapter.
344+
6. **Evaluation** — full benchmark run, compare population score against best individual member
345+
7. **Iteration** — swap weakest member for next candidate from search pool, retrain one adapter (not the whole substrate), re-evaluate
346+
347+
### Divergence Matrix — The Team Selection Primitive
348+
349+
The divergence matrix measures how much each pair of models DISAGREES on the benchmark:
350+
351+
```
352+
Qwen3-4B Phi-3-mini Phi-2 StableLM
353+
Qwen3-4B - 11 15 18
354+
Phi-3-mini 11 - 12 16
355+
Phi-2 15 12 - 10
356+
StableLM 18 16 10 -
357+
```
358+
359+
High divergence = high opportunity for substrate transfer. Low divergence = redundant knowledge (prune candidate).
360+
361+
**First measured divergence (Qwen3-4B + Phi-3-mini on GSM8K 50 problems):**
362+
```
363+
Qwen3-4B: 37/50 = 74%
364+
Phi-3-mini: 34/50 = 68%
365+
Both right: 30
366+
Qwen only: 7 (substrate could help Phi-3)
367+
Phi-3 only: 4 (substrate could help Qwen)
368+
Complementary: 11 (22% of problems)
369+
Combined potential: 41/50 = 82% (+8 points over best individual)
370+
```
371+
372+
### Scaling to N Models — Router + Capability Centroids
373+
374+
For populations >2, not all models activate for every query. A lightweight router selects the top-K most relevant experts:
375+
376+
```
377+
Input text → embed in substrate space → cosine sim to model centroids
378+
→ select top-K (2-3 out of N) → run selected through Q-Former → soft tokens
379+
→ target model generates with expert knowledge
380+
```
381+
382+
Each model has a **capability centroid** in substrate space — a learned vector summarizing "what this model knows." The router is a single matrix multiply (cheap). Only K models run per query, not all N.
383+
384+
### Experiential Plasticity
385+
386+
The capability centroids UPDATE through use:
387+
- Query routed to Qwen + Phi-3 → good result → strengthen both centroids in this region
388+
- Bad result → weaken, try different experts next time
389+
- New model joins → starts with default centroid, specializes through experience
390+
- The Foreman accumulates knowledge about which experts help on which tasks
391+
392+
After 100 forge runs, the system knows "Phi-3 always helps on math, Qwen always helps on code, StableLM never contributes to reasoning" and uses this prior to make future team searches faster.
393+
394+
### The Forge-Alloy for Populations
395+
396+
The `.alloy.json` for a Many-Worlds population describes:
397+
- The team roster (which models, which versions, which adapters)
398+
- The substrate (shared coordinate space, training provenance)
399+
- The Q-Former bridge (per-target-model, trained against the substrate)
400+
- The capability centroids (per-model, updated through experience)
401+
- The benchmark results (per-model individual + combined population)
402+
- The attestation chain (every step signed and verifiable)
403+
404+
Same attestation infrastructure, same QR codes, same verification page. The alloy proves the population's provenance just like it proves a pruned model's provenance.
405+
406+
### The Avengers Headline
407+
408+
"Assembled from N open-weight models, none larger than 4B, outperforms a single 70B model on the Open LLM Leaderboard."
409+
410+
Each member brings one superpower. The substrate assembles the right team for each question. Every new open-weight release from any lab becomes a potential recruit — one adapter (4M params, 8 minutes on consumer GPU), the population gets stronger. The knowledge was free. The coordination is cheap. The diversity is the moat.
411+
412+
Joel: *"could we make like an avengers coding model from the contributions of many experts across diverse models?"*
413+
414+
## 12. Next Experiment Design — The Right Team for the Right Benchmark
320415

321416
The thesis test requires:
322417

0 commit comments

Comments
 (0)