You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/papers/_draft_v2_30b_a3b_section.md
+96-1Lines changed: 96 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -316,7 +316,102 @@ soft_tokens (16, target_embed_dim) — each is a "mixture word"
316
316
317
317
**The thesis in one sentence:** Don't retrain, translate. The substrate converts between models' internal representations. The Q-Former translates into each model's native vocabulary. The models do what they already know how to do. The knowledge was free. The translation is cheap.
318
318
319
-
## 11. Next Experiment Design — The Right Team for the Right Benchmark
319
+
## 11. The Avengers Architecture — Automated Team Assembly
320
+
321
+
### The Full Pipeline
322
+
323
+
The Many-Worlds forge recipe automates the entire team assembly process:
2.**Divergence search** — scan candidate models, run samples from target benchmark, build divergence matrix showing which pairs disagree the most
341
+
3.**Team selection** — algorithm picks the roster with maximum complementary coverage under the VRAM budget. The divergence matrix is the Many-Worlds equivalent of the activation profile in pruning: one tells you which experts to keep, the other tells you which models to combine.
342
+
4.**Substrate training** — Q-Former bridge trained on calibration corpus matched to the target benchmark. Both source and target models frozen.
343
+
5.**VRAM pruning** — if combined VRAM exceeds target, the divergence matrix identifies the most redundant member (lowest complementary contribution). Remove and retrain one adapter.
344
+
6.**Evaluation** — full benchmark run, compare population score against best individual member
345
+
7.**Iteration** — swap weakest member for next candidate from search pool, retrain one adapter (not the whole substrate), re-evaluate
346
+
347
+
### Divergence Matrix — The Team Selection Primitive
348
+
349
+
The divergence matrix measures how much each pair of models DISAGREES on the benchmark:
350
+
351
+
```
352
+
Qwen3-4B Phi-3-mini Phi-2 StableLM
353
+
Qwen3-4B - 11 15 18
354
+
Phi-3-mini 11 - 12 16
355
+
Phi-2 15 12 - 10
356
+
StableLM 18 16 10 -
357
+
```
358
+
359
+
High divergence = high opportunity for substrate transfer. Low divergence = redundant knowledge (prune candidate).
360
+
361
+
**First measured divergence (Qwen3-4B + Phi-3-mini on GSM8K 50 problems):**
362
+
```
363
+
Qwen3-4B: 37/50 = 74%
364
+
Phi-3-mini: 34/50 = 68%
365
+
Both right: 30
366
+
Qwen only: 7 (substrate could help Phi-3)
367
+
Phi-3 only: 4 (substrate could help Qwen)
368
+
Complementary: 11 (22% of problems)
369
+
Combined potential: 41/50 = 82% (+8 points over best individual)
370
+
```
371
+
372
+
### Scaling to N Models — Router + Capability Centroids
373
+
374
+
For populations >2, not all models activate for every query. A lightweight router selects the top-K most relevant experts:
375
+
376
+
```
377
+
Input text → embed in substrate space → cosine sim to model centroids
378
+
→ select top-K (2-3 out of N) → run selected through Q-Former → soft tokens
379
+
→ target model generates with expert knowledge
380
+
```
381
+
382
+
Each model has a **capability centroid** in substrate space — a learned vector summarizing "what this model knows." The router is a single matrix multiply (cheap). Only K models run per query, not all N.
383
+
384
+
### Experiential Plasticity
385
+
386
+
The capability centroids UPDATE through use:
387
+
- Query routed to Qwen + Phi-3 → good result → strengthen both centroids in this region
388
+
- Bad result → weaken, try different experts next time
389
+
- New model joins → starts with default centroid, specializes through experience
390
+
- The Foreman accumulates knowledge about which experts help on which tasks
391
+
392
+
After 100 forge runs, the system knows "Phi-3 always helps on math, Qwen always helps on code, StableLM never contributes to reasoning" and uses this prior to make future team searches faster.
393
+
394
+
### The Forge-Alloy for Populations
395
+
396
+
The `.alloy.json` for a Many-Worlds population describes:
397
+
- The team roster (which models, which versions, which adapters)
398
+
- The substrate (shared coordinate space, training provenance)
399
+
- The Q-Former bridge (per-target-model, trained against the substrate)
400
+
- The capability centroids (per-model, updated through experience)
401
+
- The benchmark results (per-model individual + combined population)
402
+
- The attestation chain (every step signed and verifiable)
403
+
404
+
Same attestation infrastructure, same QR codes, same verification page. The alloy proves the population's provenance just like it proves a pruned model's provenance.
405
+
406
+
### The Avengers Headline
407
+
408
+
"Assembled from N open-weight models, none larger than 4B, outperforms a single 70B model on the Open LLM Leaderboard."
409
+
410
+
Each member brings one superpower. The substrate assembles the right team for each question. Every new open-weight release from any lab becomes a potential recruit — one adapter (4M params, 8 minutes on consumer GPU), the population gets stronger. The knowledge was free. The coordination is cheap. The diversity is the moat.
411
+
412
+
Joel: *"could we make like an avengers coding model from the contributions of many experts across diverse models?"*
413
+
414
+
## 12. Next Experiment Design — The Right Team for the Right Benchmark
0 commit comments