You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**An ARSENAL-powered kit for turning messy questions into claim lattices, dialectic briefs, freelance scopes, and Kaggle notebook spines.**
3
+
**Stop shipping confident mush.**
4
+
Turn messy research, philosophy, freelance, and Kaggle questions into **claim lattices**—structured arguments with evidence slots, objections, confidence, and next actions.
[](https://github.com/faresrafat3/arsenal-unified-master-pipeline)
Epistemic Forge is a **local-first Python package** (no paid API required) that implements a faithful, practical slice of the [ARSENAL](https://github.com/faresrafat3/arsenal-unified-master-pipeline)unified agent pipeline:
12
+
Local-first Python package (**no paid API required**). Implements a practical slice of the [ARSENAL](https://github.com/faresrafat3/arsenal-unified-master-pipeline)L0–L6 pipeline.
10
13
11
-
| Layer | ARSENAL idea | In this repo |
14
+
---
15
+
16
+
## The problem
17
+
18
+
Experts and freelancers constantly answer hard questions under uncertainty:
19
+
20
+
- a founder wants a **2-week research sprint** scoped *now*
21
+
- a Kaggle teammate wants a **leakage-safe baseline**, not vibes
22
+
- a seminar needs a **dialectic**, not a blog take
23
+
24
+
Default LLM / one-shot Q&A style fails the same way every time:
Per-case table and method notes: [`docs/benchmark/BENCHMARK.md`](docs/benchmark/BENCHMARK.md) · raw JSON: [`docs/benchmark/benchmark_results.json`](docs/benchmark/benchmark_results.json)
> Interpretation for portfolio readers: the gain is not “smarter vibes”—it is **argument slot coverage + packaging**. That is what clients, reviewers, and hiring managers can inspect.
> Novel angle: a **claim lattice** as the shared intermediate representation across philosophy, research writing, freelancing, and Kaggle planning—so epistemic humility travels with the deliverable.
105
+
Each folder includes `executive_summary.md`, `research_memo.md`, domain packs (`client_brief.json` / `kaggle_spine.md`), and full `result.json` (route, trials, search nodes).
22
106
23
107
---
24
108
@@ -28,9 +112,10 @@ Epistemic Forge is a **local-first Python package** (no paid API required) that
Epistemic Forge **scaffolds thinking and packaging**. It does not replace domain expertise, human ethics review, or competition rules. Treat outputs as **provisional** claims with explicit limits.
228
+
Epistemic Forge **scaffolds thinking and packaging**. It does not replace domain expertise, ethics review, or competition rules. Benchmark scores are **automatic structural metrics**, not human truth judgments. Treat outputs as **provisional** claims with explicit limits.
# Academic framework: Claim lattices and Toulmin’s model of argument
2
+
3
+
Epistemic Forge treats a **claim lattice** as a lightweight, multi-domain intermediate representation. The design is deliberately aligned with classical **argumentation theory**, especially Stephen Toulmin’s model of argument.
4
+
5
+
## Primary citation
6
+
7
+
> Toulmin, S. E. (1958/2003). *The Uses of Argument* (Updated ed.). Cambridge University Press.
8
+
9
+
Toulmin proposed that everyday and scientific arguments are better analyzed as **functional roles** than as pure syllogisms. The core layout (commonly taught in writing & critical reasoning) is:
10
+
11
+
| Toulmin element | Role | Epistemic Forge mapping |
12
+
|---|---|---|
13
+
|**Claim**| The conclusion being advanced |`Claim.text` (thesis node) |
14
+
|**Data / Grounds**| Evidence supporting the claim |`Claim.support[]`|
15
+
|**Warrant**| Principle linking data → claim | Instruction + expert integration narrative (“why this structure improves decisions”) |
16
+
|**Backing**| Support for the warrant | Domain experts (methods notes, baselines, client constraints) |
17
+
|**Qualifier**| Strength / modality of the claim |`Claim.confidence` (`sure` / `likely` / `possible` / `weak`) |
1.**Portable across domains** — The same slots structure a philosophy thesis, a freelance acceptance criterion, or a Kaggle “honest baseline” claim.
23
+
2.**Humility is first-class** — Qualifiers and rebuttals are not optional decoration; they are scored in the benchmark.
24
+
3.**Compatible with modern AI scaffolding** — Self-critique loops (Self-Refine / Reflexion) naturally *fill* rebuttal and qualifier slots rather than only polishing style.
25
+
26
+
## Related academic threads (secondary)
27
+
28
+
-**Argumentation schemes & critical questions** — Walton, Reed, Macagno (*Argumentation Schemes*, 2008): each scheme comes with defeaters; our objections list is a practical subset.
29
+
-**IBIS / design rationale** — Kunz & Rittel (1970): issues–positions–arguments; our lattice is a compressed position/argument graph for delivery, not a full IBIS database.
30
+
-**Computational argumentation** — Dung’s abstract argumentation frameworks (1995) formalize attack relations; we stay at the *informal-logic packaging* layer for human-readable deliverables.
31
+
32
+
## How the benchmark uses Toulmin
33
+
34
+
The benchmark metrics in `epistemic_forge/benchmark/metrics.py` score documents for presence of:
35
+
36
+
- claim, grounds, warrant, rebuttal, qualifier
37
+
38
+
plus packaging features (structure, actionability, humility).
39
+
**Toulmin coverage** = fraction of the five core slots detected at score ≥ 0.5.
40
+
41
+
This is an **automatic, deterministic proxy**—useful for regression testing and portfolio evidence—not a substitute for human argument evaluation.
42
+
43
+
## Practical reading
44
+
45
+
- Toulmin (2003), ch. on the layout of arguments.
46
+
- Introductory teaching notes on Toulmin in composition studies (claim–evidence–warrant).
47
+
- For AI context: connect to self-critique / debate papers only as *process*, while Toulmin remains the *structure* of the artifact.
48
+
49
+
## One-sentence thesis
50
+
51
+
> Epistemic Forge operationalizes Toulmin’s layout as a **shared claim lattice IR**, then runs an ARSENAL-style pipeline to fill, stress-test, and package those slots for research, freelancing, and applied ML planning.
0 commit comments