You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit f886c03
Browse filesBrowse the repository at this point in the historyBrowse files
feat(examples): run the OpenCode example on one GPU with Qwen3.8-27B-FP8 (#756)
* feat(examples): run the OpenCode example on one GPU with Qwen3.8-27B-FP8
* docs(examples): record the one-GPU OpenCode runs on Qwen3.8-27B-FP8
* docs(examples): record the one-GPU and cluster-route runs, and ship presence_penalty 0
* fix(examples): pass the long call only for the asked-for file, and time decode over what was streamed
* docs(examples): say how hidden reasoning affects the decode rate
* docs(examples): rewrap the session load docstring
* docs(examples): record conformance and session load at the final commit
* docs(examples): cite the server commits on main
---------
Co-authored-by: Krisztian Gajdar <krisztian@superlinked.com>
Copy file name to clipboardExpand all lines: examples/README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,7 +20,7 @@ to a separately maintained repository (clone and run there).
20
20
|[Extract custom entities from primary sources](./named-entity-extraction)| Changing zero-shot labels across financial, healthcare, rail-safety and legal text, with the two labels that came back empty left visible |`extract`| SIE endpoint with GLiNER multi v2.1; `fetch.py` pulls the recorded run, `score.py` reproduces the counts with no key | Runnable recorded example |
21
21
|[Extract the entity types you name, with no model to train](./custom-entity-types)| Asking for the 85 entity types of seven zero-shot NER sets and scoring exact spans against GPT-6 Luna, GPT-6 Sol, Claude Haiku 4.5, SIE Qwen3.8 27B, AWS Comprehend and spaCy, with a paired bootstrap and the price of each |`extract`| SIE server with GLiNER BioMed Large; `fetch.py` pulls the recorded run, `score.py` reproduces the figures with no key | Runnable recorded example |
22
22
|[Answer a question from a passage, and quote the sentence you used](./chat)| Checking a generated answer for its citation, its length and whether it declines a question the passage cannot answer |`chat/completions`| SIE Cloud with Qwen3.8 27B; `fetch.py` pulls the recorded run, `score.py` reproduces the numbers with no key | Runnable recorded example |
23
-
|[Run a coding agent on SIE with OpenCode](./coding-agent-opencode)| Pointing OpenCode at a laptop server, a self-hosted cluster or SIE Cloud, and checking the agent loop the way OpenCode drives it: streaming tool-call deltas, parallel calls, tool-result round trips, a 64K-plus prompt, finish reasons, usage and the reasoning field|`chat/completions`| An SIE Cloud endpoint that lists GLM-5.3-Flash via SIE Relay, or a local server; the laptop recipe was run on Apple Silicon with Qwen3.5-4B; `conformance.py` reports every case, `run_gate.sh` makes OpenCode fix a seeded failing test | Runnable check, laptop and SIE Cloud results recorded |
23
+
|[Run a coding agent on SIE with OpenCode](./coding-agent-opencode)| Pointing OpenCode at a laptop server, one 80 GB GPU, a self-hosted cluster or SIE Cloud, and checking the agent loop the way OpenCode drives it: streaming tool-call deltas, parallel calls, tool-result round trips, a 64K-plus prompt, a 64 KiB tool call, finish reasons, usage and the reasoning field; `session_load.py` measures how many agent sessions one endpoint holds |`chat/completions`| An SIE Cloud endpoint that lists GLM-5.3-Flash via SIE Relay, or a local server; the laptop recipe was run on Apple Silicon with Qwen3.5-4B, the GPU and cluster recipes on one H100 with Qwen3.8-27B-FP8; `conformance.py` reports every case, `run_gate.sh` makes OpenCode fix a seeded failing test | Runnable check, laptop, one-GPU and SIE Cloud results recorded |
24
24
|[Route requests while skipping most generation calls](./request-routing)| Assigning support, banking and assistant requests to routes with an embedding classifier and conditional generation |`encode`, `chat/completions`| SIE server with Qwen3 Embedding 4B and Qwen3.8 27B; recorded 3,000-case verification needs no API key | Runnable recorded example |
25
25
|[Send each request to a cheap or a strong LLM](./request-routing/cost)| Cutting LLM spend with a bge-m3 nearest-neighbour router that picks GPT-6 Luna or GPT-6.1 Sol per request: 38.6% less than always using GPT-6.1 Sol at 95.8% of its quality on 728 held-out requests of a pre-registered study |`encode`| SIE Serverless with bge-m3; `fetch.py` pulls the recorded study, `score.py` reproduces the held-out table with no key | Runnable recorded example |
26
26
|[Turn PDF pages into Markdown, scored on olmOCR-Bench](./document-to-markdown-olmocr)| Converting all 1,403 pages of Ai2's olmOCR-Bench with LightOnOCR-2-1B and scoring them with Ai2's own scorer, beside published Azure Document Intelligence and AWS Textract runs |`extract`| SIE Cloud with LightOnOCR-2-1B; `fetch.py` pulls the recorded run, `score.py` reproduces the scores with no key | Runnable recorded example |
0 commit comments