Skip to content

Commit 7445f23

Browse files
committed
docs(sentiment): record Gemma's live property ids and first-pass throughput
The vocabulary upload landed on 2026-08-14 and the first Gemma pass is under way, so the throughput row is no longer "not yet run". Its rate is the least stable of the four members because OpenRouter re-picks a backend per call: an 18-item trial ran at 9 items/min and the opening minutes of the corpus pass at closer to 4. Both bracket a pass between one and two days. Left as a range on purpose — the other three rows carry wall clocks measured from the cache `ts` values over a completed pass, and this one should be replaced the same way rather than with an extrapolation.
1 parent cd97d72 commit 7445f23

1 file changed

Lines changed: 8 additions & 1 deletion

File tree

AI_sentiment_analysis/README.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -281,12 +281,19 @@ SDK calls, so a timed-out future cannot leave an unbounded HTTP thread behind.
281281
| GPT-5.6 Luna | **2.7 h** | 4,511 |
282282
| Mistral Small 4 | **3.7 h** | 3,318 |
283283
| DeepSeek V4 Flash 0731 | **31.5 h** | 391 |
284-
| Gemma 4 31B | not yet run | |
284+
| Gemma 4 31B | first pass started 2026-08-14 | ~250–550 (early, unstable) |
285285

286286
DeepSeek is ~12× slower than Luna, and nothing like the retired preview's 9.7 s
287287
median: 0731 has no middle reasoning level, so the panel rounds it up to `high`.
288288
Budget a full day for it and hours for the others.
289289

290+
Gemma's rate is the least stable of the four, because OpenRouter re-picks a
291+
backend per call: an 18-item trial ran at **9 items/min** and the first minutes of
292+
the corpus pass at closer to **4**. Both bracket a pass in DeepSeek's league —
293+
somewhere between one day and two. Replace this row with the measured wall clock
294+
from the cache `ts` values once the pass completes, as was done for the other
295+
three.
296+
290297
**Pass `--model-timeout 300` for any 0731 or Gemma run.** The 120 s default
291298
allots 37.3 s per attempt while both models take ~55–72 s per item, so normal
292299
variance crosses a line drawn too tight: a DeepSeek corpus pass produced 91

0 commit comments

Comments
 (0)