Repository navigation

Request-sized holds, charge abandoned requests, guest output limit - #22

Merged

Marketen merged 8 commits into

mainfrom

feat/guest-chat-gateway

Nov 5, 2026

Merged

Request-sized holds, charge abandoned requests, guest output limit#22
Marketen merged 8 commits into
mainfrom
feat/guest-chat-gateway

Commits on Nov 4, 2026
- feat: send an upper-bound prompt estimate with each credit hold
  
  Marketen
  and
  claude
  committed
  1e690cf
- fix: charge requests whose client hangs up before the answer ends
  
  Marketen
  and
  claude
  committed
  a004971
- feat: guest chat requests always carry an output limit
  
  Marketen
  and
  claude
  committed
  f51ab35
- fix: every chat request carries the output limit its hold covers
  
  Marketen
  and
  claude
  committed
  cb3a561
- fix: a request without a limit gets max_completion_tokens
  
  Marketen
  and
  claude
  committed
  b04d717
- fix: only guest requests get an output limit written in
  
  Marketen
  and
  claude
  committed
  008fb46
- fix: drop arithmetic from two allocation capacity hints
  
  Marketen
  and
  claude
  committed
  e1c0ac1
Commits on Nov 5, 2026
- feat(guest): guest keys call only models open to guests
  
  Marketen
  and
  claude
  committed
  20d64fc