Skip to content

Commit 23c16cd

Browse files
maruelmaruel
committed
Update model registries and refine provider implementations
Refresh model registries and documentation for Alibaba, Gemini, Hugging Face, OpenRouter, TogetherAI, and others to align with the latest LLM releases. Key updates include upgrading Qwen 3.7 to 3.8, introducing Gemini 3.7-flash, and adding batch and transcription models for OpenAI and Anthropic. Refactor the Gemini provider to support thinking budget configurations and improve image model selection logic. Update the OpenAI Base provider to refine automatic text model selection. Perform a large-scale overhaul of the test suite, replacing outdated qwen3.7 benchmarks with qwen3.8 cases and expanding multimodal coverage for various image formats (GIF, PNG, WebP, JPG). Prune obsolete test data and scoreboards for Groq and Mistral to maintain system health and parity with current API behaviors.
1 parent e430e29 commit 23c16cd

430 files changed

Lines changed: 13693 additions & 22553 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -59,8 +59,8 @@ genai is _intentional_. Curious why it was created? See the release announcement
5959
| [codex](docs/codex.md) | 🇺🇸 | Sync, Stream🧠 | 💬📸 | 💬 | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ✅ |
6060
| [cohere](docs/cohere.md) | 🇨🇦 | Sync, Stream🧠 | 💬 | 💬 | ✅🪨 | ✅ | ❌ | ❌ | ✅ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
6161
| [deepseek](docs/deepseek.md) | 🇨🇳 | Sync, Stream🧠 | 💬 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 📏🛑 | ✅ | ❌ | ✅ | ✅ |
62-
| [gemini](docs/gemini.md) | 🇺🇸 | Sync, Stream🧠 | 🎤🎥💬📄📸 | 💬📸 | ✅🪨🕸️ | ✅ | ❌ | ✅ | ❌ | 🌱📏🛑 | ❌ | ❌ | ✅ | ✅ |
63-
| [groq](docs/groq.md) | 🇺🇸 | Sync, Stream🧠 | 💬📸 | 💬 | ✅🪨🕸️ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ❌ | ✅ | ✅ | ✅ |
62+
| [gemini](docs/gemini.md) | 🇺🇸 | Sync, Stream🧠 | 🎤🎥💬📄📸 | 💬 | ✅🪨🕸️ | ✅ | ❌ | ✅ | ❌ | 🌱📏🛑 | ❌ | ❌ | ✅ | ✅ |
63+
| [groq](docs/groq.md) | 🇺🇸 | Sync, Stream🧠 | 💬 | 💬 | ✅🪨🕸️ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ❌ | ✅ | ✅ | ✅ |
6464
| [huggingface](docs/huggingface.md) | 🇺🇸 | Sync, Stream🧠 | 💬 | 💬 | ❌ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ✅ | ✅ | ✅ |
6565
| [llamacpp](docs/llamacpp.md) | 🏠 | Sync, Stream🧠 | 🎤💬📸 | 💬 | ✅🪨 | ✅ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
6666
| [mistral](docs/mistral.md) | 🇫🇷 | Sync, Stream | 🎤💬📄📸 | 💬 | ✅🪨 | ✅ | ❌ | ❌ | ❌ | 🌱📏🛑 | ❌ | ✅ | ✅ | ✅ |

‎docs/alibaba.md‎

Lines changed: 30 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -4,8 +4,8 @@
44

55
| Model | Mode | ➛In | Out➛ | Tool | JSON | Batch | File | Cite | Text | Probs | Limits | Usage | Finish |
66
| ----------------------------------------------- | ------- | ----- | ------ | ---- | ---- | ----- | ---- | ---- | ---- | ----- | ------ | ----- | ------ |
7-
| qwen3.7-max🥇 | Sync🧠 | 💬 | 💬 | ✅ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
8-
| qwen3.7-max🥇 | Stream🧠 | 💬 | 💬 | 💨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ❌ | ❌ |
7+
| qwen3.8-max🥇 | Sync🧠 | 💬📸 | 💬 | 💨🕸️ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
8+
| qwen3.8-max🥇 | Stream🧠 | 💬📸 | 💬 | 💨🕸️ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ❌ | ❌ |
99
| qwen3-vl-flash | Sync | 💬📸 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
1010
| qwen3-vl-flash | Stream | 💬📸 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ❌ | ❌ |
1111
| qwen3-vl-plus | Sync | 💬📸 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
@@ -23,9 +23,15 @@
2323
| ccai-pro | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
2424
| deepseek-v3.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
2525
| deepseek-v4-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
26+
| deepseek-v4-flash-0731 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
2627
| deepseek-v4-pro | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
28+
| deepseek-v4-pro-0813 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
2729
| glm-5.1 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
30+
| glm-5.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
31+
| glm-5.2-fast-preview | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
2832
| kimi-k2.6 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
33+
| kimi-k2.7-code | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
34+
| qwen-audio-3.0-asr-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
2935
| qwen-coder-plus | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
3036
| qwen-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
3137
| qwen-flash-2025-07-28 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
@@ -37,6 +43,9 @@
3743
| qwen-image-2.0-pro | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
3844
| qwen-image-2.0-pro-2026-03-03 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
3945
| qwen-image-2.0-pro-2026-04-22 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
46+
| qwen-image-2.0-pro-2026-06-22 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
47+
| qwen-image-3.0 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
48+
| qwen-image-3.0-pro | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
4049
| qwen-max | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
4150
| qwen-max-2025-01-25 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
4251
| qwen-max-latest | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
@@ -113,12 +122,17 @@
113122
| qwen3.6-max-preview | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
114123
| qwen3.6-plus | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
115124
| qwen3.6-plus-2026-04-02 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
125+
| qwen3.7-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
126+
| qwen3.7-flash-2026-07-15 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
127+
| qwen3.7-max | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
116128
| qwen3.7-max-2026-05-17 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
117129
| qwen3.7-max-2026-05-20 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
118130
| qwen3.7-max-2026-06-08 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
119131
| qwen3.7-max-preview | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
120132
| qwen3.7-plus | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
121133
| qwen3.7-plus-2026-05-26 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
134+
| qwen3.7-text-embedding | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
135+
| qwen3.8-2.4t-a95b | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
122136
| wan2.7-image | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
123137
| wan2.7-image-pro | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
124138
| pre-qwen-mt-lite | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
@@ -238,8 +252,8 @@
238252

239253
| Model | Mode | ➛In | Out➛ | Tool | JSON | Batch | File | Cite | Text | Probs | Limits | Usage | Finish |
240254
| ------------------------------ | ------- | ----- | ------ | ---- | ---- | ----- | ---- | ---- | ---- | ----- | ------ | ----- | ------ |
241-
| qwen3.7-max🥇 | Sync🧠 | 💬 | 💬 | ✅🕸️ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
242-
| qwen3.7-max🥇 | Stream🧠 | 💬 | 💬 | ✅ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ❌ | ❌ |
255+
| qwen3.8-max🥇 | Sync🧠 | 💬📸 | 💬 | 💨🕸️ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
256+
| qwen3.8-max🥇 | Stream🧠 | 💬📸 | 💬 | 💨🕸️ | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ❌ | ❌ |
243257
| qwen3-vl-flash | Sync | 💬📸 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
244258
| qwen3-vl-flash | Stream | 💬📸 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ❌ | ❌ |
245259
| qwen3-vl-plus | Sync | 💬📸 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ✅ | ❌ | ✅ | ✅ |
@@ -252,16 +266,22 @@
252266
| qwen3-vl-32b-thinking | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
253267
| qwen3-vl-8b-thinking | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
254268
| deepseek-v4-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
269+
| deepseek-v4-flash-0731 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
270+
| deepseek-v4-flash-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
255271
| deepseek-v4-pro | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
272+
| deepseek-v4-pro-0813 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
273+
| deepseek-v4-pro-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
256274
| glm-5.1 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
257275
| glm-5.2 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
276+
| glm-5.2-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
258277
| kimi-k2.5 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
259278
| kimi-k2.7-code | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
260279
| pre-qwen-mt-lite | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
261280
| pre-zhongyun-test-chat | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
262281
| qwen-mt-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
263282
| qwen-mt-lite | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
264283
| qwen-mt-plus | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
284+
| qwen-plus-character | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
265285
| qwen3-vl-flash-2026-01-22-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
266286
| qwen3-vl-plus-2025-12-19 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
267287
| qwen3-vl-plus-2025-12-19-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
@@ -276,11 +296,17 @@
276296
| qwen3.6-35b-a3b | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
277297
| qwen3.6-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
278298
| qwen3.6-flash-2026-04-16 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
299+
| qwen3.6-flash-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
279300
| qwen3.6-plus-2026-04-02 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
301+
| qwen3.7-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
302+
| qwen3.7-flash-2026-07-15 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
303+
| qwen3.7-max | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
280304
| qwen3.7-max-2026-05-20 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
281305
| qwen3.7-max-2026-06-08 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
306+
| qwen3.7-max-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
282307
| qwen3.7-plus | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
283308
| qwen3.7-plus-2026-05-26 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
309+
| qwen3.7-plus-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
284310
| qwen-flash | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
285311
| qwen-flash-2025-07-28 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
286312
| qwen-flash-2025-07-28-us | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |

‎docs/baseten.md‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,14 +8,20 @@
88
| deepseek-ai/DeepSeek-V4-Pro🥈 | Stream🧠 | 💬 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏🛑 | ❌ | ❌ | ✅ | ✅ |
99
| openai/gpt-oss-120b🥉 | Sync🧠 | 💬 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏 | ❌ | ❌ | ✅ | ✅ |
1010
| openai/gpt-oss-120b🥉 | Stream🧠 | 💬 | 💬 | ✅🪨 | ☁️ | ❌ | ❌ | ❌ | 🌱📏 | ❌ | ❌ | ✅ | ✅ |
11+
| deepseek-ai/DeepSeek-V4-Flash-0731 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
12+
| deepseek-ai/DeepSeek-V4-Pro-0813 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1113
| moonshotai/Kimi-K2.5 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1214
| moonshotai/Kimi-K2.6 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1315
| moonshotai/Kimi-K2.7-Code | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
16+
| moonshotai/Kimi-K3 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1417
| nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1518
| nvidia/Nemotron-120B-A12B | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
19+
| thinkingmachines/inkling | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
20+
| thinkingmachines/inkling-small | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1621
| zai-org/GLM-4.7 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1722
| zai-org/GLM-5 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1823
| zai-org/GLM-5.1 | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
24+
| zai-org/GLM-5.2-Fast | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? | ? |
1925
<details>
2026
<summary>‼️ Click here for the legend of columns and symbols</summary>
2127

0 commit comments

Comments
 (0)