Skip to content

Commit cd54338

Browse files
author
Yadan Wei
committed
docs(vllm-omni): focus v1.7.0 changelog Highlights on container changes
- Replace upstream-PR Highlights with the container-side change: PEFT LoRA validated on SageMaker (new endpoint test, PR #6680) - Preserve the upstream v0.26.0...v0.28.0 compare link on the source line
1 parent b2dd4c6 commit cd54338

1 file changed

Lines changed: 5 additions & 13 deletions

File tree

‎docs/vllm-omni/changelog/index.md‎

Lines changed: 5 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -8,24 +8,16 @@ Changelog for the Amazon Linux 2023-based vLLM-Omni images (`omni-cuda`, `omni-s
88

99
**Tags:** `omni-cuda-v1.7` · `omni-sagemaker-cuda-v1.7`
1010

11-
**vLLM-Omni source:** [v0.28.0](https://github.com/vllm-project/vllm-omni/releases/tag/v0.28.0) (upstream vLLM v0.28.0)
11+
**vLLM-Omni source:** [v0.28.0](https://github.com/vllm-project/vllm-omni/releases/tag/v0.28.0) (upstream vLLM v0.28.0) —
12+
[full upstream diff](https://github.com/vllm-project/vllm-omni/compare/v0.26.0...v0.28.0)
1213

1314
**DLC PR:** [#6680](https://github.com/aws/deep-learning-containers/pull/6680)
1415

1516
### Highlights
1617

17-
- Upgraded to vLLM-Omni 0.28.0, tracking upstream vLLM v0.28.0 (up from 0.26.0). Full upstream diff:
18-
[v0.26.0...v0.28.0](https://github.com/vllm-project/vllm-omni/compare/v0.26.0...v0.28.0).
19-
- **New model serving.** Qwen3-Omni gains a thinker-only pipeline for Instruct serving ([#6284](https://github.com/vllm-project/vllm-omni/pull/6284)),
20-
and native full-duplex Nemotron VoiceChat serving is added ([#6089](https://github.com/vllm-project/vllm-omni/pull/6089)).
21-
- **MiniMax-H3 diffusion.** The FastH3 four-step adapter is fused at load time ([#6714](https://github.com/vllm-project/vllm-omni/pull/6714)), with
22-
native LoRA via FlashGen ([#6666](https://github.com/vllm-project/vllm-omni/pull/6666)) and Turbo LoRA with DLO
23-
([#6550](https://github.com/vllm-project/vllm-omni/pull/6550)), plus text-encoder disaggregation
24-
([#5885](https://github.com/vllm-project/vllm-omni/pull/5885)).
25-
- **TTS streaming.** Adaptive chunk ramp — Phase 2 buffer-feedback controller ([#6001](https://github.com/vllm-project/vllm-omni/pull/6001)) — plus
26-
extensive MiniCPM-o full-duplex streaming and barge-in stability fixes.
27-
- **Diffusion quantization.** Online INT8 with DLO AllGather ([#6573](https://github.com/vllm-project/vllm-omni/pull/6573)) and offline SVDQuant W4A4
28-
([#6162](https://github.com/vllm-project/vllm-omni/pull/6162)).
18+
- **PEFT LoRA validated on SageMaker.** A new endpoint test deploys an SD-3.5-medium image model with a baked-in PEFT LoRA adapter registered at
19+
startup (`SM_VLLM_ENABLE_LORA`, `SM_VLLM_LORA_MODULES`, `SM_VLLM_MAX_LORA_RANK`) and confirms that per-request adapter selection via the `lora`
20+
field on `/v1/images/generations` changes the generated image.
2921

3022
### Changes
3123

0 commit comments

Comments
 (0)