Skip to content

support Text Embedding Inference TEI 1.7.2 #5210

Closed

Description

@kandakji

Describe the feature you'd like
Hugging face has release TEI 1.7.2 that supports Qwen 3 embedding models. Please bump the DLC image to use the latest version

How would this feature be used? Please describe.
1.7.2 that supports Qwen 3 embedding models

Describe alternatives you've considered
bringing my own container but this is not ideal for support and optimization

Additional context
Add any other context or screenshots about the feature request here.

Activity

  1. sirutBuasai commented on Oct 15, 2025

    @sirutBuasai
    Contributor

    TEI 1.8.2 is released and supports Qwen3. We will be skipping TEI 1.7.2
    #5305
    awslabs/llm-hosting-container#172

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions