Skip to content

Loading a model through the SDK does not use per model defaults #178

Description

@jmaver

Let’s take Qwen3 1.7B. The installed model default temp is 0.8.
I change the default temp to 0.6.
When I load the model in the UI, the temp is 0.8.
If I use the cli with lms load, the temp is 0.8.
If I use the REST API v1, the temp is 0.8
If I use the python sdk lmstudio.llm(), the temp is not 0.8, but back to 0.6.

The other params follow the same pattern - use my custom defaults when loaded everywhere except the python sdk.

The SDK should load using the per model custom defaults I set.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions