Skip to content

Per alias model parameters #186

Description

@ccsmart

Preflight checks

  • I have searched existing issues and discussions for this idea

What problem does this solve?

Not to miss: olla is great !

To add onto, this is a request to allow default model parameter definition per alias. As defaults, if equivalent parameters are defined by the client in the request, client parameters override alias defaults.

Proposed solution

Eg equivalent to:

model_aliases:
  chat-default:
    models:
      - "Qwen3.6-27B-MTP-GGUF"
    options:
      temp: 1.0
      top_p: 0.95
      top_k: 20

  chat-developer:
    models:
      - "Qwen3.6-27B-MTP-GGUF"
    options:
      temp: 0.6
      top_p: 0.95
      top_k: 20

Affected area

Configuration

Alternatives considered

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestinvestigatingWe're actively investigating the issue.

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions