Skip to content

Commit 12212f5

Browse files
fix: handle None root_model in lm_handler
When users call llm_query(prompt) without specifying a model, request.model is None. The handler correctly uses the default client but was recording None as root_model, causing TypeError in verbose printer. Now falls back to client.model_name when request.model is None.
1 parent 8a3a661 commit 12212f5

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

‎rlm/core/lm_handler.py‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@ def _handle_single(self, request: LMRequest, handler: "LMHandler") -> LMResponse
5454
usage_summary = client.get_last_usage()
5555
return LMResponse.success_response(
5656
chat_completion=RLMChatCompletion(
57-
root_model=request.model,
57+
root_model=request.model or client.model_name,
5858
prompt=request.prompt,
5959
response=content,
6060
usage_summary=usage_summary,
@@ -80,7 +80,7 @@ async def run_all():
8080

8181
chat_completions = [
8282
RLMChatCompletion(
83-
root_model=request.model,
83+
root_model=request.model or client.model_name,
8484
prompt=prompt,
8585
response=content,
8686
usage_summary=usage_summary,

0 commit comments

Comments
 (0)