Skip to content
Discussion options

You must be logged in to vote

Yes, it is read_file itself truncating, and it is configurable. It is not related to your generationConfig or the model's context window.

Cause: read_file applies two caps, both taken from the tools settings:

  • tools.truncateToolOutputLines, default 1000 lines (used when the model does not pass its own limit)
  • tools.truncateToolOutputThreshold, default 25000 characters (always applied)

The char cap is the one you most likely hit at around 500 to 1000 lines, since 25k chars is only about 500 lines of typical code. When either cap trips, the output is cut and marked as truncated, and the model is supposed to continue with offset and limit. A 9B model often doesn't, so it re-reads the same fi…

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@jojo2357
Comment options

Answer selected by jojo2357
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants