Skip to content

Commit eb97c90

Browse files
committed
Please behave
1 parent 226a775 commit eb97c90

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

tivars/tokenizer/state.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,7 @@ def next(self, token: TIToken, remainder: str) -> list[list['TokenizerState']]:
8787
Determines the next tokenizer timelines given a token
8888
8989
Each timeline that will branch from this one is returned as a list of states to add to a copy of the stack.
90+
9091
If a list of states in a timeline is...
9192
- empty, then the timeline is exiting the current state.
9293
- length one, then the timeline's current state is being replaced by a new state.

0 commit comments

Comments
 (0)