[LLM serving 2/x] Add batching-backed serving session lifecycle - #23277

[LLM serving 2/x] Add batching-backed serving session lifecycle#23277

metascroy merged 2 commits into

mainpytorch/executorch:mainfrom

llm-serving/02-session-lifecyclepytorch/executorch:llm-serving/02-session-lifecycleCopy head branch name to clipboard