Problem Statement
- Make sure core components such as llm-d-router is not overloaded during the benchmark and therefore not affecting benchmark results negatively
- Serve as a regression test to detect component regressions
Proposed Solution
the results should capture cpu/memory usage stats during the benchmark
Alternatives Considered
No response
Willingness to Contribute
Yes, I can submit a PR
Additional Context
No response
Problem Statement
Proposed Solution
the results should capture cpu/memory usage stats during the benchmark
Alternatives Considered
No response
Willingness to Contribute
Yes, I can submit a PR
Additional Context
No response