Repository navigation
Commit 9dfd9f5
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 22 files
- docs/mcore-inference-user-guide.md+22
- megatron/core/inference/engines/dynamic_engine.py+12-1
- megatron/core/inference/inference_request.py+5-1
- megatron/core/inference/sampling/base.py+3
- megatron/core/inference/sampling/flashinfer_sampling.py+1
- megatron/core/inference/sampling/request_seed_noise.py+66
- megatron/core/inference/sampling/torch_sampling.py+58-4
- megatron/core/inference/sampling_params.py+9
- megatron/core/inference/text_generation_controllers/text_generation_controller.py+14-5
- megatron/core/inference/text_generation_server/dynamic_text_gen_server/endpoints/chat_completions.py+6-4
- megatron/core/inference/text_generation_server/dynamic_text_gen_server/endpoints/common.py+9
- megatron/core/inference/text_generation_server/dynamic_text_gen_server/endpoints/completions.py+4-1
- pyproject.toml+2-2
- tests/unit_tests/determinism/kernels/manifest.py+12
- tests/unit_tests/determinism/kernels/test_request_seed_sampling.py+52
- tests/unit_tests/inference/engines/test_dynamic_engine_async_sched.py+4-2
- tests/unit_tests/inference/engines/test_dynamic_engine_request_lifecycle.py+1
- tests/unit_tests/inference/test_endpoints_common.py+2
- tests/unit_tests/inference/test_http_request_seed.py+72
- tests/unit_tests/inference/test_request_seed_sampling.py+252
- tests/unit_tests/inference/text_generation_controllers/test_text_generation_controller.py+63-2
- uv.lock+4-4
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
171 | 171 | | |
172 | 172 | | |
173 | 173 | | |
174 | | - | |
| 174 | + | |
175 | 175 | | |
176 | 176 | | |
177 | 177 | | |
| |||
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments