You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 034f5dd
Browse filesBrowse the repository at this point in the historyBrowse files
[None][fix] Cherry-pick #20777 from release/1.3: Validate telemetry deployment IDs as UUIDs
Forward-port of release/1.3 PR #20777
(release/1.3 commit 6c172f3) to main.
Adapted to main: the new payload test patches _HEARTBEAT_STOP, which main
renamed from _REPORTER_STOP.
Signed-off-by: Maxim Gluhovskoi <mgluhovskoi@nvidia.com>
Signed-off-by: Simeng Liu <simengl@nvidia.com>
Every heartbeat also contains the five aggregate LLM lifecycle counters above.
169
169
@@ -183,7 +183,7 @@ outcome. Missing terminal events remain unknown; they are not confirmed crashes.
183
183
|`reportingSource`| enum |`self`, `supervisor`, or `executor_proxy`. |
184
184
|`ingressPoint`| ShortString | Entry point copied onto the terminal event so terminal-only early failures remain attributable. |
185
185
|`disaggRole`| ShortString | Disaggregated role (`context`, `generation`, `coordinator`, `server_coordinator`, or compatible legacy `ctx0`/`gen0`), or empty when unavailable/not applicable. |
Every terminal report also contains the five aggregate LLM lifecycle counters
189
189
above. Delivery is best-effort and waits no more than 0.5 seconds; the local
@@ -310,7 +310,13 @@ over time.
310
310
|`TRTLLM_USAGE_HEARTBEAT_INTERVAL`|`600`| Heartbeat interval in seconds. |
311
311
|`TRTLLM_USAGE_FORCE_ENABLED`|`0`| Set to `1` to force-enable telemetry in CI/test environments. |
312
312
|`TRTLLM_DISAGG_ROLE`| unset | Disaggregated serving role (`context`, `generation`, `coordinator`, `server_coordinator`, or compatible legacy values such as `ctx0`/`gen0`). |
313
-
|`TRTLLM_DISAGG_DEPLOYMENT_ID`| unset | Shared deployment ID across disaggregated workers. |
313
+
|`TRTLLM_DISAGG_DEPLOYMENT_ID`| unset | Shared deployment UUID across disaggregated workers. Invalid values are reported as an empty ID. |
314
+
315
+
The disaggregated launcher generates a random deployment UUID and shares it
316
+
through the environment. Custom launchers can also supply a shared UUID via
317
+
`TRTLLM_DISAGG_DEPLOYMENT_ID`. Telemetry validates it with `uuid.UUID` and emits
318
+
32 lowercase hexadecimal characters, or an empty string if invalid. This checks
319
+
format, not who generated the UUID or whether it contains encoded identifying data.
0 commit comments