Repository navigation
Commit e0761ff
authored
Checks to use the correct ami when on cu130 to avoid crashes at launch (#6281)
* add: checks to use the correct ami when on cu130 to avoid crashes at
launch
add: tests
Signed-off-by: DWarez <dario.salvati@huggingface.co>
* fix: reverting timeout in kwargs change
Signed-off-by: DWarez <dario.salvati@huggingface.co>
* fix: removing the check on vllm server in order to apply the fix for
every dlc
Signed-off-by: DWarez <dario.salvati@huggingface.co>
* fix: addressed code bot comment
Signed-off-by: DWarez <dario.salvati@huggingface.co>
---------
Signed-off-by: DWarez <dario.salvati@huggingface.co>1 parent 38d4ef9 commit e0761ff
4 files changed
Lines changed: 156 additions & 18 deletions
File tree
- sagemaker-serve
- src/sagemaker/serve
- tests/unit
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3988 | 3988 | | |
3989 | 3989 | | |
3990 | 3990 | | |
| 3991 | + | |
| 3992 | + | |
| 3993 | + | |
| 3994 | + | |
| 3995 | + | |
| 3996 | + | |
3991 | 3997 | | |
3992 | 3998 | | |
3993 | 3999 | | |
| |||
6053 | 6059 | | |
6054 | 6060 | | |
6055 | 6061 | | |
| 6062 | + | |
| 6063 | + | |
| 6064 | + | |
6056 | 6065 | | |
6057 | 6066 | | |
6058 | 6067 | | |
| |||
6113 | 6122 | | |
6114 | 6123 | | |
6115 | 6124 | | |
6116 | | - | |
6117 | | - | |
6118 | | - | |
6119 | | - | |
6120 | | - | |
6121 | 6125 | | |
6122 | 6126 | | |
6123 | 6127 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
24 | | - | |
| 24 | + | |
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
| |||
76 | 76 | | |
77 | 77 | | |
78 | 78 | | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
79 | 95 | | |
80 | 96 | | |
81 | 97 | | |
| |||
327 | 343 | | |
328 | 344 | | |
329 | 345 | | |
| 346 | + | |
| 347 | + | |
| 348 | + | |
| 349 | + | |
| 350 | + | |
| 351 | + | |
| 352 | + | |
| 353 | + | |
| 354 | + | |
| 355 | + | |
| 356 | + | |
| 357 | + | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
| 361 | + | |
| 362 | + | |
| 363 | + | |
| 364 | + | |
| 365 | + | |
| 366 | + | |
| 367 | + | |
| 368 | + | |
330 | 369 | | |
331 | 370 | | |
332 | 371 | | |
333 | 372 | | |
334 | | - | |
335 | | - | |
336 | | - | |
337 | | - | |
338 | | - | |
| 373 | + | |
| 374 | + | |
| 375 | + | |
| 376 | + | |
339 | 377 | | |
340 | 378 | | |
341 | 379 | | |
| |||
358 | 396 | | |
359 | 397 | | |
360 | 398 | | |
361 | | - | |
362 | | - | |
| 399 | + | |
363 | 400 | | |
364 | 401 | | |
365 | 402 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| |||
292 | 292 | | |
293 | 293 | | |
294 | 294 | | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
| 344 | + | |
| 345 | + | |
| 346 | + | |
| 347 | + | |
| 348 | + | |
| 349 | + | |
| 350 | + | |
| 351 | + | |
| 352 | + | |
| 353 | + | |
| 354 | + | |
| 355 | + | |
| 356 | + | |
| 357 | + | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
| 361 | + | |
| 362 | + | |
| 363 | + | |
| 364 | + | |
| 365 | + | |
| 366 | + | |
| 367 | + | |
| 368 | + | |
| 369 | + | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
| 373 | + | |
| 374 | + | |
| 375 | + | |
| 376 | + | |
| 377 | + | |
| 378 | + | |
| 379 | + | |
| 380 | + | |
| 381 | + | |
| 382 | + | |
| 383 | + | |
| 384 | + | |
| 385 | + | |
| 386 | + | |
| 387 | + | |
| 388 | + | |
| 389 | + | |
| 390 | + | |
295 | 391 | | |
296 | 392 | | |
297 | 393 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
198 | 198 | | |
199 | 199 | | |
200 | 200 | | |
201 | | - | |
202 | | - | |
| 201 | + | |
| 202 | + | |
203 | 203 | | |
204 | | - | |
| 204 | + | |
205 | 205 | | |
206 | | - | |
| 206 | + | |
| 207 | + | |
207 | 208 | | |
208 | 209 | | |
209 | 210 | | |
| |||
0 commit comments