Repository navigation
Commit beafc96
committed
Update the TensorRT backend docs page
The TensorRT backend page had drifted away from Torch-TensorRT, the project
that builds and ships the TensorRT delegate. It pointed readers at a nightly
build from early October. It said that CUDA graph replay never runs for
engines on the shared activation scratch, which nightly builds now do. It
repeated most of the Torch-TensorRT deployment guide, so every change to the
delegate had to be made in two places. The backends table listed TensorRT as
Linux only.
The page keeps the usual backend sections but says less in each and shows
more code: the one-line install command, export, sending unsupported
operators to the CUDA backend, keeping inputs and outputs on the GPU, Python
and C++ runtime integration (a main.cpp, a complete CMakeLists.txt, and the
build and run commands), and a short list of performance options that link to
the Torch-TensorRT guide. It describes Torch-TensorRT 2.15 and newer and marks
the two features that need a newer build. The examples no longer pass
retrace=False, because save keeps the compiled graph by default.1 parent 4db778e commit beafc96
2 files changed
Lines changed: 287 additions & 329 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
25 | | - | |
| 25 | + | |
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
| |||
0 commit comments