You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 6aa6e7e
Browse filesBrowse the repository at this point in the historyBrowse files
Make the CUDA backend page agree with the TensorRT page
The CUDA backend page said several things that the TensorRT page, and the
code, contradict:
- It said the Python runtime allocates host memory for an unplanned output,
so a method that keeps its outputs on the GPU could not run from Python.
The Python runtime allocates a new device buffer for each call.
- It said a planned input fed with GPU memory makes an undefined host
memcpy and crashes. The runtime refuses that copy and the call fails with
NotSupported.
- It asked for a CUDA 11.x or later toolkit to run a model. The prebuilt
packages use CUDA 13 and bring the CUDA runtime with them on Linux, a
build from source also supports CUDA 12.6, and the toolkit is needed for
export, where nvcc compiles the kernels. It also gave no minimum GPU,
while the packages are built for compute capability 8.0 and newer, and it
asked for Python 3.8+, while the package needs 3.11 to 3.15.
- It listed Windows without saying that programs for Windows are exported
on Linux. It now links to the C++ guide section that shows how.
0 commit comments