target: add NVIDIA H20 support - #4
Open
Fucov wants to merge 1 commit into
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add NVIDIA H20 as a first-class
GpuTargetand validate the existing Hoppersm_90AutoMegaKernel path on real H20 hardware.This is intentionally a minimal hardware-retargeting change: H20 reuses the existing SM90 CUDA implementation and requires no H20-specific scheduler, VM, ABI, or kernel branch.
H20 target
Validated on an NVIDIA H20 96GB system:
9.0(sm_90)7895.1 GiB60 MiB233472 B232448 B4000 GB/sFresh
eval/peak_bandwidth.pymeasurements:The target records the median result:
which is approximately
92.8%of the nominal bandwidth.Validation
H20 target registration and CUDA execution:
The 8-token generation test reports:
Correctness-gated single-stream decode baselines:
The H20/IR/ABI targeted regression suite passes:
including the frozen validator and ABI regression tests.
Existing upstream test status
The full test suite on the H20 host reports:
The two failures are:
Both failures were reproduced unchanged on pristine
upstream/mainat commita514bbcon the same machine, before applying the H20 target change.Similarly,
ruff check .currently reports five violations in the untouchedinstructions/reference.py; this PR does not modify that file.These pre-existing failures are intentionally not changed here in order to keep the H20 hardware-target contribution focused.
Scope
This PR only adds:
GpuTargetIt intentionally excludes unrelated model-importer, scheduler, attention, search-test, and local benchmark-artifact changes.