Tune quickstart capture framing and downsampling for documentation media - #7584
Draft
mataylor-nvidia wants to merge 1 commit into
Draft
Tune quickstart capture framing and downsampling for documentation media#7584mataylor-nvidia wants to merge 1 commit into
mataylor-nvidia wants to merge 1 commit into
Conversation
The quickstart GIFs rendered the OVRTX path tracer straight to their 320x240 publication size, so robot silhouettes and shadow edges aliased badly, and the per-task focal lengths left the subject occupying a small part of the frame with a large empty floor area around it. Capture at 1280x960 and let the generator downsample with lanczos, which resolves the detail that rendering directly to the final size destroyed. Tighten the focal lengths per task to the largest value that keeps the subject inside the published crop. The safe value is scene-specific rather than a fixed ratio: Cartpole clips its pole above 21, and Kuka Allegro is held at 24 because its lift policy raises the arm above the pose a zero action holds. Ease the denoiser from 2:2:6:6 to 1:1:3:3 now that supersampling rather than blurring removes the path-tracer noise, and widen the GIF palette from 128 to 256 colors with sierra2_4a dithering to avoid banding on the smoother gradients.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
The quickstart media generator rendered the OVRTX path tracer straight to the 320x240 publication size. Robot silhouettes and shadow edges aliased badly at that size, and the per-task focal lengths left the subject occupying a small fraction of the frame with a large empty floor area around it.
This changes the capture and encode stages only:
hqdn3dfrom2:2:6:6to1:1:3:3. The heavy setting existed to hide path-tracer noise; supersampling now removes that noise without blurring away detail.bayertosierra2_4adithering, which removes banding on the smoother gradients the sharper frames produce.Before / after
End-to-end effect on a published frame — current pipeline on the left, this PR in the middle, and a 640px variant on the right that was evaluated and not taken:
The framing options that were compared before settling on the tighter value:
Full variant sweep, including
rtx_environment="studio", which was rejected — it blows out the background and lowers contrast rather than raising it:Per-task focal lengths
The safe focal length is scene-specific rather than a fixed ratio of the old value. Scaling every task by the same factor clips two of them, so they are tuned individually:
Cartpole and G1 under the naive proportional scaling — note the Cartpole pole leaving the top of the crop:
Cartpole sweep that established 21 as the safe maximum:
Kuka Allegro sweep showing the arm clipping at 32:
Each value was validated by capturing the task and inspecting the frame through the same crop and downscale the generator applies.
Media refresh
This PR changes tooling only. Since #7501 moved the quickstart GIFs to S3,
docs/source/setup/quickstart.rstpoints atdownload.isaacsim.omniverse.nvidia.comURLs while the generator still writesagent-comparison.gifandtask-sampler.gifintodocs/source/_static/quickstart/. Regenerated media has to be uploaded to the bucket separately before readers see any change.Type of change
Checklist
pre-commitchecks with./isaaclab.sh --formatconfig/extension.tomlfile — n/a, no source package changedCONTRIBUTORS.mdor my name already exists there