Skip to content

feat(training): add DPO training with offline-scored reference model - #6092

Merged
cuichenx merged 42 commits into
NVIDIA-NeMo:mainfrom
Josephasafg:dpo_support
Oct 14, 2026
Merged

cuichenx merged 42 commits into
NVIDIA-NeMo:mainfrom
Josephasafg:dpo_support

Merge branch 'main' into dpo_support

59570d8
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 12, 2026 in 1s

DCO

All commits are signed off!