Fix local/unfused Megatron attention and LoRA on Ascend - #9864

Fix local/unfused Megatron attention and LoRA on Ascend#9864

hazelduan wants to merge 3 commits into

modelscope:mainmodelscope/ms-swift:mainfrom

hazelduan:gkd_dxqhazelduan/ms-swift:gkd_dxqCopy head branch name to clipboard