[Multi-GPU] Refactors multi-gpu logic into module, fix ghost process on keyboard interrup

[Multi-GPU] Refactors multi-gpu logic into module, fix ghost process on keyboard interrup #965