CUDA device Change

[adhiraj4802]

Currently when my cuda device 0, doesnt have any space left I load the SNAC model on device "cuda:1". After loading onto cuda:1, i get no outputs from the SNAC model.

[adhiraj4802]

Found the solution my bad:
Solution:
with (torch.cuda.device(self._device)):
with torch.inference_mode():
audio_hat = self.model.decode(codes)

self._device needs to be a torch device

[adhiraj4802]

Only useful when using any other CUDA device than "cuda:0"