mpi
Use CUDA_VISIBLE_DEVICES environment variable as below. CUDA_VISIBLE_DEVICES=0,2,3 mpiexec -n 3 python train.py https://devtalk.nvidia.com/default/topic/509221/specifying-gpu-device-using-openmpi-mpirun/
Use CUDA_VISIBLE_DEVICES environment variable as below. CUDA_VISIBLE_DEVICES=0,2,3 mpiexec -n 3 python train.py https://devtalk.nvidia.com/default/topic/509221/specifying-gpu-device-using-openmpi-mpirun/