Conda multi-gpu env quick setup

Post date: Oct 09, 2020 3:0:22 PM

Main packages:

conda create -n py36 python=3.6

conda activate py36

conda install tensorflow-gpu==1.15

conda install cmake

conda install gxx_linux-64

conda install nccl

conda install openmpi

HOROVOD_GPU_OPERATIONS=NCCL pip install horovod==0.19.5

horovodrun -np 4 -H localhost:4 python main.py

For troubleshooting, refer to [1].

[1] https://github.com/horovod/horovod/issues/1944