Training deep networks on the cluster

How to run a program to train the neural network on the cluster

1. Train the neural network on the CPU

srun -c 12 -t 3:00:00 -u python mnist.py

-c - the number of CPU cores

-t - maximum training time (3:00:00 means 3 hours)

-u - print the program output

mnist.py - the name of the program

2. Train the neural network on the GPU

srun --gres=gpu:1 -t 3:00:00 -u python mnist.py

--gres=gpu:1 - request a GPU for training. Keras supports only one GPU for training neural networks.

-t - maximum training time (3:00:00 means 3 hours)

-u - print the program output

mnist.py - the name of the program