11.2. How to control the number of nodes used by a job ?

Set the number of CPU nodes used by DP algorithms with:

mpirun -np $num_nodes dp  Set the number of threads used by DP algorithms with: export OMP_NUM_THREADS=$num_threads


Set the number of CPU nodes used by TF kernels with:

export TF_INTRA_OP_PARALLELISM_THREADS=$num_nodes export TF_INTER_OP_PARALLELISM_THREADS=$num_nodes