NVIDIA Performance states

By design, NVIDIA GPU power states scale depending on GPU workload and each P-State maps to a performance level. For instance…

P0 (highest) – Maximum 3D Performance

P2 – Balanced 3D Performance-Power

P8 – Basic/Idle

If P state is not at P0, then program (i.e. Python) is not tasking the GPU to max performance.

Example resources:

• https://stackoverflow.com/questions/58092553/verify-tensorflow-is-maximizing-use-of-nvidia-gpu

• https://www.tensorflow.org/guide/gpu

• TensorFlow-Examples/examples/6_MultiGPU/multigpu_cnn.py at master · aymericdamien/TensorFlow-Examples