Display NVIDIA devices using nvidia-smi
management command-line utility.
This utility is a part of the nvidia-utils
package.
$ echo nvidia-utils-$(nvidia-detector | awk -F "-" '{print $NF}')
nvidia-utils-470
List NVIDIA GPUs.
$ nvidia-smi --list-gpus
GPU 0: Quadro K420 (UUID: GPU-62037bd7-f5c9-58b4-289c-63a22b70a5f1)
Display GPU summary.
$ nvidia-smi --id=0
Sun Jun 19 00:56:11 2022 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 470.129.06 Driver Version: 470.129.06 CUDA Version: 11.4 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 Quadro K420 Off | 00000000:01:00.0 On | N/A | | 29% 58C P8 N/A / N/A | 370MiB / 972MiB | 1% Default | | | | N/A | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 6039 G /usr/lib/xorg/Xorg 120MiB | | 0 N/A N/A 6189 G /usr/bin/gnome-shell 84MiB | | 0 N/A N/A 7584 G ...184089392535669558,131072 128MiB | | 0 N/A N/A 11969 G ...=SendTabToSelfSigninPromo 30MiB | +-----------------------------------------------------------------------------+
Display memory information.
$ nvidia-smi --query --id=GPU-62037bd7-f5c9-58b4-289c-63a22b70a5f1 --display=MEMORY
==============NVSMI LOG============== Timestamp : Sun Jun 19 00:57:45 2022 Driver Version : 470.129.06 CUDA Version : 11.4 Attached GPUs : 1 GPU 00000000:01:00.0 FB Memory Usage Total : 972 MiB Used : 286 MiB Free : 686 MiB BAR1 Memory Usage Total : 256 MiB Used : 31 MiB Free : 225 MiB
Display GPUs utilization.
$ nvidia-smi --query --id=0 --display=UTILIZATION
==============NVSMI LOG============== Timestamp : Sun Jun 19 00:58:35 2022 Driver Version : 470.129.06 CUDA Version : 11.4 Attached GPUs : 1 GPU 00000000:01:00.0 Utilization Gpu : 8 % Memory : 10 % Encoder : 0 % Decoder : 0 % GPU Utilization Samples Duration : 16.54 sec Number of Samples : 99 Max : 32 % Min : 0 % Avg : 1 % Memory Utilization Samples Duration : 16.54 sec Number of Samples : 99 Max : 18 % Min : 2 % Avg : 3 % ENC Utilization Samples Duration : 16.54 sec Number of Samples : 99 Max : 0 % Min : 0 % Avg : 0 % DEC Utilization Samples Duration : 16.54 sec Number of Samples : 99 Max : 0 % Min : 0 % Avg : 0 %
Display temperature readings.
$ nvidia-smi --query --id=GPU-62037bd7-f5c9-58b4-289c-63a22b70a5f1 --display=TEMPERATURE
==============NVSMI LOG============== Timestamp : Sun Jun 19 00:59:19 2022 Driver Version : 470.129.06 CUDA Version : 11.4 Attached GPUs : 1 GPU 00000000:01:00.0 Temperature GPU Current Temp : 61 C GPU Shutdown Temp : 106 C GPU Slowdown Temp : 101 C GPU Max Operating Temp : N/A GPU Target Temperature : N/A Memory Current Temp : N/A Memory Max Operating Temp : N/A
Display current GPU clocks.
$ nvidia-smi --query --id=GPU-62037bd7-f5c9-58b4-289c-63a22b70a5f1 --display=CLOCK
==============NVSMI LOG============== Timestamp : Sun Jun 19 00:59:45 2022 Driver Version : 470.129.06 CUDA Version : 11.4 Attached GPUs : 1 GPU 00000000:01:00.0 Clocks Graphics : 706 MHz SM : 706 MHz Memory : 891 MHz Video : 540 MHz Applications Clocks Graphics : N/A Memory : N/A Default Applications Clocks Graphics : N/A Memory : N/A Max Clocks Graphics : 875 MHz SM : 875 MHz Memory : 891 MHz Video : 540 MHz Max Customer Boost Clocks Graphics : N/A SM Clock Samples Duration : 1368.45 sec Number of Samples : 100 Max : 875 MHz Min : 324 MHz Avg : 717 MHz Memory Clock Samples Duration : 1368.45 sec Number of Samples : 100 Max : 891 MHz Min : 324 MHz Avg : 748 MHz Clock Policy Auto Boost : N/A Auto Boost Default : N/A
Display processes using GPUs.
$ nvidia-smi --query --id=GPU-62037bd7-f5c9-58b4-289c-63a22b70a5f1 --display=PIDS
==============NVSMI LOG============== Timestamp : Sun Jun 19 00:53:34 2022 Driver Version : 470.129.06 CUDA Version : 11.4 Attached GPUs : 1 GPU 00000000:01:00.0 Processes GPU instance ID : N/A Compute instance ID : N/A Process ID : 6039 Type : G Name : /usr/lib/xorg/Xorg Used GPU Memory : 119 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 6189 Type : G Name : /usr/bin/gnome-shell Used GPU Memory : 77 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 7584 Type : G Name : /snap/chromium/2011/usr/lib/chromium-browser/chrome --type=gpu-process --change-stack-guard-on-fork=enable --gpu-preferences=WAAAAAAAAAAgAAAIAAAAAAAAAAAAAAAAAABgAAAAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAIAAAAAAAAAABAAAAAAAAAAgAAAAAAAAACAAAAAAAAAAIAAAAAAAAAA== --shared-files --field-trial-handle=0,i,13790493903683230138,10184089392535669558,131072 Used GPU Memory : 98 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 11969 Type : G Name : /opt/google/chrome/chrome --type=gpu-process --enable-crashpad --crashpad-handler-pid=11934 --enable-crash-reporter=, --change-stack-guard-on-fork=enable --gpu-preferences=WAAAAAAAAAAgAAAIAAAAAAAAAAAAAAAAAABgAAAAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAIAAAAAAAAAABAAAAAAAAAAgAAAAAAAAACAAAAAAAAAAIAAAAAAAAAA== --shared-files --field-trial-handle=0,i,1121080178544329143,6562938458874923767,131072 --enable-features=SendTabToSelfSigninPromo Used GPU Memory : 49 MiB
Display supported GPU clocks.
$ nvidia-smi --query --id=GPU-62037bd7-f5c9-58b4-289c-63a22b70a5f1 --display=SUPPORTED_CLOCKS
==============NVSMI LOG============== Timestamp : Sun Jun 19 00:54:17 2022 Driver Version : 470.129.06 CUDA Version : 11.4 Attached GPUs : 1 GPU 00000000:01:00.0 Supported Clocks Memory : 891 MHz Graphics : 875 MHz Graphics : 862 MHz Graphics : 849 MHz Graphics : 836 MHz Graphics : 823 MHz Graphics : 810 MHz Graphics : 797 MHz Graphics : 784 MHz Graphics : 771 MHz Graphics : 758 MHz Graphics : 745 MHz Graphics : 732 MHz Graphics : 719 MHz Graphics : 706 MHz Graphics : 693 MHz Graphics : 680 MHz Graphics : 667 MHz Graphics : 654 MHz Graphics : 641 MHz Graphics : 628 MHz Graphics : 615 MHz Graphics : 602 MHz Graphics : 589 MHz Graphics : 576 MHz Graphics : 563 MHz Graphics : 550 MHz Graphics : 537 MHz Graphics : 524 MHz Graphics : 511 MHz Graphics : 498 MHz Graphics : 485 MHz Graphics : 472 MHz Graphics : 459 MHz Graphics : 446 MHz Graphics : 433 MHz Graphics : 420 MHz Graphics : 407 MHz Graphics : 394 MHz Graphics : 381 MHz Graphics : 368 MHz Graphics : 355 MHz Graphics : 342 MHz Memory : 324 MHz Graphics : 324 MHz
Display all information at once.
$ nvidia-smi --query --id=0
==============NVSMI LOG============== Timestamp : Sun Jun 19 00:55:52 2022 Driver Version : 470.129.06 CUDA Version : 11.4 Attached GPUs : 1 GPU 00000000:01:00.0 Product Name : Quadro K420 Product Brand : Quadro Display Mode : Enabled Display Active : Enabled Persistence Mode : Disabled MIG Mode Current : N/A Pending : N/A Accounting Mode : Disabled Accounting Mode Buffer Size : 4000 Driver Model Current : N/A Pending : N/A Serial Number : 0422015055555 GPU UUID : GPU-62037bd7-f5c9-58b4-289c-63a22b70a5f1 Minor Number : 0 VBIOS Version : 80.07.E3.00.08 MultiGPU Board : No Board ID : 0x100 GPU Part Number : N/A Module ID : 0 Inforom Version Image Version : 2012.0505.00.01 OEM Object : 1.1 ECC Object : N/A Power Management Object : N/A GPU Operation Mode Current : N/A Pending : N/A GSP Firmware Version : N/A GPU Virtualization Mode Virtualization Mode : None Host VGPU Mode : N/A IBMNPU Relaxed Ordering Mode : N/A PCI Bus : 0x01 Device : 0x00 Domain : 0x0000 Device Id : 0x0FF310DE Bus Id : 00000000:01:00.0 Sub System Id : 0x110610DE GPU Link Info PCIe Generation Max : 2 Current : 2 Link Width Max : 16x Current : 16x Bridge Chip Type : N/A Firmware : N/A Replays Since Reset : 0 Replay Number Rollovers : 0 Tx Throughput : N/A Rx Throughput : N/A Fan Speed : 31 % Performance State : P0 Clocks Throttle Reasons Idle : Not Active Applications Clocks Setting : Not Active SW Power Cap : Not Active HW Slowdown : Not Active HW Thermal Slowdown : N/A HW Power Brake Slowdown : N/A Sync Boost : Not Active SW Thermal Slowdown : Not Active Display Clock Setting : Not Active FB Memory Usage Total : 972 MiB Used : 350 MiB Free : 622 MiB BAR1 Memory Usage Total : 256 MiB Used : 31 MiB Free : 225 MiB Compute Mode : Default Utilization Gpu : 0 % Memory : 2 % Encoder : 0 % Decoder : 0 % Encoder Stats Active Sessions : 0 Average FPS : 0 Average Latency : 0 FBC Stats Active Sessions : 0 Average FPS : 0 Average Latency : 0 Ecc Mode Current : N/A Pending : N/A ECC Errors Volatile Single Bit Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Double Bit Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Aggregate Single Bit Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Double Bit Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Retired Pages Single Bit ECC : N/A Double Bit ECC : N/A Pending Page Blacklist : N/A Remapped Rows : N/A Temperature GPU Current Temp : 62 C GPU Shutdown Temp : 106 C GPU Slowdown Temp : 101 C GPU Max Operating Temp : N/A GPU Target Temperature : N/A Memory Current Temp : N/A Memory Max Operating Temp : N/A Power Readings Power Management : N/A Power Draw : N/A Power Limit : N/A Default Power Limit : N/A Enforced Power Limit : N/A Min Power Limit : N/A Max Power Limit : N/A Clocks Graphics : 875 MHz SM : 875 MHz Memory : 891 MHz Video : 540 MHz Applications Clocks Graphics : N/A Memory : N/A Default Applications Clocks Graphics : N/A Memory : N/A Max Clocks Graphics : 875 MHz SM : 875 MHz Memory : 891 MHz Video : 540 MHz Max Customer Boost Clocks Graphics : N/A Clock Policy Auto Boost : N/A Auto Boost Default : N/A Voltage Graphics : N/A Processes GPU instance ID : N/A Compute instance ID : N/A Process ID : 6039 Type : G Name : /usr/lib/xorg/Xorg Used GPU Memory : 121 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 6189 Type : G Name : /usr/bin/gnome-shell Used GPU Memory : 84 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 7584 Type : G Name : /snap/chromium/2011/usr/lib/chromium-browser/chrome --type=gpu-process --change-stack-guard-on-fork=enable --gpu-preferences=WAAAAAAAAAAgAAAIAAAAAAAAAAAAAAAAAABgAAAAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAIAAAAAAAAAABAAAAAAAAAAgAAAAAAAAACAAAAAAAAAAIAAAAAAAAAA== --shared-files --field-trial-handle=0,i,13790493903683230138,10184089392535669558,131072 Used GPU Memory : 107 MiB GPU instance ID : N/A Compute instance ID : N/A Process ID : 11969 Type : G Name : /opt/google/chrome/chrome --type=gpu-process --enable-crashpad --crashpad-handler-pid=11934 --enable-crash-reporter=, --change-stack-guard-on-fork=enable --gpu-preferences=WAAAAAAAAAAgAAAIAAAAAAAAAAAAAAAAAABgAAAAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAIAAAAAAAAAABAAAAAAAAAAgAAAAAAAAACAAAAAAAAAAIAAAAAAAAAA== --shared-files --field-trial-handle=0,i,1121080178544329143,6562938458874923767,131072 --enable-features=SendTabToSelfSigninPromo Used GPU Memory : 30 MiB