Categories
SysOps

How to display Hadoop cluster report

Display Hadoop cluster report.

$ hdfs dfsadmin -report
Configured Capacity: 63010750464 (58.68 GB)
Present Capacity: 52346458112 (48.75 GB)
DFS Remaining: 49855922176 (46.43 GB)
DFS Used: 2490535936 (2.32 GB)
DFS Used%: 4.76%
Replicated Blocks:
        Under replicated blocks: 5797
        Blocks with corrupt replicas: 0
        Missing blocks: 0
        Missing blocks (with replication factor 1): 0
        Low redundancy blocks with highest priority to recover: 0
        Pending deletion blocks: 0
Erasure Coded Block Groups: 
        Low redundancy block groups: 0
        Block groups with corrupt internal blocks: 0
        Missing block groups: 0
        Low redundancy blocks with highest priority to recover: 0
        Pending deletion blocks: 0

-------------------------------------------------
Live datanodes (3):

Name: 192.168.8.173:9866 (datanode1.example.org)
Hostname: datanode1.example.org
Rack: /rack-red
Decommission Status : Normal
Configured Capacity: 21003583488 (19.56 GB)
DFS Used: 830136320 (791.68 MB)
Non DFS Used: 2464727040 (2.30 GB)
DFS Remaining: 16618201088 (15.48 GB)
DFS Used%: 3.95%
DFS Remaining%: 79.12%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Mon May 17 22:29:59 UTC 2021
Last Block Report: Mon May 17 22:26:03 UTC 2021
Num of Blocks: 5834


Name: 192.168.8.174:9866 (datanode2.example.org)
Hostname: datanode2.example.org
Rack: /rack-blue
Decommission Status : Normal
Configured Capacity: 21003583488 (19.56 GB)
DFS Used: 830205952 (791.75 MB)
Non DFS Used: 2464002048 (2.29 GB)
DFS Remaining: 16618856448 (15.48 GB)
DFS Used%: 3.95%
DFS Remaining%: 79.12%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Mon May 17 22:29:59 UTC 2021
Last Block Report: Mon May 17 22:26:03 UTC 2021
Num of Blocks: 5835


Name: 192.168.8.175:9866 (datanode3.example.org)
Hostname: datanode3.example.org
Rack: /rack-red
Decommission Status : Normal
Configured Capacity: 21003583488 (19.56 GB)
DFS Used: 830193664 (791.73 MB)
Non DFS Used: 2464006144 (2.29 GB)
DFS Remaining: 16618864640 (15.48 GB)
DFS Used%: 3.95%
DFS Remaining%: 79.12%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Mon May 17 22:29:59 UTC 2021
Last Block Report: Mon May 17 22:26:03 UTC 2021
Num of Blocks: 5835

There are additional options, but these will be described later.

hdfs dfsadmin [-report [-live] [-dead] [-decommissioning] [-enteringmaintenance] [-inmaintenance]]