How to inspect Hadoop configuration using command-line

Inspect Hadoop configuration using command-line.

Hadoop provides a utility to get necessary configuration information.

$ hdfs getconf

hdfs getconf is utility for getting configuration information from the config file.

hadoop getconf 
        [-namenodes]                    gets list of namenodes in the cluster.
        [-secondaryNameNodes]                   gets list of secondary namenodes in the cluster.
        [-backupNodes]                  gets list of backup nodes in the cluster.
        [-journalNodes]                 gets list of journal nodes in the cluster.
        [-includeFile]                  gets the include file path that defines the datanodes that can join the cluster.
        [-excludeFile]                  gets the exclude file path that defines the datanodes that need to decommissioned.
        [-nnRpcAddresses]                       gets the namenode rpc addresses
        [-confKey [key]]                        gets a specific key from the configuration

Display name nodes.

$ hdfs getconf -namenodes

namenode.example.org

Display secondary name nodes.

$ hdfs getconf -secondaryNameNodes

secondarynamenode.example.org

Display name node RPC addresses.

$ hdfs getconf -nnRpcAddresses    

namenode.example.org:9000

Display include file path.

$ hdfs getconf -includeFile

/opt/hadoop/hadoop-3.2.2/etc/hadoop/includes

Display exclude file path.

$ hdfs getconf -excludeFile

Configuration dfs.hosts.exclude is missing.

Display specific configuration key.

$ hdfs getconf -confKey dfs.namenode.datanode.registration.ip-hostname-check

true

$ hdfs getconf -confKey dfs.namenode.checkpoint.period

3600s

Use exit code to determine if configuration key is missing.