Inspect and redeploy the master certificate in OpenShift 3.11.

Preliminary notes

I am using custom master certificates.

openshift_master_overwrite_named_certificates: true
    openshift_master_named_certificates:
    - certfile: /etc/ssl/certs/openshift/openshift-development.example.org.pem
      keyfile: /etc/ssl/certs/openshift/openshift-development.example.org.key
These certificates are stored on the management node.

Inspect certificates

You can check certificates using easy-mode.yaml playbook.

$ cat ./playbooks/openshift-checks/certificate_expiry/easy-mode.yaml
---
# This example playbook is great if you're just wanting to try the
# role out.
#
# This example enables HTML and JSON reports
#
# All certificates (healthy or not) are included in the results
- name: Initialize facts
  import_playbook: ../../init/main.yml
  vars:
    l_init_fact_hosts: nodes:masters:etcd
    l_openshift_version_set_hosts: nodes:masters:etcd
- name: Check cert expirys
  hosts: nodes:masters:etcd
  vars:
    openshift_certificate_expiry_save_json_results: yes
    openshift_certificate_expiry_generate_html_report: yes
    openshift_certificate_expiry_show_all: yes
  roles:
    - role: openshift_certificate_expiry
Role variables are described on the Redeploying Certificates page.

Execute it to check cluster certificates.

$ ansible-playbook -i hosts ./playbooks/openshift-checks/certificate_expiry/easy-mode.yaml
PLAY [Initialization Checkpoint Start] ******************************************************************************************************************************************************************************
TASK [Set install initialization 'In Progress'] *********************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:57 +0200 (0:00:00.040)       0:00:00.040 *********
ok: [openshift-development-master-1.example.org]
PLAY [Populate config host groups] **********************************************************************************************************************************************************************************
TASK [Load group name mapping variables] ****************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:57 +0200 (0:00:00.102)       0:00:00.143 *********
ok: [localhost]
TASK [Evaluate groups - g_nfs_hosts is single host] *****************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:57 +0200 (0:00:00.025)       0:00:00.169 *********
skipping: [localhost]
TASK [Evaluate oo_all_hosts] ****************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:57 +0200 (0:00:00.072)       0:00:00.242 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
ok: [localhost] => (item=openshift-development-infra-1.example.org)
ok: [localhost] => (item=openshift-development-node-1.example.org)
ok: [localhost] => (item=openshift-development-node-2.example.org)
ok: [localhost] => (item=openshift-development-lb-1.example.org)
TASK [Evaluate oo_masters] ******************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.181)       0:00:00.423 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_first_master] *************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.134)       0:00:00.558 *********
ok: [localhost]
TASK [Evaluate oo_new_etcd_to_config] *******************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.144)       0:00:00.703 *********
TASK [Evaluate oo_masters_to_config] ********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.079)       0:00:00.782 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_etcd_to_config] ***********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.095)       0:00:00.878 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_first_etcd] ***************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.092)       0:00:00.971 *********
ok: [localhost]
TASK [Evaluate oo_etcd_hosts_to_upgrade] ****************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.097)       0:00:01.068 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_etcd_hosts_to_backup] *****************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.085)       0:00:01.154 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_nodes_to_config] **********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:58 +0200 (0:00:00.085)       0:00:01.239 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
ok: [localhost] => (item=openshift-development-infra-1.example.org)
ok: [localhost] => (item=openshift-development-node-1.example.org)
ok: [localhost] => (item=openshift-development-node-2.example.org)
TASK [Evaluate oo_lb_to_config] *************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:59 +0200 (0:00:00.117)       0:00:01.357 *********
ok: [localhost] => (item=openshift-development-lb-1.example.org)
TASK [Evaluate oo_nfs_to_config] ************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:59 +0200 (0:00:00.089)       0:00:01.447 *********
TASK [Evaluate oo_glusterfs_to_config] ******************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:59 +0200 (0:00:00.077)       0:00:01.524 *********
TASK [Evaluate oo_etcd_to_migrate] **********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:59 +0200 (0:00:00.075)       0:00:01.599 *********
ok: [localhost] => (item=openshift-development-master-1.example.org)
[WARNING]: Could not match supplied host pattern, ignoring: oo_nfs_to_config
PLAY [Ensure that all non-node hosts are accessible] ****************************************************************************************************************************************************************
TASK [Gathering Facts] **********************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:11:59 +0200 (0:00:00.093)       0:00:01.693 *********
ok: [openshift-development-lb-1.example.org]
ok: [openshift-development-master-1.example.org]
PLAY [Initialize basic host facts] **********************************************************************************************************************************************************************************
TASK [Gathering Facts] **********************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:01 +0200 (0:00:02.009)       0:00:03.703 *********
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-infra-1.example.org]
TASK [openshift_sanitize_inventory : include_tasks] *****************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:03 +0200 (0:00:01.828)       0:00:05.532 *********
included: /root/openshift-ansible/roles/openshift_sanitize_inventory/tasks/deprecations.yml for openshift-development-master-1.example.org, openshift-development-infra-1.example.org, openshift-development-node-1.example.org, openshift-development-node-2.example.org
TASK [openshift_sanitize_inventory : Check for usage of deprecated variables] ***************************************************************************************************************************************
Thursday 02 July 2020  12:12:03 +0200 (0:00:00.378)       0:00:05.910 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-infra-1.example.org]
TASK [openshift_sanitize_inventory : debug] *************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:04 +0200 (0:00:00.443)       0:00:06.354 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : set_stats] *********************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:04 +0200 (0:00:00.205)       0:00:06.560 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : set_fact] **********************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:04 +0200 (0:00:00.193)       0:00:06.753 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Standardize on latest variable names] ******************************************************************************************************************************************
Thursday 02 July 2020  12:12:04 +0200 (0:00:00.221)       0:00:06.975 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Normalize openshift_release] ***************************************************************************************************************************************************
Thursday 02 July 2020  12:12:04 +0200 (0:00:00.241)       0:00:07.217 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Abort when openshift_release is invalid] ***************************************************************************************************************************************
Thursday 02 July 2020  12:12:05 +0200 (0:00:00.205)       0:00:07.422 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : include_tasks] *****************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:05 +0200 (0:00:00.279)       0:00:07.702 *********
`included: /root/openshift-ansible/roles/openshift_sanitize_inventory/tasks/unsupported.yml for openshift-development-master-1.example.org, openshift-development-infra-1.example.org, openshift-development-node-1.example.org, openshift-development-node-2.example.org
[
TASK [openshift_sanitize_inventory : set_fact] **********************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:05 +0200 (0:00:00.426)       0:00:08.128 *********
TASK [openshift_sanitize_inventory : Ensure that dynamic provisioning is set if using dynamic storage] **************************************************************************************************************
Thursday 02 July 2020  12:12:06 +0200 (0:00:00.220)       0:00:08.349 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure the hosted registry's GlusterFS storage is configured correctly] ********************************************************************************************************
Thursday 02 July 2020  12:12:06 +0200 (0:00:00.209)       0:00:08.558 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure the hosted registry's GlusterFS storage is configured correctly] ********************************************************************************************************
Thursday 02 July 2020  12:12:06 +0200 (0:00:00.197)       0:00:08.756 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Check for deprecated prometheus/grafana install] *******************************************************************************************************************************
Thursday 02 July 2020  12:12:06 +0200 (0:00:00.187)       0:00:08.944 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure clusterid is set along with the cloudprovider] **************************************************************************************************************************
Thursday 02 July 2020  12:12:06 +0200 (0:00:00.226)       0:00:09.170 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure ansible_service_broker_remove and ansible_service_broker_install are mutually exclusive] ********************************************************************************
Thursday 02 July 2020  12:12:07 +0200 (0:00:00.191)       0:00:09.362 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure template_service_broker_remove and template_service_broker_install are mutually exclusive] ******************************************************************************
Thursday 02 July 2020  12:12:07 +0200 (0:00:00.202)       0:00:09.564 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure that all requires vsphere configuration variables are set] **************************************************************************************************************
Thursday 02 July 2020  12:12:07 +0200 (0:00:00.186)       0:00:09.751 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : ensure provider configuration variables are defined] ***************************************************************************************************************************
Thursday 02 July 2020  12:12:07 +0200 (0:00:00.185)       0:00:09.936 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure removed web console extension variables are not set] ********************************************************************************************************************
Thursday 02 July 2020  12:12:07 +0200 (0:00:00.197)       0:00:10.134 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure that web console port matches API server port] **************************************************************************************************************************
Thursday 02 July 2020  12:12:08 +0200 (0:00:00.227)       0:00:10.361 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : At least one master is schedulable] ********************************************************************************************************************************************
Thursday 02 July 2020  12:12:08 +0200 (0:00:00.199)       0:00:10.560 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : Ensure openshift_master_cluster_hostname is set when deploying multiple masters] ***********************************************************************************************
Thursday 02 July 2020  12:12:08 +0200 (0:00:00.241)       0:00:10.802 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [Detecting Operating System from ostree_booted] ****************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:08 +0200 (0:00:00.192)       0:00:10.994 *********
^[[5~ok: [openshift-development-node-2.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-master-1.example.org]
TASK [set openshift_deployment_type if unset] ***********************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:09 +0200 (0:00:00.505)       0:00:11.500 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
^[[5~
TASK [initialize_facts set fact openshift_is_atomic] ****************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:09 +0200 (0:00:00.224)       0:00:11.725 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
TASK [Determine Atomic Host Docker Version] *************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:09 +0200 (0:00:00.196)       0:00:11.921 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [assert atomic host docker version is 1.12 or later] ***********************************************************************************************************************************************************
Thursday 02 July 2020  12:12:09 +0200 (0:00:00.206)       0:00:12.128 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
PLAY [Retrieve existing master configs and validate] ****************************************************************************************************************************************************************
TASK [openshift_control_plane : stat] *******************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:10 +0200 (0:00:00.234)       0:00:12.362 *********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : slurp] ******************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:10 +0200 (0:00:00.243)       0:00:12.606 *********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : set_fact] ***************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:10 +0200 (0:00:00.439)       0:00:13.045 *********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : Check for file paths outside of /etc/origin/master in master's config] **************************************************************************************************************
Thursday 02 July 2020  12:12:10 +0200 (0:00:00.139)       0:00:13.185 *********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : set_fact] ***************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:10 +0200 (0:00:00.081)       0:00:13.267 *********
ok: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.085)       0:00:13.352 *********
ok: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.068)       0:00:13.421 *********
ok: [openshift-development-master-1.example.org]
PLAY [Initialize special first-master variables] ********************************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.080)       0:00:13.501 *********
skipping: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.067)       0:00:13.568 *********
ok: [openshift-development-master-1.example.org]
PLAY [Disable web console if required] ******************************************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.071)       0:00:13.640 *********
skipping: [openshift-development-master-1.example.org]
PLAY [Setup yum repositories for all hosts] *************************************************************************************************************************************************************************
skipping: no hosts matched
PLAY [Install packages necessary for installer] *********************************************************************************************************************************************************************
TASK [Determine if chrony is installed] *****************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.070)       0:00:13.710 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Install ntp package] ******************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.218)       0:00:13.929 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Start and enable ntpd/chronyd] ********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:11 +0200 (0:00:00.220)       0:00:14.150 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Ensure minimum kernel version] ********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:12 +0200 (0:00:00.222)       0:00:14.372 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Ensure openshift-ansible installer package deps are installed] ************************************************************************************************************************************************
Thursday 02 July 2020  12:12:12 +0200 (0:00:00.221)       0:00:14.593 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
PLAY [Initialize cluster facts] *************************************************************************************************************************************************************************************
TASK [get openshift_current_version] ********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:12 +0200 (0:00:00.226)       0:00:14.820 *********
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-master-1.example.org]
TASK [set_fact openshift_portal_net if present on masters] **********************************************************************************************************************************************************
Thursday 02 July 2020  12:12:13 +0200 (0:00:00.794)       0:00:15.614 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
TASK [Gather Cluster facts] *****************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:13 +0200 (0:00:00.309)       0:00:15.924 *********
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-master-1.example.org]
TASK [Set fact of no_proxy_internal_hostnames] **********************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:14 +0200 (0:00:00.811)       0:00:16.735 *********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
TASK [Initialize openshift.node.sdn_mtu] ****************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:14 +0200 (0:00:00.213)       0:00:16.949 *********
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
TASK [set_fact l_kubelet_node_name] *********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:15 +0200 (0:00:00.629)       0:00:17.578 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
PLAY [Initialize etcd host variables] *******************************************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:15 +0200 (0:00:00.238)       0:00:17.816 *********
ok: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:15 +0200 (0:00:00.160)       0:00:17.977 *********
ok: [openshift-development-master-1.example.org]
PLAY [Determine openshift_version to configure on first master] *****************************************************************************************************************************************************
TASK [include_role : openshift_version] *****************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:15 +0200 (0:00:00.078)       0:00:18.055 *********
TASK [openshift_version : Use openshift_current_version fact as version to configure if already installed] **********************************************************************************************************
Thursday 02 July 2020  12:12:15 +0200 (0:00:00.131)       0:00:18.187 *********
ok: [openshift-development-master-1.example.org]
TASK [Set openshift_version to openshift_release if undefined] ******************************************************************************************************************************************************
Thursday 02 July 2020  12:12:15 +0200 (0:00:00.078)       0:00:18.266 *********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:15 +0200 (0:00:00.064)       0:00:18.331 *********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_version : set_fact] *********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.060)       0:00:18.391 *********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.068)       0:00:18.459 *********
ok: [openshift-development-master-1.example.org] => {
    "msg": "openshift_image_tag was not defined. Falling back to v3.11.0"
}
TASK [openshift_version : set_fact] *********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.070)       0:00:18.529 *********
ok: [openshift-development-master-1.example.org]
TASK [openshift_version : assert openshift_release in openshift_image_tag] ******************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.078)       0:00:18.608 *********
ok: [openshift-development-master-1.example.org] => {
    "changed": false,
    "msg": "All assertions passed"
}
TASK [openshift_version : assert openshift_release in openshift_pkg_version] ****************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.066)       0:00:18.675 *********
ok: [openshift-development-master-1.example.org] => {
    "changed": false,
    "msg": "All assertions passed"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.115)       0:00:18.791 *********
ok: [openshift-development-master-1.example.org] => {
    "openshift_release": "3.11"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.073)       0:00:18.864 *********
ok: [openshift-development-master-1.example.org] => {
    "openshift_image_tag": "v3.11.0"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.063)       0:00:18.928 *********
ok: [openshift-development-master-1.example.org] => {
    "openshift_pkg_version": "-3.11.0"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.068)       0:00:18.997 *********
ok: [openshift-development-master-1.example.org] => {
    "openshift_version": "3.11.0"
}
PLAY [Set openshift_version for etcd, node, and master hosts] *******************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:16 +0200 (0:00:00.071)       0:00:19.069 *********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
PLAY [Verify Requirements] ******************************************************************************************************************************************************************************************
TASK [Run variable sanity checks] ***********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:17 +0200 (0:00:00.387)       0:00:19.457 *********
ok: [openshift-development-master-1.example.org]
TASK [Validate openshift_node_groups and openshift_node_group_name] *************************************************************************************************************************************************
Thursday 02 July 2020  12:12:17 +0200 (0:00:00.242)       0:00:19.699 *********
ok: [openshift-development-master-1.example.org]
TASK [Validate openshift_master_ca_certificate when defined] ********************************************************************************************************************************************************
Thursday 02 July 2020  12:12:17 +0200 (0:00:00.210)       0:00:19.910 *********
skipping: [openshift-development-master-1.example.org]
TASK [Fetch ca.crt from cluster if exists] **************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:17 +0200 (0:00:00.069)       0:00:19.980 *********
ok: [openshift-development-master-1.example.org]
TASK [Validate ca.crt from cluster if exists] ***********************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:17 +0200 (0:00:00.237)       0:00:20.217 *********
skipping: [openshift-development-master-1.example.org]
PLAY [Verify Node Prerequisites] ************************************************************************************************************************************************************************************
skipping: no hosts matched
PLAY [Validate Aci deployment variables] ****************************************************************************************************************************************************************************
TASK [Verify Aci deployment file variable is defined] ***************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:17 +0200 (0:00:00.091)       0:00:20.309 *********
skipping: [openshift-development-master-1.example.org]
TASK [Verify Aci deployment file exists] ****************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:18 +0200 (0:00:00.067)       0:00:20.376 *********
skipping: [openshift-development-master-1.example.org]
TASK [Fail if file does not exist] **********************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:18 +0200 (0:00:00.072)       0:00:20.449 *********
skipping: [openshift-development-master-1.example.org]
PLAY [Initialization Checkpoint End] ********************************************************************************************************************************************************************************
TASK [Set install initialization 'Complete'] ************************************************************************************************************************************************************************
Thursday 02 July 2020  12:12:18 +0200 (0:00:00.073)       0:00:20.522 *********
ok: [openshift-development-master-1.example.org]
PLAY [Check cert expirys] *******************************************************************************************************************************************************************************************
TASK [openshift_certificate_expiry : Ensure python dateutil library is present] *************************************************************************************************************************************
Thursday 02 July 2020  12:12:18 +0200 (0:00:00.125)       0:00:20.647 *********
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-master-1.example.org]
TASK [openshift_certificate_expiry : Check cert expirys on host] ****************************************************************************************************************************************************
Thursday 02 July 2020  12:12:19 +0200 (0:00:00.916)       0:00:21.564 *********
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-master-1.example.org]
TASK [openshift_certificate_expiry : Generate expiration report HTML] ***********************************************************************************************************************************************
Thursday 02 July 2020  12:12:20 +0200 (0:00:01.718)       0:00:23.282 *********
changed: [openshift-development-master-1.example.org]
TASK [openshift_certificate_expiry : Generate results JSON file] ****************************************************************************************************************************************************
Thursday 02 July 2020  12:12:22 +0200 (0:00:01.982)       0:00:25.265 *********
changed: [openshift-development-master-1.example.org]
TASK [openshift_certificate_expiry : Fail when certs are near or already expired] ***********************************************************************************************************************************
Thursday 02 July 2020  12:12:24 +0200 (0:00:01.185)       0:00:26.451 *********
fatal: [openshift-development-master-1.example.org]: FAILED! => {"changed": false, "msg": "Cluster certificates found to be expired or within 365 days of expiring. You may view the report at /home/milosz/cert-expiry-report.20200702T121201.html or /home/milosz/cert-expiry-report.20200702T121201.json. \n"}
fatal: [openshift-development-infra-1.example.org]: FAILED! => {"changed": false, "msg": "Cluster certificates found to be expired or within 365 days of expiring. You may view the report at /home/milosz/cert-expiry-report.20200702T121202.html or /home/milosz/cert-expiry-report.20200702T121202.json. \n"}
fatal: [openshift-development-node-1.example.org]: FAILED! => {"changed": false, "msg": "Cluster certificates found to be expired or within 365 days of expiring. You may view the report at /home/milosz/cert-expiry-report.20200702T121202.html or /home/milosz/cert-expiry-report.20200702T121202.json. \n"}
fatal: [openshift-development-node-2.example.org]: FAILED! => {"changed": false, "msg": "Cluster certificates found to be expired or within 365 days of expiring. You may view the report at /home/milosz/cert-expiry-report.20200702T121202.html or /home/milosz/cert-expiry-report.20200702T121202.json. \n"}
PLAY RECAP **********************************************************************************************************************************************************************************************************
localhost                  : ok=12   changed=0    unreachable=0    failed=0    skipped=4    rescued=0    ignored=0
openshift-development-infra-1.example.org : ok=17   changed=0    unreachable=0    failed=1    skipped=26   rescued=0    ignored=0
openshift-development-lb-1.example.org : ok=1    changed=0    unreachable=0    failed=0    skipped=5    rescued=0    ignored=0
openshift-development-master-1.example.org : ok=43   changed=2    unreachable=0    failed=1    skipped=36   rescued=0    ignored=0
openshift-development-node-1.example.org : ok=17   changed=0    unreachable=0    failed=1    skipped=26   rescued=0    ignored=0
openshift-development-node-2.example.org : ok=17   changed=0    unreachable=0    failed=1    skipped=26   rescued=0    ignored=0
INSTALLER STATUS ****************************************************************************************************************************************************************************************************
Initialization  : Complete (0:00:21)
Thursday 02 July 2020  12:12:24 +0200 (0:00:00.179)       0:00:26.631 *********
===============================================================================
Gathering Facts ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2.01s
openshift_certificate_expiry : Generate expiration report HTML ----------------------------------------------------------------------------------------------------------------------------------------------- 1.98s
Gathering Facts ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 1.83s
openshift_certificate_expiry : Check cert expirys on host ---------------------------------------------------------------------------------------------------------------------------------------------------- 1.72s
openshift_certificate_expiry : Generate results JSON file ---------------------------------------------------------------------------------------------------------------------------------------------------- 1.19s
openshift_certificate_expiry : Ensure python dateutil library is present ------------------------------------------------------------------------------------------------------------------------------------- 0.92s
Gather Cluster facts ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.81s
get openshift_current_version -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.80s
Initialize openshift.node.sdn_mtu ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.63s
Detecting Operating System from ostree_booted ---------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.51s
openshift_sanitize_inventory : Check for usage of deprecated variables --------------------------------------------------------------------------------------------------------------------------------------- 0.44s
openshift_control_plane : slurp ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 0.44s
openshift_sanitize_inventory : include_tasks ----------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.43s
set_fact ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.39s
openshift_sanitize_inventory : include_tasks ----------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.38s
set_fact openshift_portal_net if present on masters ---------------------------------------------------------------------------------------------------------------------------------------------------------- 0.31s
openshift_sanitize_inventory : Abort when openshift_release is invalid --------------------------------------------------------------------------------------------------------------------------------------- 0.28s
openshift_control_plane : stat ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.24s
Run variable sanity checks ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.24s
openshift_sanitize_inventory : Standardize on latest variable names ------------------------------------------------------------------------------------------------------------------------------------------ 0.24s

You can inspect JSON directly, but there is a better way.

$ cat /home/milosz/cert-expiry-report.20200702T121202.json
{
  "data": {
    "openshift-development-infra-1.example.org": {
      "etcd": [],
      "kubeconfigs": [
        {
          "cert_cn": "O=system:nodes:, CN=system:node:openshift-development-infra-1.example.org:",
          "days_remaining": 364,
          "expiry": "2021-07-01 16:54:00",
          "health": "warning",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/certificates/kubelet-client-current.pem",
          "serial": 1982382132740626034621136945362094506050804997,
          "serial_hex": "0x58e4a17eda5723cf4d37ca37068cd2f26b5d05L"
        },
        {
          "cert_cn": "O=system:nodes:, CN=system:node:openshift-development-infra-1.example.org:",
          "days_remaining": 364,
          "expiry": "2021-07-01 16:54:00",
          "health": "warning",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/certificates/kubelet-client-current.pem",
          "serial": 1982382132740626034621136945362094506050804997,
          "serial_hex": "0x58e4a17eda5723cf4d37ca37068cd2f26b5d05L"
        }
      ],
      "meta": {
        "checked_at_time": "2020-07-02 12:12:19.799512",
        "show_all": "True",
        "warn_before_date": "2021-07-02 12:12:19.799512",
        "warning_days": 365
      },
      "ocp_certs": [
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        },
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        }
      ],
      "registry": [],
      "router": []
    },
    "openshift-development-master-1.example.org": {
      "etcd": [
        {
          "cert_cn": "CN=etcd-signer@1593622058:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:53:49",
          "health": "ok",
          "issuer": "CN=etcd-signer@1593622058",
          "path": "/etc/etcd/ca.crt",
          "serial": 10207652613911617567,
          "serial_hex": "0x8da8ddf84aca201fL"
        },
        {
          "cert_cn": "CN=openshift-development-master-1.example.org:, IP Address:10.3.12.239, DNS:openshift-development-master-1.example.org",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:53:55",
          "health": "ok",
          "issuer": "CN=etcd-signer@1593622058",
          "path": "/etc/etcd/server.crt",
          "serial": 1,
          "serial_hex": "0x1"
        },
        {
          "cert_cn": "CN=openshift-development-master-1.example.org:, IP Address:10.3.12.239, DNS:openshift-development-master-1.example.org",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:53:55",
          "health": "ok",
          "issuer": "CN=etcd-signer@1593622058",
          "path": "/etc/etcd/peer.crt",
          "serial": 2,
          "serial_hex": "0x2"
        }
      ],
      "kubeconfigs": [
        {
          "cert_cn": "O=system:masters:, O=system:cluster-admins:, CN=system:admin:",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/node.kubeconfig",
          "serial": 6,
          "serial_hex": "0x6"
        },
        {
          "cert_cn": "O=system:masters:, O=system:cluster-admins:, CN=system:admin:",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/node.kubeconfig",
          "serial": 6,
          "serial_hex": "0x6"
        },
        {
          "cert_cn": "O=system:masters:, O=system:cluster-admins:, CN=system:admin:",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/master/admin.kubeconfig",
          "serial": 6,
          "serial_hex": "0x6"
        },
        {
          "cert_cn": "O=system:masters:, CN=system:openshift-master:",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/master/openshift-master.kubeconfig",
          "serial": 4,
          "serial_hex": "0x4"
        }
      ],
      "meta": {
        "checked_at_time": "2020-07-02 12:12:19.808487",
        "show_all": "True",
        "warn_before_date": "2021-07-02 12:12:19.808487",
        "warning_days": 365
      },
      "ocp_certs": [
        {
          "cert_cn": "CN=openshift-development.example.org:, DNS:*.openshift-development.example.org, DNS:openshift-development.example.org",
          "days_remaining": -2,
          "expiry": "2020-07-01 11:08:25",
          "health": "expired",
          "issuer": "C=US, O=Let's Encrypt, CN=Let's Encrypt Authority X3",
          "path": "/etc/origin/master/named_certificates/openshift-development.example.org.pem",
          "serial": 334961564405360459426909584619470885560261,
          "serial_hex": "0x3d85d12b5f0f1400b326fae92e2b23d1fc5L"
        },
        {
          "cert_cn": "CN=10.3.12.239:, DNS:kubernetes, DNS:kubernetes.default, DNS:kubernetes.default.svc, DNS:kubernetes.default.svc.cluster.local, DNS:openshift, DNS:openshift-development-master-1.example.org, DNS:openshift-development.example.org, DNS:openshift.default, DNS:openshift.default.svc, DNS:openshift.default.svc.cluster.local, DNS:10.3.12.239, DNS:172.30.0.1, IP Address:10.3.12.239, IP Address:172.30.0.1",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/master/master.server.crt",
          "serial": 5,
          "serial_hex": "0x5"
        },
        {
          "cert_cn": "CN=system:master-proxy:",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/master/master.proxy-client.crt",
          "serial": 3,
          "serial_hex": "0x3"
        },
        {
          "cert_cn": "O=system:node-admins:, CN=system:openshift-node-admin:",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/master/master.kubelet-client.crt",
          "serial": 2,
          "serial_hex": "0x2"
        },
        {
          "cert_cn": "CN=openshift-service-serving-signer@1593622484:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-service-serving-signer@1593622484",
          "path": "/etc/origin/master/service-signer.crt",
          "serial": 1,
          "serial_hex": "0x1"
        },
        {
          "cert_cn": "CN=openshift-development-master-1.example.org:, IP Address:10.3.12.239, DNS:openshift-development-master-1.example.org",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:02",
          "health": "ok",
          "issuer": "CN=etcd-signer@1593622058",
          "path": "/etc/origin/master/master.etcd-client.crt",
          "serial": 3,
          "serial_hex": "0x3"
        },
        {
          "cert_cn": "CN=etcd-signer@1593622058:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:53:49",
          "health": "ok",
          "issuer": "CN=etcd-signer@1593622058",
          "path": "/etc/origin/master/master.etcd-ca.crt",
          "serial": 10207652613911617567,
          "serial_hex": "0x8da8ddf84aca201fL"
        },
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/master/ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        },
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        },
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        }
      ],
      "registry": [
        {
          "cert_cn": "CN=172.30.96.194:, DNS:docker-registry-default.openshift-development.example.org, DNS:docker-registry.default.svc, DNS:docker-registry.default.svc.cluster.local, DNS:172.30.96.194, IP Address:172.30.96.194",
          "days_remaining": 729,
          "expiry": "2022-07-01 16:59:33",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/api/v1/namespaces/default/secrets/registry-certificates",
          "serial": 9,
          "serial_hex": "0x9"
        }
      ],
      "router": []
    },
    "openshift-development-node-1.example.org": {
      "etcd": [],
      "kubeconfigs": [
        {
          "cert_cn": "O=system:nodes:, CN=system:node:openshift-development-node-1.example.org:",
          "days_remaining": 364,
          "expiry": "2021-07-01 16:54:00",
          "health": "warning",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/certificates/kubelet-client-current.pem",
          "serial": 650360721510880889226432718094513488974426285521,
          "serial_hex": "0x71eb2ef154f5576da347082a506d4a6b083a25d1L"
        },
        {
          "cert_cn": "O=system:nodes:, CN=system:node:openshift-development-node-1.example.org:",
          "days_remaining": 364,
          "expiry": "2021-07-01 16:54:00",
          "health": "warning",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/certificates/kubelet-client-current.pem",
          "serial": 650360721510880889226432718094513488974426285521,
          "serial_hex": "0x71eb2ef154f5576da347082a506d4a6b083a25d1L"
        }
      ],
      "meta": {
        "checked_at_time": "2020-07-02 12:12:19.814676",
        "show_all": "True",
        "warn_before_date": "2021-07-02 12:12:19.814676",
        "warning_days": 365
      },
      "ocp_certs": [
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        },
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        }
      ],
      "registry": [],
      "router": []
    },
    "openshift-development-node-2.example.org": {
      "etcd": [],
      "kubeconfigs": [
        {
          "cert_cn": "O=system:nodes:, CN=system:node:openshift-development-node-2.example.org:",
          "days_remaining": 364,
          "expiry": "2021-07-01 16:54:00",
          "health": "warning",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/certificates/kubelet-client-current.pem",
          "serial": 365046555422862473190760761310921020549099184390,
          "serial_hex": "0x3ff140f1377e8da90ad18a68e4167215289c6106L"
        },
        {
          "cert_cn": "O=system:nodes:, CN=system:node:openshift-development-node-2.example.org:",
          "days_remaining": 364,
          "expiry": "2021-07-01 16:54:00",
          "health": "warning",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/certificates/kubelet-client-current.pem",
          "serial": 365046555422862473190760761310921020549099184390,
          "serial_hex": "0x3ff140f1377e8da90ad18a68e4167215289c6106L"
        }
      ],
      "meta": {
        "checked_at_time": "2020-07-02 12:12:19.835171",
        "show_all": "True",
        "warn_before_date": "2021-07-02 12:12:19.835171",
        "warning_days": 365
      },
      "ocp_certs": [
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        },
        {
          "cert_cn": "CN=openshift-signer@1593622483:",
          "days_remaining": 1824,
          "expiry": "2025-06-30 16:54:44",
          "health": "ok",
          "issuer": "CN=openshift-signer@1593622483",
          "path": "/etc/origin/node/client-ca.crt",
          "serial": 1,
          "serial_hex": "0x1"
        }
      ],
      "registry": [],
      "router": []
    }
  },
  "summary": {
    "expired": 1,
    "ok": 23,
    "total": 30,
    "warning": 6
  }
}

Use jq utility to get the self-explanatory summary.

$ jq .summary /home/milosz/cert-expiry-report.20200702T121202.json
{
  "expired": 1,
  "ok": 23,
  "total": 30,
  "warning": 6
}

Use jq utility to get a node list.

$ jq -r 'first(.[]) | keys[]' /home/milosz/cert-expiry-report.20200702T121202.json
openshift-development-infra-1.example.org
openshift-development-master-1.example.org
openshift-development-node-1.example.org
openshift-development-node-2.example.org

Use jq utility to pretty-print certificates information.

$ jq -r 'first(.[]) | keys[] as $server | .[$server] | keys[] as $element | .[$element] | .[] | select(type == "object") | "Server:         \($server)\nCN:             \(.cert_cn)\nPath:           \(.path)\nHealth:         \(.health)\nExpiry:         \(.expiry)\nDays remaining: \(.days_remaining)\n"' /home/milosz/cert-expiry-report.20200702T121202.json
Server:         openshift-development-infra-1.example.org
CN:             O=system:nodes:, CN=system:node:openshift-development-infra-1.example.org:
Path:           /etc/origin/node/certificates/kubelet-client-current.pem
Health:         warning
Expiry:         2021-07-01 16:54:00
Days remaining: 364
Server:         openshift-development-infra-1.example.org
CN:             O=system:nodes:, CN=system:node:openshift-development-infra-1.example.org:
Path:           /etc/origin/node/certificates/kubelet-client-current.pem
Health:         warning
Expiry:         2021-07-01 16:54:00
Days remaining: 364
Server:         openshift-development-infra-1.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-infra-1.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=etcd-signer@1593622058:
Path:           /etc/etcd/ca.crt
Health:         ok
Expiry:         2025-06-30 16:53:49
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-development-master-1.example.org:, IP Address:10.3.12.239, DNS:openshift-development-master-1.example.org
Path:           /etc/etcd/server.crt
Health:         ok
Expiry:         2025-06-30 16:53:55
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-development-master-1.example.org:, IP Address:10.3.12.239, DNS:openshift-development-master-1.example.org
Path:           /etc/etcd/peer.crt
Health:         ok
Expiry:         2025-06-30 16:53:55
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             O=system:masters:, O=system:cluster-admins:, CN=system:admin:
Path:           /etc/origin/node/node.kubeconfig
Health:         ok
Expiry:         2022-07-01 16:54:44
Days remaining: 729
Server:         openshift-development-master-1.example.org
CN:             O=system:masters:, O=system:cluster-admins:, CN=system:admin:
Path:           /etc/origin/node/node.kubeconfig
Health:         ok
Expiry:         2022-07-01 16:54:44
Days remaining: 729
Server:         openshift-development-master-1.example.org
CN:             O=system:masters:, O=system:cluster-admins:, CN=system:admin:
Path:           /etc/origin/master/admin.kubeconfig
Health:         ok
Expiry:         2022-07-01 16:54:44
Days remaining: 729
Server:         openshift-development-master-1.example.org
CN:             O=system:masters:, CN=system:openshift-master:
Path:           /etc/origin/master/openshift-master.kubeconfig
Health:         ok
Expiry:         2022-07-01 16:54:44
Days remaining: 729
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-development.example.org:, DNS:*.openshift-development.example.org, DNS:openshift-development.example.org
Path:           /etc/origin/master/named_certificates/openshift-development.example.org.pem
Health:         expired
Expiry:         2020-07-01 11:08:25
Days remaining: -2
Server:         openshift-development-master-1.example.org
CN:             CN=10.3.12.239:, DNS:kubernetes, DNS:kubernetes.default, DNS:kubernetes.default.svc, DNS:kubernetes.default.svc.cluster.local, DNS:openshift, DNS:openshift-development-master-1.example.org, DNS:openshift-development.example.org, DNS:openshift.default, DNS:openshift.default.svc, DNS:openshift.default.svc.cluster.local, DNS:10.3.12.239, DNS:172.30.0.1, IP Address:10.3.12.239, IP Address:172.30.0.1
Path:           /etc/origin/master/master.server.crt
Health:         ok
Expiry:         2022-07-01 16:54:44
Days remaining: 729
Server:         openshift-development-master-1.example.org
CN:             CN=system:master-proxy:
Path:           /etc/origin/master/master.proxy-client.crt
Health:         ok
Expiry:         2022-07-01 16:54:44
Days remaining: 729
Server:         openshift-development-master-1.example.org
CN:             O=system:node-admins:, CN=system:openshift-node-admin:
Path:           /etc/origin/master/master.kubelet-client.crt
Health:         ok
Expiry:         2022-07-01 16:54:44
Days remaining: 729
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-service-serving-signer@1593622484:
Path:           /etc/origin/master/service-signer.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-development-master-1.example.org:, IP Address:10.3.12.239, DNS:openshift-development-master-1.example.org
Path:           /etc/origin/master/master.etcd-client.crt
Health:         ok
Expiry:         2025-06-30 16:54:02
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=etcd-signer@1593622058:
Path:           /etc/origin/master/master.etcd-ca.crt
Health:         ok
Expiry:         2025-06-30 16:53:49
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/master/ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-master-1.example.org
CN:             CN=172.30.96.194:, DNS:docker-registry-default.openshift-development.example.org, DNS:docker-registry.default.svc, DNS:docker-registry.default.svc.cluster.local, DNS:172.30.96.194, IP Address:172.30.96.194
Path:           /api/v1/namespaces/default/secrets/registry-certificates
Health:         ok
Expiry:         2022-07-01 16:59:33
Days remaining: 729
Server:         openshift-development-node-1.example.org
CN:             O=system:nodes:, CN=system:node:openshift-development-node-1.example.org:
Path:           /etc/origin/node/certificates/kubelet-client-current.pem
Health:         warning
Expiry:         2021-07-01 16:54:00
Days remaining: 364
Server:         openshift-development-node-1.example.org
CN:             O=system:nodes:, CN=system:node:openshift-development-node-1.example.org:
Path:           /etc/origin/node/certificates/kubelet-client-current.pem
Health:         warning
Expiry:         2021-07-01 16:54:00
Days remaining: 364
Server:         openshift-development-node-1.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-node-1.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-node-2.example.org
CN:             O=system:nodes:, CN=system:node:openshift-development-node-2.example.org:
Path:           /etc/origin/node/certificates/kubelet-client-current.pem
Health:         warning
Expiry:         2021-07-01 16:54:00
Days remaining: 364
Server:         openshift-development-node-2.example.org
CN:             O=system:nodes:, CN=system:node:openshift-development-node-2.example.org:
Path:           /etc/origin/node/certificates/kubelet-client-current.pem
Health:         warning
Expiry:         2021-07-01 16:54:00
Days remaining: 364
Server:         openshift-development-node-2.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824
Server:         openshift-development-node-2.example.org
CN:             CN=openshift-signer@1593622483:
Path:           /etc/origin/node/client-ca.crt
Health:         ok
Expiry:         2025-06-30 16:54:44
Days remaining: 1824

Use jq utility to pretty-print expired certificates information.

$ jq -r 'first(.[]) | keys[] as $server | .[$server] | keys[] as $element | .[$element] | .[] | select(type == "object" and .days_remaining < 0) | "Server:         ($server)nCN:             (.cert_cn)nPath:           (.path)nHealth:         (.health)nExpiry:         (.expiry)nDays remaining: (.days_remaining)n"'  /home/milosz/cert-expiry-report.20200702T121202.json
Server:         openshift-development-master-1.example.org
CN:             CN=openshift-development.example.org:, DNS:*.openshift-development.example.org, DNS:openshift-development.example.org"
Health:         expired
Expiry:         2020-07-01 11:08:25
Days remaining: -2

Redeploy certificate

Update certificates mentioned in preliminary notes.

Redeploy master certificate.

$ ansible-playbook -i hosts ./playbooks/openshift-master/redeploy-certificates.yml
PLAY [Initialization Checkpoint Start] ******************************************************************************************************************************************************************************
TASK [Set install initialization 'In Progress'] *********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:29 +0200 (0:00:00.034)       0:00:00.034 ***********
ok: [openshift-development-master-1.example.org]
PLAY [Populate config host groups] **********************************************************************************************************************************************************************************
TASK [Load group name mapping variables] ****************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:29 +0200 (0:00:00.110)       0:00:00.144 ***********
ok: [localhost]
TASK [Evaluate groups - g_nfs_hosts is single host] *****************************************************************************************************************************************************************
Friday 03 July 2020  12:07:29 +0200 (0:00:00.020)       0:00:00.165 ***********
skipping: [localhost]
TASK [Evaluate oo_all_hosts] ****************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:29 +0200 (0:00:00.064)       0:00:00.230 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
ok: [localhost] => (item=openshift-development-infra-1.example.org)
ok: [localhost] => (item=openshift-development-node-1.example.org)
ok: [localhost] => (item=openshift-development-node-2.example.org)
ok: [localhost] => (item=openshift-development-lb-1.example.org)
TASK [Evaluate oo_masters] ******************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:29 +0200 (0:00:00.141)       0:00:00.371 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_first_master] *************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.102)       0:00:00.474 ***********
ok: [localhost]
TASK [Evaluate oo_new_etcd_to_config] *******************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.081)       0:00:00.555 ***********
TASK [Evaluate oo_masters_to_config] ********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.071)       0:00:00.626 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_etcd_to_config] ***********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.099)       0:00:00.726 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_first_etcd] ***************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.090)       0:00:00.816 ***********
ok: [localhost]
TASK [Evaluate oo_etcd_hosts_to_upgrade] ****************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.082)       0:00:00.899 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_etcd_hosts_to_backup] *****************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.080)       0:00:00.979 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
TASK [Evaluate oo_nodes_to_config] **********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.085)       0:00:01.064 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
ok: [localhost] => (item=openshift-development-infra-1.example.org)
ok: [localhost] => (item=openshift-development-node-1.example.org)
ok: [localhost] => (item=openshift-development-node-2.example.org)
TASK [Evaluate oo_lb_to_config] *************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.112)       0:00:01.176 ***********
ok: [localhost] => (item=openshift-development-lb-1.example.org)
TASK [Evaluate oo_nfs_to_config] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.084)       0:00:01.260 ***********
TASK [Evaluate oo_glusterfs_to_config] ******************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.062)       0:00:01.323 ***********
TASK [Evaluate oo_etcd_to_migrate] **********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:30 +0200 (0:00:00.070)       0:00:01.394 ***********
ok: [localhost] => (item=openshift-development-master-1.example.org)
[WARNING]: Could not match supplied host pattern, ignoring: oo_nfs_to_config
PLAY [Ensure that all non-node hosts are accessible] ****************************************************************************************************************************************************************
TASK [Gathering Facts] **********************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:31 +0200 (0:00:00.096)       0:00:01.490 ***********
ok: [openshift-development-lb-1.example.org]
ok: [openshift-development-master-1.example.org]
PLAY [Initialize basic host facts] **********************************************************************************************************************************************************************************
TASK [Gathering Facts] **********************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:32 +0200 (0:00:01.772)       0:00:03.263 ***********
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-infra-1.example.org]
TASK [openshift_sanitize_inventory : include_tasks] *****************************************************************************************************************************************************************
Friday 03 July 2020  12:07:34 +0200 (0:00:02.020)       0:00:05.283 ***********
included: /root/openshift-ansible/roles/openshift_sanitize_inventory/tasks/deprecations.yml for openshift-development-master-1.example.org, openshift-development-infra-1.example.org, openshift-development-node-1.example.org, openshift-development-node-2.example.org, openshift-development-lb-1.example.org
TASK [openshift_sanitize_inventory : Check for usage of deprecated variables] ***************************************************************************************************************************************
Friday 03 July 2020  12:07:35 +0200 (0:00:00.409)       0:00:05.693 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-lb-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-2.example.org]
TASK [openshift_sanitize_inventory : debug] *************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:35 +0200 (0:00:00.483)       0:00:06.176 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : set_stats] *********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:35 +0200 (0:00:00.211)       0:00:06.387 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : set_fact] **********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:36 +0200 (0:00:00.234)       0:00:06.621 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Standardize on latest variable names] ******************************************************************************************************************************************
Friday 03 July 2020  12:07:36 +0200 (0:00:00.336)       0:00:06.958 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Normalize openshift_release] ***************************************************************************************************************************************************
Friday 03 July 2020  12:07:36 +0200 (0:00:00.268)       0:00:07.227 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Abort when openshift_release is invalid] ***************************************************************************************************************************************
Friday 03 July 2020  12:07:37 +0200 (0:00:00.264)       0:00:07.491 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : include_tasks] *****************************************************************************************************************************************************************
Friday 03 July 2020  12:07:37 +0200 (0:00:00.221)       0:00:07.713 ***********
included: /root/openshift-ansible/roles/openshift_sanitize_inventory/tasks/unsupported.yml for openshift-development-master-1.example.org, openshift-development-infra-1.example.org, openshift-development-node-1.example.org, openshift-development-node-2.example.org, openshift-development-lb-1.example.org
TASK [openshift_sanitize_inventory : set_fact] **********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:37 +0200 (0:00:00.434)       0:00:08.147 ***********
TASK [openshift_sanitize_inventory : Ensure that dynamic provisioning is set if using dynamic storage] **************************************************************************************************************
Friday 03 July 2020  12:07:37 +0200 (0:00:00.242)       0:00:08.389 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure the hosted registry's GlusterFS storage is configured correctly] ********************************************************************************************************
Friday 03 July 2020  12:07:38 +0200 (0:00:00.245)       0:00:08.634 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure the hosted registry's GlusterFS storage is configured correctly] ********************************************************************************************************
Friday 03 July 2020  12:07:38 +0200 (0:00:00.208)       0:00:08.843 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Check for deprecated prometheus/grafana install] *******************************************************************************************************************************
Friday 03 July 2020  12:07:38 +0200 (0:00:00.222)       0:00:09.065 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure clusterid is set along with the cloudprovider] **************************************************************************************************************************
Friday 03 July 2020  12:07:38 +0200 (0:00:00.227)       0:00:09.293 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure ansible_service_broker_remove and ansible_service_broker_install are mutually exclusive] ********************************************************************************
Friday 03 July 2020  12:07:39 +0200 (0:00:00.235)       0:00:09.529 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure template_service_broker_remove and template_service_broker_install are mutually exclusive] ******************************************************************************
Friday 03 July 2020  12:07:39 +0200 (0:00:00.215)       0:00:09.745 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure that all requires vsphere configuration variables are set] **************************************************************************************************************
Friday 03 July 2020  12:07:39 +0200 (0:00:00.223)       0:00:09.968 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : ensure provider configuration variables are defined] ***************************************************************************************************************************
Friday 03 July 2020  12:07:39 +0200 (0:00:00.212)       0:00:10.180 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure removed web console extension variables are not set] ********************************************************************************************************************
Friday 03 July 2020  12:07:39 +0200 (0:00:00.217)       0:00:10.397 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure that web console port matches API server port] **************************************************************************************************************************
Friday 03 July 2020  12:07:40 +0200 (0:00:00.236)       0:00:10.634 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : At least one master is schedulable] ********************************************************************************************************************************************
Friday 03 July 2020  12:07:40 +0200 (0:00:00.267)       0:00:10.901 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [openshift_sanitize_inventory : Ensure openshift_master_cluster_hostname is set when deploying multiple masters] ***********************************************************************************************
Friday 03 July 2020  12:07:40 +0200 (0:00:00.279)       0:00:11.181 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Detecting Operating System from ostree_booted] ****************************************************************************************************************************************************************
Friday 03 July 2020  12:07:40 +0200 (0:00:00.227)       0:00:11.408 ***********
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-lb-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-infra-1.example.org]
TASK [set openshift_deployment_type if unset] ***********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:41 +0200 (0:00:00.478)       0:00:11.887 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [initialize_facts set fact openshift_is_atomic] ****************************************************************************************************************************************************************
Friday 03 July 2020  12:07:41 +0200 (0:00:00.263)       0:00:12.151 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-lb-1.example.org]
TASK [Determine Atomic Host Docker Version] *************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:41 +0200 (0:00:00.215)       0:00:12.367 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [assert atomic host docker version is 1.12 or later] ***********************************************************************************************************************************************************
Friday 03 July 2020  12:07:42 +0200 (0:00:00.235)       0:00:12.602 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
PLAY [Retrieve existing master configs and validate] ****************************************************************************************************************************************************************
TASK [openshift_control_plane : stat] *******************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:42 +0200 (0:00:00.221)       0:00:12.824 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : slurp] ******************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:42 +0200 (0:00:00.222)       0:00:13.046 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : set_fact] ***************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.422)       0:00:13.469 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : Check for file paths outside of /etc/origin/master in master's config] **************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.159)       0:00:13.628 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : set_fact] ***************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.086)       0:00:13.715 ***********
ok: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.092)       0:00:13.808 ***********
ok: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.074)       0:00:13.882 ***********
ok: [openshift-development-master-1.example.org]
PLAY [Initialize special first-master variables] ********************************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.095)       0:00:13.978 ***********
skipping: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.058)       0:00:14.037 ***********
ok: [openshift-development-master-1.example.org]
PLAY [Disable web console if required] ******************************************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.081)       0:00:14.118 ***********
skipping: [openshift-development-master-1.example.org]
PLAY [Setup yum repositories for all hosts] *************************************************************************************************************************************************************************
skipping: no hosts matched
PLAY [Install packages necessary for installer] *********************************************************************************************************************************************************************
TASK [Determine if chrony is installed] *****************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:43 +0200 (0:00:00.084)       0:00:14.203 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Install ntp package] ******************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:44 +0200 (0:00:00.243)       0:00:14.446 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Start and enable ntpd/chronyd] ********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:44 +0200 (0:00:00.216)       0:00:14.663 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Ensure minimum kernel version] ********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:44 +0200 (0:00:00.241)       0:00:14.905 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Ensure openshift-ansible installer package deps are installed] ************************************************************************************************************************************************
Friday 03 July 2020  12:07:44 +0200 (0:00:00.246)       0:00:15.151 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
PLAY [Initialize cluster facts] *************************************************************************************************************************************************************************************
TASK [get openshift_current_version] ********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:44 +0200 (0:00:00.238)       0:00:15.390 ***********
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-lb-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-master-1.example.org]
TASK [set_fact openshift_portal_net if present on masters] **********************************************************************************************************************************************************
Friday 03 July 2020  12:07:45 +0200 (0:00:00.805)       0:00:16.195 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-lb-1.example.org]
TASK [Gather Cluster facts] *****************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:46 +0200 (0:00:00.332)       0:00:16.527 ***********
changed: [openshift-development-node-2.example.org]
changed: [openshift-development-node-1.example.org]
changed: [openshift-development-master-1.example.org]
changed: [openshift-development-infra-1.example.org]
changed: [openshift-development-lb-1.example.org]
TASK [Set fact of no_proxy_internal_hostnames] **********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:46 +0200 (0:00:00.850)       0:00:17.378 ***********
skipping: [openshift-development-master-1.example.org]
skipping: [openshift-development-infra-1.example.org]
skipping: [openshift-development-node-1.example.org]
skipping: [openshift-development-node-2.example.org]
skipping: [openshift-development-lb-1.example.org]
TASK [Initialize openshift.node.sdn_mtu] ****************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:47 +0200 (0:00:00.226)       0:00:17.604 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-lb-1.example.org]
TASK [set_fact l_kubelet_node_name] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:47 +0200 (0:00:00.602)       0:00:18.207 ***********
ok: [openshift-development-master-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-node-2.example.org]
ok: [openshift-development-lb-1.example.org]
PLAY [Initialize etcd host variables] *******************************************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.236)       0:00:18.443 ***********
ok: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.156)       0:00:18.600 ***********
ok: [openshift-development-master-1.example.org]
PLAY [Determine openshift_version to configure on first master] *****************************************************************************************************************************************************
TASK [include_role : openshift_version] *****************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.093)       0:00:18.694 ***********
TASK [openshift_version : Use openshift_current_version fact as version to configure if already installed] **********************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.191)       0:00:18.885 ***********
ok: [openshift-development-master-1.example.org]
TASK [Set openshift_version to openshift_release if undefined] ******************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.083)       0:00:18.969 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.067)       0:00:19.037 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_version : set_fact] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.067)       0:00:19.104 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.061)       0:00:19.166 ***********
ok: [openshift-development-master-1.example.org] => {
    "msg": "openshift_image_tag was not defined. Falling back to v3.11.0"
}
TASK [openshift_version : set_fact] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.068)       0:00:19.234 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_version : assert openshift_release in openshift_image_tag] ******************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.073)       0:00:19.308 ***********
ok: [openshift-development-master-1.example.org] => {
    "changed": false,
    "msg": "All assertions passed"
}
TASK [openshift_version : assert openshift_release in openshift_pkg_version] ****************************************************************************************************************************************
Friday 03 July 2020  12:07:48 +0200 (0:00:00.095)       0:00:19.403 ***********
ok: [openshift-development-master-1.example.org] => {
    "changed": false,
    "msg": "All assertions passed"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:49 +0200 (0:00:00.073)       0:00:19.477 ***********
ok: [openshift-development-master-1.example.org] => {
    "openshift_release": "3.11"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:49 +0200 (0:00:00.092)       0:00:19.569 ***********
ok: [openshift-development-master-1.example.org] => {
    "openshift_image_tag": "v3.11.0"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:49 +0200 (0:00:00.075)       0:00:19.645 ***********
ok: [openshift-development-master-1.example.org] => {
    "openshift_pkg_version": "-3.11.0"
}
TASK [openshift_version : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:49 +0200 (0:00:00.076)       0:00:19.722 ***********
ok: [openshift-development-master-1.example.org] => {
    "openshift_version": "3.11.0"
}
PLAY [Set openshift_version for etcd, node, and master hosts] *******************************************************************************************************************************************************
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:49 +0200 (0:00:00.109)       0:00:19.832 ***********
ok: [openshift-development-node-1.example.org]
ok: [openshift-development-infra-1.example.org]
ok: [openshift-development-node-2.example.org]
PLAY [Verify Requirements] ******************************************************************************************************************************************************************************************
TASK [Run variable sanity checks] ***********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:49 +0200 (0:00:00.319)       0:00:20.151 ***********
ok: [openshift-development-master-1.example.org]
TASK [Validate openshift_node_groups and openshift_node_group_name] *************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.294)       0:00:20.445 ***********
ok: [openshift-development-master-1.example.org]
TASK [Validate openshift_master_ca_certificate when defined] ********************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.216)       0:00:20.662 ***********
skipping: [openshift-development-master-1.example.org]
TASK [Fetch ca.crt from cluster if exists] **************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.076)       0:00:20.738 ***********
ok: [openshift-development-master-1.example.org]
TASK [Validate ca.crt from cluster if exists] ***********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.232)       0:00:20.971 ***********
skipping: [openshift-development-master-1.example.org]
PLAY [Verify Node Prerequisites] ************************************************************************************************************************************************************************************
skipping: no hosts matched
PLAY [Validate Aci deployment variables] ****************************************************************************************************************************************************************************
TASK [Verify Aci deployment file variable is defined] ***************************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.086)       0:00:21.057 ***********
skipping: [openshift-development-master-1.example.org]
TASK [Verify Aci deployment file exists] ****************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.064)       0:00:21.121 ***********
skipping: [openshift-development-master-1.example.org]
TASK [Fail if file does not exist] **********************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.066)       0:00:21.188 ***********
skipping: [openshift-development-master-1.example.org]
PLAY [Initialization Checkpoint End] ********************************************************************************************************************************************************************************
TASK [Set install initialization 'Complete'] ************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.070)       0:00:21.258 ***********
ok: [openshift-development-master-1.example.org]
PLAY [Backup and remove master cerftificates] ***********************************************************************************************************************************************************************
TASK [Check for generated-configs directory] ************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:50 +0200 (0:00:00.135)       0:00:21.394 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [Backup generated-configs directory] ***************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:51 +0200 (0:00:00.335)       0:00:21.729 ***********
skipping: [openshift-development-master-1.example.org]
TASK [Remove generated-configs directory] ***************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:51 +0200 (0:00:00.143)       0:00:21.873 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=/etc/origin/generated-configs)
TASK [Backup master certificates and config] ************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:51 +0200 (0:00:00.432)       0:00:22.305 ***********
[WARNING]: Consider using the unarchive module rather than running 'tar'.  If you need to use command because unarchive is insufficient you can add 'warn: false' to this command task or set
'command_warnings=False' in ansible.cfg to get rid of this message.
changed: [openshift-development-master-1.example.org]
TASK [Remove master certificates and config] ************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:52 +0200 (0:00:00.582)       0:00:22.888 ***********
changed: [openshift-development-master-1.example.org] => (item=admin.crt)
changed: [openshift-development-master-1.example.org] => (item=admin.key)
changed: [openshift-development-master-1.example.org] => (item=admin.kubeconfig)
changed: [openshift-development-master-1.example.org] => (item=aggregator-front-proxy.crt)
changed: [openshift-development-master-1.example.org] => (item=aggregator-front-proxy.key)
changed: [openshift-development-master-1.example.org] => (item=aggregator-front-proxy.kubeconfig)
changed: [openshift-development-master-1.example.org] => (item=front-proxy-ca.crt)
changed: [openshift-development-master-1.example.org] => (item=front-proxy-ca.key)
changed: [openshift-development-master-1.example.org] => (item=master.kubelet-client.crt)
changed: [openshift-development-master-1.example.org] => (item=master.kubelet-client.key)
changed: [openshift-development-master-1.example.org] => (item=master.proxy-client.crt)
changed: [openshift-development-master-1.example.org] => (item=master.proxy-client.key)
changed: [openshift-development-master-1.example.org] => (item=etcd.server.crt)
changed: [openshift-development-master-1.example.org] => (item=etcd.server.key)
changed: [openshift-development-master-1.example.org] => (item=master.server.crt)
changed: [openshift-development-master-1.example.org] => (item=master.server.key)
changed: [openshift-development-master-1.example.org] => (item=openshift-master.crt)
changed: [openshift-development-master-1.example.org] => (item=openshift-master.key)
changed: [openshift-development-master-1.example.org] => (item=openshift-master.kubeconfig)
TASK [Remove service signer certificates] ***************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:55 +0200 (0:00:03.116)       0:00:26.005 ***********
skipping: [openshift-development-master-1.example.org] => (item=service-signer.crt)
skipping: [openshift-development-master-1.example.org] => (item=service-signer.key)
PLAY [Create OpenShift certificates for master hosts] ***************************************************************************************************************************************************************
TASK [openshift_master_facts : Set master facts] ********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:55 +0200 (0:00:00.113)       0:00:26.119 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_facts : Determine if scheduler config present] ***********************************************************************************************************************************************
Friday 03 July 2020  12:07:56 +0200 (0:00:00.433)       0:00:26.552 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_facts : Set Default scheduler predicates and priorities] *************************************************************************************************************************************
Friday 03 July 2020  12:07:56 +0200 (0:00:00.268)       0:00:26.821 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_facts : Retrieve current scheduler config] ***************************************************************************************************************************************************
Friday 03 July 2020  12:07:56 +0200 (0:00:00.082)       0:00:26.904 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_facts : Set openshift_master_scheduler_current_config] ***************************************************************************************************************************************
Friday 03 July 2020  12:07:56 +0200 (0:00:00.222)       0:00:27.126 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_facts : Test if scheduler config is readable] ************************************************************************************************************************************************
Friday 03 July 2020  12:07:56 +0200 (0:00:00.075)       0:00:27.202 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_master_facts : Set current scheduler predicates and priorities] *************************************************************************************************************************************
Friday 03 July 2020  12:07:56 +0200 (0:00:00.066)       0:00:27.268 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_named_certificates : set_fact] **********************************************************************************************************************************************************************
Friday 03 July 2020  12:07:56 +0200 (0:00:00.095)       0:00:27.364 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_named_certificates : openshift_facts] ***************************************************************************************************************************************************************
Friday 03 July 2020  12:07:57 +0200 (0:00:00.082)       0:00:27.446 ***********
changed: [openshift-development-master-1.example.org]
TASK [openshift_named_certificates : Clear named certificates] ******************************************************************************************************************************************************
Friday 03 July 2020  12:07:57 +0200 (0:00:00.358)       0:00:27.805 ***********
changed: [openshift-development-master-1.example.org]
TASK [openshift_named_certificates : Ensure named certificate directory exists] *************************************************************************************************************************************
Friday 03 July 2020  12:07:57 +0200 (0:00:00.214)       0:00:28.019 ***********
changed: [openshift-development-master-1.example.org]
TASK [openshift_named_certificates : Land named certificates] *******************************************************************************************************************************************************
Friday 03 July 2020  12:07:57 +0200 (0:00:00.246)       0:00:28.266 ***********
changed: [openshift-development-master-1.example.org] => (item={u'keyfile': u'/etc/ssl/certs/openshift/openshift-development.example.org.key', u'certfile': u'/etc/ssl/certs/openshift/openshift-development.example.org.pem'})
TASK [openshift_named_certificates : Land named certificate keys] ***************************************************************************************************************************************************
Friday 03 July 2020  12:07:58 +0200 (0:00:00.901)       0:00:29.167 ***********
changed: [openshift-development-master-1.example.org] => (item={u'keyfile': u'/etc/ssl/certs/openshift/openshift-development.example.org.key', u'certfile': u'/etc/ssl/certs/openshift/openshift-development.example.org.pem'})
TASK [openshift_named_certificates : Land named CA certificates] ****************************************************************************************************************************************************
Friday 03 July 2020  12:07:59 +0200 (0:00:00.567)       0:00:29.735 ***********
TASK [openshift_ca : fail] ******************************************************************************************************************************************************************************************
Friday 03 July 2020  12:07:59 +0200 (0:00:00.077)       0:00:29.812 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_ca : Install the base package for admin tooling] ****************************************************************************************************************************************************
Friday 03 July 2020  12:07:59 +0200 (0:00:00.146)       0:00:29.959 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Reload generated facts] ************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:00 +0200 (0:00:01.093)       0:00:31.053 ***********
skipping: [openshift-development-master-1.example.org]
TASK [Create openshift_ca_config_dir if it does not exist] **********************************************************************************************************************************************************
Friday 03 July 2020  12:08:00 +0200 (0:00:00.158)       0:00:31.211 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Determine if CA must be created] ***************************************************************************************************************************************************************
Friday 03 July 2020  12:08:01 +0200 (0:00:00.304)       0:00:31.516 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=ca-bundle.crt)
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=ca.crt)
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=ca.key)
TASK [openshift_ca : Determine if front-proxy CA must be created] ***************************************************************************************************************************************************
Friday 03 July 2020  12:08:01 +0200 (0:00:00.635)       0:00:32.152 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=front-proxy-ca.crt)
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=front-proxy-ca.key)
TASK [openshift_ca : set_fact] **************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:02 +0200 (0:00:00.400)       0:00:32.552 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_ca : Retain original serviceaccount keys] ***********************************************************************************************************************************************************
Friday 03 July 2020  12:08:02 +0200 (0:00:00.070)       0:00:32.623 ***********
changed: [openshift-development-master-1.example.org] => (item=/etc/origin/master/serviceaccounts.private.key)
changed: [openshift-development-master-1.example.org] => (item=/etc/origin/master/serviceaccounts.public.key)
TASK [openshift_ca : Deploy master ca certificate] ******************************************************************************************************************************************************************
Friday 03 July 2020  12:08:02 +0200 (0:00:00.724)       0:00:33.348 ***********
skipping: [openshift-development-master-1.example.org] => (item={u'dest': u'ca.crt', u'src': u''})
skipping: [openshift-development-master-1.example.org] => (item={u'dest': u'ca.key', u'src': u''})
TASK [openshift_ca : Deploy additional ca] **************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:03 +0200 (0:00:00.098)       0:00:33.446 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_ca : Create ca serial] ******************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:03 +0200 (0:00:00.125)       0:00:33.572 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_ca : find] ******************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:03 +0200 (0:00:00.066)       0:00:33.638 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_ca : Set fact master_legacy_ca_files] ***************************************************************************************************************************************************************
Friday 03 July 2020  12:08:03 +0200 (0:00:00.475)       0:00:34.114 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_ca : Create the front-proxy CA if it does not already exist] ****************************************************************************************************************************************
Friday 03 July 2020  12:08:03 +0200 (0:00:00.115)       0:00:34.230 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Create the master certificates if they do not already exist] ***********************************************************************************************************************************
Friday 03 July 2020  12:08:04 +0200 (0:00:01.080)       0:00:35.310 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : command] ***************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:06 +0200 (0:00:01.337)       0:00:36.648 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : copy] ******************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:06 +0200 (0:00:00.253)       0:00:36.902 ***********
TASK [openshift_ca : copy] ******************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:06 +0200 (0:00:00.103)       0:00:37.005 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : assemble] **************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:07 +0200 (0:00:00.425)       0:00:37.430 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Test local loopback context] *******************************************************************************************************************************************************************
Friday 03 July 2020  12:08:07 +0200 (0:00:00.707)       0:00:38.138 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Create temp directory for loopback master client config] ***************************************************************************************************************************************
Friday 03 July 2020  12:08:08 +0200 (0:00:00.530)       0:00:38.669 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_ca : Generate the loopback master client config] ****************************************************************************************************************************************************
Friday 03 July 2020  12:08:08 +0200 (0:00:00.160)       0:00:38.829 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_ca : Copy generated loopback master client config to master config dir] *****************************************************************************************************************************
Friday 03 July 2020  12:08:08 +0200 (0:00:00.126)       0:00:38.955 ***********
skipping: [openshift-development-master-1.example.org] => (item=openshift-master.crt)
skipping: [openshift-development-master-1.example.org] => (item=openshift-master.key)
skipping: [openshift-development-master-1.example.org] => (item=openshift-master.kubeconfig)
TASK [openshift_ca : Delete temp directory] *************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:08 +0200 (0:00:00.139)       0:00:39.095 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_ca : Create temp directory for loopback master client config] ***************************************************************************************************************************************
Friday 03 July 2020  12:08:08 +0200 (0:00:00.116)       0:00:39.211 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Generate the aggregator api-client config] *****************************************************************************************************************************************************
Friday 03 July 2020  12:08:09 +0200 (0:00:00.297)       0:00:39.509 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Copy generated loopback master client config to master config dir] *****************************************************************************************************************************
Friday 03 July 2020  12:08:09 +0200 (0:00:00.768)       0:00:40.277 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=aggregator-front-proxy.crt)
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=aggregator-front-proxy.key)
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=aggregator-front-proxy.kubeconfig)
TASK [openshift_ca : Delete temp directory] *************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:10 +0200 (0:00:00.967)       0:00:41.245 ***********
changed: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_ca : Restore original serviceaccount keys] **********************************************************************************************************************************************************
Friday 03 July 2020  12:08:11 +0200 (0:00:00.249)       0:00:41.494 ***********
ok: [openshift-development-master-1.example.org] => (item=/etc/origin/master/serviceaccounts.private.key)
ok: [openshift-development-master-1.example.org] => (item=/etc/origin/master/serviceaccounts.public.key)
TASK [openshift_ca : Remove backup serviceaccount keys] *************************************************************************************************************************************************************
Friday 03 July 2020  12:08:11 +0200 (0:00:00.666)       0:00:42.161 ***********
changed: [openshift-development-master-1.example.org] => (item=/etc/origin/master/serviceaccounts.private.key)
changed: [openshift-development-master-1.example.org] => (item=/etc/origin/master/serviceaccounts.public.key)
TASK [openshift_master_certificates : Check status of master certificates] ******************************************************************************************************************************************
Friday 03 July 2020  12:08:12 +0200 (0:00:00.396)       0:00:42.557 ***********
skipping: [openshift-development-master-1.example.org] => (item=admin.crt)
skipping: [openshift-development-master-1.example.org] => (item=ca.crt)
skipping: [openshift-development-master-1.example.org] => (item=ca-bundle.crt)
skipping: [openshift-development-master-1.example.org] => (item=front-proxy-ca.crt)
skipping: [openshift-development-master-1.example.org] => (item=master.kubelet-client.crt)
skipping: [openshift-development-master-1.example.org] => (item=master.proxy-client.crt)
skipping: [openshift-development-master-1.example.org] => (item=master.server.crt)
skipping: [openshift-development-master-1.example.org] => (item=openshift-master.crt)
skipping: [openshift-development-master-1.example.org] => (item=service-signer.crt)
skipping: [openshift-development-master-1.example.org] => (item=aggregator-front-proxy.crt)
TASK [openshift_master_certificates : set_fact] *********************************************************************************************************************************************************************
Friday 03 July 2020  12:08:12 +0200 (0:00:00.140)       0:00:42.698 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Ensure the generated_configs directory present] *******************************************************************************************************************************
Friday 03 July 2020  12:08:12 +0200 (0:00:00.135)       0:00:42.833 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : find] *************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:12 +0200 (0:00:00.157)       0:00:42.991 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Set fact master_legacy_ca_files] **********************************************************************************************************************************************
Friday 03 July 2020  12:08:12 +0200 (0:00:00.217)       0:00:43.208 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Create the master server certificate] *****************************************************************************************************************************************
Friday 03 July 2020  12:08:12 +0200 (0:00:00.208)       0:00:43.417 ***********
skipping: [openshift-development-master-1.example.org] => (item=openshift-development-master-1.example.org)
TASK [openshift_master_certificates : Generate the loopback master client config] ***********************************************************************************************************************************
Friday 03 July 2020  12:08:13 +0200 (0:00:00.130)       0:00:43.548 ***********
skipping: [openshift-development-master-1.example.org] => (item=openshift-development-master-1.example.org)
TASK [openshift_master_certificates : copy] *************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:13 +0200 (0:00:00.159)       0:00:43.707 ***********
skipping: [openshift-development-master-1.example.org] => (item=admin.crt)
skipping: [openshift-development-master-1.example.org] => (item=admin.key)
skipping: [openshift-development-master-1.example.org] => (item=admin.kubeconfig)
skipping: [openshift-development-master-1.example.org] => (item=aggregator-front-proxy.crt)
skipping: [openshift-development-master-1.example.org] => (item=aggregator-front-proxy.key)
skipping: [openshift-development-master-1.example.org] => (item=aggregator-front-proxy.kubeconfig)
skipping: [openshift-development-master-1.example.org] => (item=front-proxy-ca.crt)
skipping: [openshift-development-master-1.example.org] => (item=front-proxy-ca.key)
skipping: [openshift-development-master-1.example.org] => (item=master.kubelet-client.crt)
skipping: [openshift-development-master-1.example.org] => (item=master.kubelet-client.key)
skipping: [openshift-development-master-1.example.org] => (item=master.proxy-client.crt)
skipping: [openshift-development-master-1.example.org] => (item=master.proxy-client.key)
skipping: [openshift-development-master-1.example.org] => (item=service-signer.crt)
skipping: [openshift-development-master-1.example.org] => (item=service-signer.key)
skipping: [openshift-development-master-1.example.org] => (item=ca-bundle.crt)
skipping: [openshift-development-master-1.example.org] => (item=ca.crt)
skipping: [openshift-development-master-1.example.org] => (item=ca.key)
skipping: [openshift-development-master-1.example.org] => (item=client-ca-bundle.crt)
skipping: [openshift-development-master-1.example.org] => (item=serviceaccounts.private.key)
skipping: [openshift-development-master-1.example.org] => (item=serviceaccounts.public.key)
TASK [openshift_master_certificates : Remove generated etcd client certs when using external etcd] ******************************************************************************************************************
Friday 03 July 2020  12:08:13 +0200 (0:00:00.363)       0:00:44.070 ***********
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=master.etcd-client.crt)
ok: [openshift-development-master-1.example.org -> openshift-development-master-1.example.org] => (item=master.etcd-client.key)
TASK [openshift_master_certificates : Create local temp directory for syncing certs] ********************************************************************************************************************************
Friday 03 July 2020  12:08:14 +0200 (0:00:00.441)       0:00:44.512 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Chmod local temp directory for syncing certs] *********************************************************************************************************************************
Friday 03 July 2020  12:08:14 +0200 (0:00:00.253)       0:00:44.766 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Create a tarball of the master certs] *****************************************************************************************************************************************
Friday 03 July 2020  12:08:14 +0200 (0:00:00.325)       0:00:45.092 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Retrieve the master cert tarball from the master] *****************************************************************************************************************************
Friday 03 July 2020  12:08:14 +0200 (0:00:00.111)       0:00:45.204 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Ensure certificate directory exists] ******************************************************************************************************************************************
Friday 03 July 2020  12:08:14 +0200 (0:00:00.104)       0:00:45.309 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Unarchive the tarball on the master] ******************************************************************************************************************************************
Friday 03 July 2020  12:08:14 +0200 (0:00:00.073)       0:00:45.383 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Delete local temp directory] **************************************************************************************************************************************************
Friday 03 July 2020  12:08:15 +0200 (0:00:00.068)       0:00:45.451 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Lookup default group for ansible_ssh_user] ************************************************************************************************************************************
Friday 03 July 2020  12:08:15 +0200 (0:00:00.226)       0:00:45.678 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : set_fact] *********************************************************************************************************************************************************************
Friday 03 July 2020  12:08:15 +0200 (0:00:00.245)       0:00:45.924 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Create the client config dir(s)] **********************************************************************************************************************************************
Friday 03 July 2020  12:08:15 +0200 (0:00:00.069)       0:00:45.993 ***********
ok: [openshift-development-master-1.example.org] => (item=root)
TASK [openshift_master_certificates : Copy the admin client config(s)] **********************************************************************************************************************************************
Friday 03 July 2020  12:08:15 +0200 (0:00:00.242)       0:00:46.235 ***********
changed: [openshift-development-master-1.example.org] => (item=root)
TASK [openshift_master_certificates : Update the permissions on the admin client config(s)] *************************************************************************************************************************
Friday 03 July 2020  12:08:16 +0200 (0:00:00.344)       0:00:46.580 ***********
ok: [openshift-development-master-1.example.org] => (item=root)
TASK [openshift_master_certificates : Check for ca-bundle.crt] ******************************************************************************************************************************************************
Friday 03 July 2020  12:08:16 +0200 (0:00:00.241)       0:00:46.822 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Check for ca.crt] *************************************************************************************************************************************************************
Friday 03 July 2020  12:08:16 +0200 (0:00:00.278)       0:00:47.100 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Migrate ca.crt to ca-bundle.crt] **********************************************************************************************************************************************
Friday 03 July 2020  12:08:16 +0200 (0:00:00.224)       0:00:47.324 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_master_certificates : Link ca.crt to ca-bundle.crt] *************************************************************************************************************************************************
Friday 03 July 2020  12:08:16 +0200 (0:00:00.078)       0:00:47.403 ***********
skipping: [openshift-development-master-1.example.org]
PLAY [Validate configuration for rolling restart] *******************************************************************************************************************************************************************
TASK [fail] *********************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:17 +0200 (0:00:00.080)       0:00:47.484 ***********
skipping: [openshift-development-master-1.example.org]
PLAY [Create temp file on localhost] ********************************************************************************************************************************************************************************
TASK [command] ******************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:17 +0200 (0:00:00.037)       0:00:47.522 ***********
ok: [localhost]
PLAY [Check if temp file exists on any masters] *********************************************************************************************************************************************************************
TASK [stat] *********************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:17 +0200 (0:00:00.239)       0:00:47.762 ***********
ok: [openshift-development-master-1.example.org]
PLAY [Cleanup temp file on localhost] *******************************************************************************************************************************************************************************
TASK [file] *********************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:17 +0200 (0:00:00.188)       0:00:47.950 ***********
ok: [localhost]
PLAY [Warn if restarting the system where ansible is running] *******************************************************************************************************************************************************
TASK [pause] ********************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:17 +0200 (0:00:00.289)       0:00:48.239 ***********
skipping: [openshift-development-master-1.example.org]
TASK [set_fact] *****************************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:17 +0200 (0:00:00.075)       0:00:48.315 ***********
skipping: [openshift-development-master-1.example.org]
PLAY [Restart masters] **********************************************************************************************************************************************************************************************
TASK [Restart master system] ****************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:17 +0200 (0:00:00.078)       0:00:48.394 ***********
skipping: [openshift-development-master-1.example.org]
TASK [Wait for master to restart] ***********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:18 +0200 (0:00:00.067)       0:00:48.462 ***********
skipping: [openshift-development-master-1.example.org]
TASK [Wait for master API to come back online] **********************************************************************************************************************************************************************
Friday 03 July 2020  12:08:18 +0200 (0:00:00.072)       0:00:48.534 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_control_plane : restart master] *********************************************************************************************************************************************************************
Friday 03 July 2020  12:08:18 +0200 (0:00:00.073)       0:00:48.607 ***********
changed: [openshift-development-master-1.example.org] => (item=api)
changed: [openshift-development-master-1.example.org] => (item=controllers)
RUNNING HANDLER [openshift_control_plane : verify API server] *******************************************************************************************************************************************************
Friday 03 July 2020  12:08:20 +0200 (0:00:02.041)       0:00:50.649 ***********
FAILED - RETRYING: verify API server (120 retries left).
FAILED - RETRYING: verify API server (119 retries left).
FAILED - RETRYING: verify API server (118 retries left).
FAILED - RETRYING: verify API server (117 retries left).
FAILED - RETRYING: verify API server (116 retries left).
ok: [openshift-development-master-1.example.org]
PLAY [Update web console certificates] ******************************************************************************************************************************************************************************
TASK [Remove certificates secret] ***********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:35 +0200 (0:00:15.585)       0:01:06.234 ***********
changed: [openshift-development-master-1.example.org]
TASK [Remove web console pods] **************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:36 +0200 (0:00:01.125)       0:01:07.360 ***********
changed: [openshift-development-master-1.example.org]
TASK [Verify that the console is running] ***************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:39 +0200 (0:00:02.199)       0:01:09.559 ***********
ok: [openshift-development-master-1.example.org]
PLAY [Update console certificates] **********************************************************************************************************************************************************************************
TASK [Remove certificates secret] ***********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:39 +0200 (0:00:00.461)       0:01:10.021 ***********
changed: [openshift-development-master-1.example.org]
TASK [openshift_console : include_tasks] ****************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:40 +0200 (0:00:00.718)       0:01:10.739 ***********
included: /root/openshift-ansible/roles/openshift_console/tasks/install.yml for openshift-development-master-1.example.org
TASK [openshift_console : Ensure openshift-console project exists] **************************************************************************************************************************************************
Friday 03 July 2020  12:08:40 +0200 (0:00:00.135)       0:01:10.875 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : Make temp directory for console templates] ************************************************************************************************************************************************
Friday 03 July 2020  12:08:41 +0200 (0:00:00.766)       0:01:11.641 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : Copy admin client config] *****************************************************************************************************************************************************************
Friday 03 July 2020  12:08:42 +0200 (0:00:01.231)       0:01:12.873 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : Copy console templates to temp directory] *************************************************************************************************************************************************
Friday 03 July 2020  12:08:42 +0200 (0:00:00.225)       0:01:13.098 ***********
changed: [openshift-development-master-1.example.org] => (item=console-template.yaml)
changed: [openshift-development-master-1.example.org] => (item=console-config.yaml)
TASK [openshift_console : Read the existing console config map] *****************************************************************************************************************************************************
Friday 03 July 2020  12:08:43 +0200 (0:00:01.099)       0:01:14.197 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : set_fact] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:44 +0200 (0:00:00.804)       0:01:15.002 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : Copy the existing web console config to temp directory] ***********************************************************************************************************************************
Friday 03 July 2020  12:08:44 +0200 (0:00:00.079)       0:01:15.082 ***********
changed: [openshift-development-master-1.example.org]
TASK [openshift_console : set_fact] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:45 +0200 (0:00:00.558)       0:01:15.640 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : set_fact] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:45 +0200 (0:00:00.087)       0:01:15.728 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : set_fact] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:45 +0200 (0:00:00.066)       0:01:15.795 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : set_fact] *********************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:45 +0200 (0:00:00.069)       0:01:15.864 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : Set web console config properties from inventory variables] *******************************************************************************************************************************
Friday 03 July 2020  12:08:45 +0200 (0:00:00.072)       0:01:15.936 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : Add context selector URL] *****************************************************************************************************************************************************************
Friday 03 July 2020  12:08:45 +0200 (0:00:00.072)       0:01:16.009 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : slurp] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:46 +0200 (0:00:00.596)       0:01:16.605 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : Apply the console template file] **********************************************************************************************************************************************************
Friday 03 July 2020  12:08:46 +0200 (0:00:00.217)       0:01:16.823 ***********
changed: [openshift-development-master-1.example.org]
TASK [openshift_console : Remove temp directory] ********************************************************************************************************************************************************************
Friday 03 July 2020  12:08:47 +0200 (0:00:00.668)       0:01:17.491 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : include_tasks] ****************************************************************************************************************************************************************************
Friday 03 July 2020  12:08:47 +0200 (0:00:00.248)       0:01:17.740 ***********
included: /root/openshift-ansible/roles/openshift_console/tasks/start.yml for openshift-development-master-1.example.org
TASK [openshift_console : Waiting for console rollout to complete] **************************************************************************************************************************************************
Friday 03 July 2020  12:08:47 +0200 (0:00:00.134)       0:01:17.875 ***********
ok: [openshift-development-master-1.example.org]
TASK [openshift_console : Check status in the openshift-console namespace] ******************************************************************************************************************************************
Friday 03 July 2020  12:09:06 +0200 (0:00:19.418)       0:01:37.293 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:09:06 +0200 (0:00:00.074)       0:01:37.367 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : Get pods in the openshift-console namespace] **********************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.069)       0:01:37.436 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.075)       0:01:37.512 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : Get events in the openshift-console namespace] ********************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.075)       0:01:37.587 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.075)       0:01:37.663 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : Get console pod logs] *********************************************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.071)       0:01:37.735 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : debug] ************************************************************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.068)       0:01:37.803 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : Report console errors] ********************************************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.095)       0:01:37.898 ***********
skipping: [openshift-development-master-1.example.org]
TASK [openshift_console : include_tasks] ****************************************************************************************************************************************************************************
Friday 03 July 2020  12:09:07 +0200 (0:00:00.084)       0:01:37.983 ***********
skipping: [openshift-development-master-1.example.org]
PLAY RECAP **********************************************************************************************************************************************************************************************************
localhost                  : ok=14   changed=0    unreachable=0    failed=0    skipped=4    rescued=0    ignored=0
openshift-development-infra-1.example.org : ok=15   changed=1    unreachable=0    failed=0    skipped=26   rescued=0    ignored=0
openshift-development-lb-1.example.org : ok=14   changed=1    unreachable=0    failed=0    skipped=26   rescued=0    ignored=0
openshift-development-master-1.example.org : ok=110  changed=26   unreachable=0    failed=0    skipped=81   rescued=0    ignored=0
openshift-development-node-1.example.org : ok=15   changed=1    unreachable=0    failed=0    skipped=26   rescued=0    ignored=0
openshift-development-node-2.example.org : ok=15   changed=1    unreachable=0    failed=0    skipped=26   rescued=0    ignored=0
INSTALLER STATUS ****************************************************************************************************************************************************************************************************
Initialization  : Complete (0:00:21)
Friday 03 July 2020  12:09:07 +0200 (0:00:00.031)       0:01:38.014 ***********
===============================================================================
openshift_console : Waiting for console rollout to complete ------------------------------------------------------------------------------------------------------------------------------------------------- 19.42s
openshift_control_plane : verify API server ----------------------------------------------------------------------------------------------------------------------------------------------------------------- 15.59s
Remove master certificates and config ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 3.12s
Remove web console pods -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2.20s
openshift_control_plane : restart master --------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2.04s
Gathering Facts ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2.02s
Gathering Facts ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 1.77s
openshift_ca : Create the master certificates if they do not already exist ----------------------------------------------------------------------------------------------------------------------------------- 1.34s
openshift_console : Make temp directory for console templates ------------------------------------------------------------------------------------------------------------------------------------------------ 1.23s
Remove certificates secret ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 1.13s
openshift_console : Copy console templates to temp directory ------------------------------------------------------------------------------------------------------------------------------------------------- 1.10s
openshift_ca : Install the base package for admin tooling ---------------------------------------------------------------------------------------------------------------------------------------------------- 1.09s
openshift_ca : Create the front-proxy CA if it does not already exist ---------------------------------------------------------------------------------------------------------------------------------------- 1.08s
openshift_ca : Copy generated loopback master client config to master config dir ----------------------------------------------------------------------------------------------------------------------------- 0.97s
openshift_named_certificates : Land named certificates ------------------------------------------------------------------------------------------------------------------------------------------------------- 0.90s
Gather Cluster facts ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.85s
get openshift_current_version -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 0.81s
openshift_console : Read the existing console config map ----------------------------------------------------------------------------------------------------------------------------------------------------- 0.80s
openshift_ca : Generate the aggregator api-client config ----------------------------------------------------------------------------------------------------------------------------------------------------- 0.77s
openshift_console : Ensure openshift-console project exists -------------------------------------------------------------------------------------------------------------------------------------------------- 0.77s