Stdout
[BeforeEach] [sig-network] NetworkPolicy [LinuxOnly]
/home/stack/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:151
�[1mSTEP�[0m: Creating a kubernetes client
Jun 29 07:21:54.975: INFO: >>> kubeConfig: /home/stack/ostest/auth/kubeconfig
�[1mSTEP�[0m: Building a namespace api object, basename network-policy
Jun 29 07:21:55.230: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
�[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-network] NetworkPolicy [LinuxOnly]
/home/stack/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/network/network_policy.go:50
[BeforeEach] NetworkPolicy between server and client
/home/stack/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/network/network_policy.go:56
�[1mSTEP�[0m: Creating a simple server that serves on port 80 and 81.
�[1mSTEP�[0m: Creating a server pod server in namespace network-policy-9184
Jun 29 07:21:56.315: INFO: Created pod server-lbb9q
�[1mSTEP�[0m: Creating a service svc-server for pod server in namespace network-policy-9184
Jun 29 07:21:56.341: INFO: Created service svc-server
�[1mSTEP�[0m: Waiting for pod ready
�[1mSTEP�[0m: Testing pods can connect to both ports when no policy is present.
�[1mSTEP�[0m: Creating client pod client-can-connect-80 that should successfully connect to svc-server.
Jun 29 07:23:04.439: INFO: Waiting for client-can-connect-80-mpbhw to complete.
Jun 29 07:24:58.458: INFO: Waiting for client-can-connect-80-mpbhw to complete.
Jun 29 07:24:58.458: INFO: Waiting up to 1m0s for pod "client-can-connect-80-mpbhw" in namespace "network-policy-9184" to be "success or failure"
Jun 29 07:24:58.465: INFO: Pod "client-can-connect-80-mpbhw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 7.68988ms
�[1mSTEP�[0m: Saw pod success
Jun 29 07:24:58.465: INFO: Pod "client-can-connect-80-mpbhw" satisfied condition "success or failure"
�[1mSTEP�[0m: Cleaning up the pod client-can-connect-80-mpbhw
�[1mSTEP�[0m: Creating client pod client-can-connect-81 that should successfully connect to svc-server.
Jun 29 07:24:58.610: INFO: Waiting for client-can-connect-81-xf9vm to complete.
Jun 29 07:26:34.637: INFO: Waiting for client-can-connect-81-xf9vm to complete.
Jun 29 07:26:34.637: INFO: Waiting up to 1m0s for pod "client-can-connect-81-xf9vm" in namespace "network-policy-9184" to be "success or failure"
Jun 29 07:26:34.646: INFO: Pod "client-can-connect-81-xf9vm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.687115ms
�[1mSTEP�[0m: Saw pod success
Jun 29 07:26:34.646: INFO: Pod "client-can-connect-81-xf9vm" satisfied condition "success or failure"
�[1mSTEP�[0m: Cleaning up the pod client-can-connect-81-xf9vm
[It] should enforce policy based on PodSelector or NamespaceSelector [Feature:NetworkPolicy-06]
/home/stack/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/network/network_policy.go:289
�[1mSTEP�[0m: Creating a network policy for the server which allows traffic from client-b or namespace-b.
�[1mSTEP�[0m: Creating client pod client-a that should successfully connect to svc-server.
Jun 29 07:26:35.047: INFO: Waiting for client-a-4dtmq to complete.
Jun 29 07:29:35.072: FAIL: Pod did not finish as expected.
Unexpected error:
<*errors.errorString | 0xc000099960>: {
s: "timed out waiting for the condition",
}
timed out waiting for the condition
occurred
�[1mSTEP�[0m: Cleaning up the pod client-a-4dtmq
�[1mSTEP�[0m: Cleaning up the policy.
[AfterEach] NetworkPolicy between server and client
/home/stack/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/network/network_policy.go:74
�[1mSTEP�[0m: Cleaning up the server.
�[1mSTEP�[0m: Cleaning up the server's service.
[AfterEach] [sig-network] NetworkPolicy [LinuxOnly]
/home/stack/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:152
�[1mSTEP�[0m: Collecting events from namespace "network-policy-9184".
�[1mSTEP�[0m: Found 20 events.
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:21:56 -0400 EDT - event for server-lbb9q: {default-scheduler } Scheduled: Successfully assigned network-policy-9184/server-lbb9q to ostest-l6xkl-worker-xx4sh
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:22:45 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Pulling: Pulling image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8"
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:22:53 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Created: Created container server-container-81
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:22:53 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Pulled: Container image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8" already present on machine
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:22:53 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Started: Started container server-container-80
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:22:53 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Created: Created container server-container-80
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:22:53 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Pulled: Successfully pulled image "gcr.io/kubernetes-e2e-test-images/agnhost:2.8"
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:22:53 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Started: Started container server-container-81
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:23:04 -0400 EDT - event for client-can-connect-80-mpbhw: {default-scheduler } Scheduled: Successfully assigned network-policy-9184/client-can-connect-80-mpbhw to ostest-l6xkl-worker-p6h8f
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:23:19 -0400 EDT - event for client-can-connect-80-mpbhw: {kubelet ostest-l6xkl-worker-p6h8f} Pulling: Pulling image "docker.io/library/busybox:1.29-glibc"
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:23:27 -0400 EDT - event for client-can-connect-80-mpbhw: {kubelet ostest-l6xkl-worker-p6h8f} Created: Created container client-can-connect-80-container
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:23:27 -0400 EDT - event for client-can-connect-80-mpbhw: {kubelet ostest-l6xkl-worker-p6h8f} Pulled: Successfully pulled image "docker.io/library/busybox:1.29-glibc"
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:23:27 -0400 EDT - event for client-can-connect-80-mpbhw: {kubelet ostest-l6xkl-worker-p6h8f} Started: Started container client-can-connect-80-container
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:24:58 -0400 EDT - event for client-can-connect-80-mpbhw: {kubelet ostest-l6xkl-worker-p6h8f} Killing: Stopping container client-can-connect-80-container
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:24:58 -0400 EDT - event for client-can-connect-81-xf9vm: {default-scheduler } Scheduled: Successfully assigned network-policy-9184/client-can-connect-81-xf9vm to ostest-l6xkl-worker-p6h8f
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:25:01 -0400 EDT - event for client-can-connect-81-xf9vm: {kubelet ostest-l6xkl-worker-p6h8f} Pulled: Container image "docker.io/library/busybox:1.29-glibc" already present on machine
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:25:02 -0400 EDT - event for client-can-connect-81-xf9vm: {kubelet ostest-l6xkl-worker-p6h8f} Started: Started container client-can-connect-81-container
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:25:02 -0400 EDT - event for client-can-connect-81-xf9vm: {kubelet ostest-l6xkl-worker-p6h8f} Created: Created container client-can-connect-81-container
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:29:35 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Killing: Stopping container server-container-80
Jun 29 07:29:35.220: INFO: At 2020-06-29 07:29:35 -0400 EDT - event for server-lbb9q: {kubelet ostest-l6xkl-worker-xx4sh} Killing: Stopping container server-container-81
Jun 29 07:29:35.231: INFO: POD NODE PHASE GRACE CONDITIONS
Jun 29 07:29:35.231: INFO: server-lbb9q ostest-l6xkl-worker-xx4sh Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2020-06-29 07:21:56 -0400 EDT } {Ready True 0001-01-01 00:00:00 +0000 UTC 2020-06-29 07:23:02 -0400 EDT } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2020-06-29 07:23:02 -0400 EDT } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2020-06-29 07:21:56 -0400 EDT }]
Jun 29 07:29:35.231: INFO:
Jun 29 07:29:35.246: INFO:
Logging node info for node ostest-l6xkl-master-0
Jun 29 07:29:35.256: INFO: Node Info: &Node{ObjectMeta:{ostest-l6xkl-master-0 /api/v1/nodes/ostest-l6xkl-master-0 875ba094-0141-4a18-b8be-c69064b1941b 35310 0 2020-06-29 06:34:16 -0400 EDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:m4.xlarge beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/zone:nova kubernetes.io/arch:amd64 kubernetes.io/hostname:ostest-l6xkl-master-0 kubernetes.io/os:linux node-role.kubernetes.io/master: node.kubernetes.io/instance-type:m4.xlarge node.openshift.io/os_id:rhcos topology.kubernetes.io/zone:nova] map[machine.openshift.io/machine:openshift-machine-api/ostest-l6xkl-master-0 machineconfiguration.openshift.io/currentConfig:rendered-master-e8dc97609266174245f6dd96b2ac8f94 machineconfiguration.openshift.io/desiredConfig:rendered-master-e8dc97609266174245f6dd96b2ac8f94 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:openstack://47809b6f-4e01-474c-87bc-8c0539102527,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{42384470016 0} {<nil>} 41391084Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16815423488 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Allocatable:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{3500 -3} {<nil>} 3500m DecimalSI},ephemeral-storage: {{37072281128 0} {<nil>} 37072281128 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15636824064 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-06-29 07:24:44 -0400 EDT,LastTransitionTime:2020-06-29 06:34:16 -0400 EDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-06-29 07:24:44 -0400 EDT,LastTransitionTime:2020-06-29 06:34:16 -0400 EDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-06-29 07:24:44 -0400 EDT,LastTransitionTime:2020-06-29 06:34:16 -0400 EDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-06-29 07:24:44 -0400 EDT,LastTransitionTime:2020-06-29 06:38:27 -0400 EDT,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:ostest-l6xkl-master-0,},NodeAddress{Type:InternalIP,Address:10.196.1.57,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:47809b6f4e01474c87bc8c0539102527,SystemUUID:47809b6f-4e01-474c-87bc-8c0539102527,BootID:ce1115f9-a4f3-4f86-8885-308916441690,KernelVersion:4.18.0-147.20.1.el8_1.x86_64,OSImage:Red Hat Enterprise Linux CoreOS 44.81.202006271430-0 (Ootpa),ContainerRuntimeVersion:cri-o://1.17.4-18.dev.rhaos4.4.gitfb8131a.el8,KubeletVersion:v1.17.1+1aa1c48,KubeProxyVersion:v1.17.1+1aa1c48,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f5f1f1566ea8ec07e9b15ff46d1767ee49148205f26a6de6aa168d8c853d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:872290769,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8862a492686a39b3fd2926caf6140e3cfa7a42273e0df7f8d57a8305273bc6e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:773298245,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b097ff30213109b123d024a442deb00aa5fab5d035ad4a149365ca3399fb1375 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:677943167,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4b8c2c1e258b6a17a4a02c3d9660dd2f9bc3323a386131f86b70e71a4b2d00a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:651228269,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5dc00078f4b78f907f0fb6cb94b7f71984fd6888cade27d0ea6817f00d6d4f3 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:608014211,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0a47fb26cd52ba22dd7fc963e74c105d5b6e091ab7922a4766efb4e63f52bb6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:467326588,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f551588a89a7f2f8d39bc766be1ce5f688ee166f4d19bfa45e87a955cb3a0db quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:461969109,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e92e2fada5baf7bf6336d366a4817394cefa0f43bf3de881c0bcb6f5c555a38 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:429897331,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d478d1a212bd1a2a5bd14e36e0fd740607c4097c7498d7afea028b8eec699755 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:364474354,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6ecb98c9a40eb5c0f69fbb66ea5c77e451e6d2c5ffc2c529781490ff9da3223 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:342626046,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbf4b2d6fa1a405387bea55db2a293fb196e3808d61a269b1bf5b00dfe054997 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:338257579,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c93ab547a5f6fb1110ea190ff1e9f76b9c3400234ec91e38b40db187ec6a1cb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:333703633,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7cb23c271c3b40a1733f7ae366167cdb91050a449c263811c066f582b772054c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325673898,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80b81897621f119d1cc459dbcd2c6eeec5c8211c77e1ac86bea7f04e22c55c68 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:324521511,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:633e031d8ae1e6f5954c01984849ee8ffd251e587a0ace0b455d43464d20abb0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:322181042,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6e93aecf649d936c914f64477dbffed1db0e3d4a5e1c144ed6ca35fb04378c57 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:321842313,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1afa7bad421bf89937557098854c12d111b8b01b0ba50fc4e9581e87bda4af97 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:321048085,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fe3ae0b69d25ec5886aad6380632869b7df2d4439f8904df72d6f2b9c722ef9 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:319311938,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be8b79f4e4a00c54194d278133fbf1abcfbcd77025984039251bd582a84b4070 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318699317,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fb3e77fc49889cecd0b70334fb648cd460985b9534e39e7d72026d58ef91d25 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318390261,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f713807d89802682d410f2b93d525a139eeffa9273ce7bab80c4441feff35825 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318048395,},ContainerImage{Names:[registry.svc.ci.openshift.org/ocp/release@sha256:2dbc394c6007e5a285beb68d74ebc7c55ff5faa863e39008fd2cc16b9ca525d0 registry.svc.ci.openshift.org/ocp/release@sha256:<none>],SizeBytes:305837295,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1cfcdb3c2406c10e980eabd454ef2640877b15d6576e7dfae2beaf129ec94f03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:305583473,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76c30df17a5c6157fcf6683a96ec2a7b0eee59434646472cf5be1acf90c3cf6c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:303804001,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86cff84c1cffbe966ae78097aa67e2bdacc5148a19aee7e4c65582640bb4a36d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:303286374,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:850ab358446406d3d946aa170bbc510c900a7b6b716a060da3c66ad5cfcd9ab4 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:302920229,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6b00c21cd64212818879441d0ba7c6d1f56f5a4e5de0a1d44d8c18b947d9db8e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:302446757,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05f8e6d1f6d516eb96e7b0a692562a8bae4648f55fd9adcc954b5e782f1bfc0d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:300628574,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eead17f86e48dcad334cc8bfd5af017097459cf1359cff49a20223cf7a3e3806 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:300265160,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:549b5733928b41144f0098055ec74c86b6b2cff4890f2a3f66f46ac5c9bd7c68 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:300132953,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba07f994b46759305977961cead61b8b48d558a13f1baf52265a7ae6fdfd4dd6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299998351,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cb4e129b59fee2c779cbf90b893e2ad95cb23a42317d0a4d426781acc7ca6310 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299823290,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233886ae12eca510dfe3bdf9d2e7517b1e7ee1d41eda6919b66569b11b328d0c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299604026,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24287276201fe8f5f7905e7c32305487a288dd2c760f9031ce9411977f0bc96d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299510340,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1e063194c5d539d0526d6e70113149baa567cf8c02ce290435dfd4fe0a3db44 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:289660091,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:579c744bbf13643352f44d656671f54529afb020e5bf76337a1131d540760f08 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:287115280,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ccce1c6c856a113d219a284ad9bc3f89c1f49f124a42c02a9c087f1d23fe8ba quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:283435012,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1de153bc8773f9857efbb092f0e2756a6d253c0cb5189310641c9eda0ef8c61 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:267611081,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51d2c485bb848c6fb8cfc65d2a834a059ef97ed1241f6f5a85e19094ebb64d60 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:264205161,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bb48291f2937c1a0bf84eee5f26fc98d400e5242ee75afc4e6a3c5b75e7a03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:255814539,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec70cc0697d893d2b5c83b11e0888488a6c7556a945da11b59015ad69f98a62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:251028388,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52686d7a2b9ffbc8619ba2a4835dd91bab71f52a4a959144ec7bde5a3ed04004 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:237302018,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jun 29 07:29:35.257: INFO:
Logging kubelet events for node ostest-l6xkl-master-0
Jun 29 07:29:35.272: INFO:
Logging pods the kubelet thinks is on node ostest-l6xkl-master-0
Jun 29 07:29:35.426: INFO: machine-config-operator-6bb6687b54-cbvkx started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container machine-config-operator ready: true, restart count 0
Jun 29 07:29:35.426: INFO: kube-controller-manager-ostest-l6xkl-master-0 started at 2020-06-29 06:41:41 -0400 EDT (2+4 container statuses recorded)
Jun 29 07:29:35.426: INFO: Init container wait-for-host-port ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Init container wait-for-cpc-host-port ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container cluster-policy-controller ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-controller-manager ready: true, restart count 1
Jun 29 07:29:35.426: INFO: Container kube-controller-manager-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-controller-manager-recovery-controller ready: true, restart count 0
Jun 29 07:29:35.426: INFO: openshift-controller-manager-operator-77b5f6d6d4-kpdzk started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container operator ready: true, restart count 1
Jun 29 07:29:35.426: INFO: kuryr-cni-62wzm started at 2020-06-29 06:37:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container kuryr-cni ready: true, restart count 0
Jun 29 07:29:35.426: INFO: kuryr-dns-admission-controller-w4dgn started at 2020-06-29 06:37:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container kuryr-dns-admission-controller ready: true, restart count 0
Jun 29 07:29:35.426: INFO: machine-approver-57785996dc-r94x2 started at 2020-06-29 06:38:27 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container machine-approver-controller ready: true, restart count 0
Jun 29 07:29:35.426: INFO: multus-admission-controller-hvcpw started at 2020-06-29 06:38:27 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container multus-admission-controller ready: true, restart count 0
Jun 29 07:29:35.426: INFO: installer-4-ostest-l6xkl-master-0 started at 2020-06-29 06:41:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.426: INFO: downloads-56b865b565-7x4z7 started at 2020-06-29 06:44:28 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container download-server ready: true, restart count 0
Jun 29 07:29:35.426: INFO: revision-pruner-7-ostest-l6xkl-master-0 started at 2020-06-29 06:49:28 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.426: INFO: etcd-quorum-guard-7846d75884-gb4qx started at 2020-06-29 06:44:07 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container guard ready: true, restart count 0
Jun 29 07:29:35.426: INFO: controller-manager-rhhsw started at 2020-06-29 06:46:14 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container controller-manager ready: true, restart count 0
Jun 29 07:29:35.426: INFO: cluster-version-operator-56f4d5d85c-jkxgp started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container cluster-version-operator ready: true, restart count 0
Jun 29 07:29:35.426: INFO: installer-6-ostest-l6xkl-master-0 started at 2020-06-29 06:47:21 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.426: INFO: revision-pruner-3-ostest-l6xkl-master-0 started at 2020-06-29 06:42:25 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.426: INFO: dns-default-l5m7t started at 2020-06-29 06:42:53 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container dns ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container dns-node-resolver ready: true, restart count 0
Jun 29 07:29:35.426: INFO: revision-pruner-4-ostest-l6xkl-master-0 started at 2020-06-29 06:42:59 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.426: INFO: revision-pruner-2-ostest-l6xkl-master-0 started at 2020-06-29 06:45:02 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.426: INFO: revision-pruner-6-ostest-l6xkl-master-0 started at 2020-06-29 06:50:15 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.426: INFO: mdns-publisher-ostest-l6xkl-master-0 started at 2020-06-29 06:34:04 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container mdns-publisher ready: true, restart count 0
Jun 29 07:29:35.426: INFO: service-ca-operator-899c4c869-8zx9x started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container operator ready: true, restart count 1
Jun 29 07:29:35.426: INFO: machine-config-server-6tkng started at 2020-06-29 06:43:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container machine-config-server ready: true, restart count 0
Jun 29 07:29:35.426: INFO: openshift-kube-scheduler-ostest-l6xkl-master-0 started at 2020-06-29 06:41:35 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:35.426: INFO: Init container wait-for-host-port ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-scheduler ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-scheduler-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.426: INFO: installer-6-ostest-l6xkl-master-0 started at 2020-06-29 06:49:01 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.426: INFO: machine-config-daemon-xrlhr started at 2020-06-29 06:39:29 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container machine-config-daemon ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:35.426: INFO: etcd-ostest-l6xkl-master-0 started at 2020-06-29 06:44:30 -0400 EDT (2+4 container statuses recorded)
Jun 29 07:29:35.426: INFO: Init container etcd-ensure-env-vars ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Init container etcd-resources-copy ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container etcd ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container etcd-metrics ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container etcdctl ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container rollbackcopier ready: true, restart count 0
Jun 29 07:29:35.426: INFO: node-exporter-xk8bg started at 2020-06-29 06:45:52 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:35.426: INFO: Init container init-textfile ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container node-exporter ready: true, restart count 0
Jun 29 07:29:35.426: INFO: installer-8-ostest-l6xkl-master-0 started at 2020-06-29 06:48:24 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.426: INFO: revision-pruner-5-ostest-l6xkl-master-0 started at 2020-06-29 06:49:00 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.426: INFO: tuned-d4flv started at 2020-06-29 06:39:02 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container tuned ready: true, restart count 0
Jun 29 07:29:35.426: INFO: installer-3-ostest-l6xkl-master-0 started at 2020-06-29 06:41:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.426: INFO: revision-pruner-5-ostest-l6xkl-master-0 started at 2020-06-29 06:42:29 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.426: INFO: kube-apiserver-ostest-l6xkl-master-0 started at 2020-06-29 06:41:31 -0400 EDT (1+4 container statuses recorded)
Jun 29 07:29:35.426: INFO: Init container setup ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-apiserver ready: true, restart count 4
Jun 29 07:29:35.426: INFO: Container kube-apiserver-cert-regeneration-controller ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-apiserver-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.426: INFO: Container kube-apiserver-insecure-readyz ready: true, restart count 0
Jun 29 07:29:35.426: INFO: kube-controller-manager-operator-7d76c966b5-f5qf9 started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.426: INFO: Container kube-controller-manager-operator ready: true, restart count 1
Jun 29 07:29:35.427: INFO: node-ca-rtk97 started at 2020-06-29 06:45:15 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container node-ca ready: true, restart count 0
Jun 29 07:29:35.427: INFO: revision-pruner-8-ostest-l6xkl-master-0 started at 2020-06-29 06:49:04 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.427: INFO: console-5584bd86cd-q4pr6 started at 2020-06-29 06:54:11 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container console ready: true, restart count 0
Jun 29 07:29:35.427: INFO: haproxy-ostest-l6xkl-master-0 started at 2020-06-29 06:34:04 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container haproxy ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Container haproxy-monitor ready: true, restart count 0
Jun 29 07:29:35.427: INFO: keepalived-ostest-l6xkl-master-0 started at 2020-06-29 06:34:04 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Container keepalived ready: true, restart count 0
Jun 29 07:29:35.427: INFO: apiserver-6f55bcc488-zl5k4 started at 2020-06-29 06:46:36 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Init container fix-audit-permissions ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Container openshift-apiserver ready: true, restart count 0
Jun 29 07:29:35.427: INFO: openshift-apiserver-operator-86b8f7c5c9-vmmhb started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container openshift-apiserver-operator ready: true, restart count 0
Jun 29 07:29:35.427: INFO: etcd-operator-57c66d7876-ccsnj started at 2020-06-29 06:40:39 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container operator ready: true, restart count 1
Jun 29 07:29:35.427: INFO: openshift-service-catalog-apiserver-operator-7b688bdc49-fv5st started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container operator ready: true, restart count 1
Jun 29 07:29:35.427: INFO: revision-pruner-7-ostest-l6xkl-master-0 started at 2020-06-29 06:48:23 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.427: INFO: cluster-node-tuning-operator-75f7ff88b-lx7tt started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container cluster-node-tuning-operator ready: true, restart count 0
Jun 29 07:29:35.427: INFO: revision-pruner-7-ostest-l6xkl-master-0 started at 2020-06-29 07:00:35 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.427: INFO: installer-5-ostest-l6xkl-master-0 started at 2020-06-29 06:48:23 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.427: INFO: openshift-service-catalog-controller-manager-operator-5db64zvjf started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container operator ready: true, restart count 1
Jun 29 07:29:35.427: INFO: kube-storage-version-migrator-operator-6c99bbcb6c-855pb started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container kube-storage-version-migrator-operator ready: true, restart count 1
Jun 29 07:29:35.427: INFO: installer-5-ostest-l6xkl-master-0 started at 2020-06-29 06:41:21 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.427: INFO: machine-config-controller-85985858cd-gz6b9 started at 2020-06-29 06:42:21 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container machine-config-controller ready: true, restart count 0
Jun 29 07:29:35.427: INFO: installer-2-ostest-l6xkl-master-0 started at 2020-06-29 06:44:13 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.427: INFO: openshift-kube-scheduler-operator-85464db85b-6dv62 started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container kube-scheduler-operator-container ready: true, restart count 1
Jun 29 07:29:35.427: INFO: authentication-operator-67c7ddd76c-w5qhv started at 2020-06-29 06:40:39 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container operator ready: true, restart count 0
Jun 29 07:29:35.427: INFO: installer-7-ostest-l6xkl-master-0 started at 2020-06-29 06:47:39 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.427: INFO: packageserver-cc79b64fb-mpj25 started at 2020-06-29 06:43:16 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container packageserver ready: true, restart count 0
Jun 29 07:29:35.427: INFO: installer-7-ostest-l6xkl-master-0 started at 2020-06-29 06:48:21 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.427: INFO: revision-pruner-6-ostest-l6xkl-master-0 started at 2020-06-29 06:48:16 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.427: INFO: installer-7-ostest-l6xkl-master-0 started at 2020-06-29 06:58:20 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.427: INFO: coredns-ostest-l6xkl-master-0 started at 2020-06-29 06:34:04 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Container coredns ready: true, restart count 0
Jun 29 07:29:35.427: INFO: multus-d98rs started at 2020-06-29 06:37:03 -0400 EDT (5+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Init container multus-binary-copy ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Init container cni-plugins ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Init container routeoverride-cni ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Init container whereabouts-cni-bincopy ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Init container whereabouts-cni ready: true, restart count 0
Jun 29 07:29:35.427: INFO: Container kube-multus ready: true, restart count 0
Jun 29 07:29:35.427: INFO: olm-operator-869976bfd5-nd5rl started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container olm-operator ready: true, restart count 0
Jun 29 07:29:35.427: INFO: kube-apiserver-operator-5975fc466-hr7wl started at 2020-06-29 06:38:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.427: INFO: Container kube-apiserver-operator ready: true, restart count 1
W0629 07:29:35.450515 438694 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Jun 29 07:29:35.527: INFO:
Latency metrics for node ostest-l6xkl-master-0
Jun 29 07:29:35.527: INFO:
Logging node info for node ostest-l6xkl-master-1
Jun 29 07:29:35.541: INFO: Node Info: &Node{ObjectMeta:{ostest-l6xkl-master-1 /api/v1/nodes/ostest-l6xkl-master-1 1c740a5a-39a7-4059-a32d-26d0f722f96b 35544 0 2020-06-29 06:34:37 -0400 EDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:m4.xlarge beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/zone:nova kubernetes.io/arch:amd64 kubernetes.io/hostname:ostest-l6xkl-master-1 kubernetes.io/os:linux node-role.kubernetes.io/master: node.kubernetes.io/instance-type:m4.xlarge node.openshift.io/os_id:rhcos topology.kubernetes.io/zone:nova] map[machine.openshift.io/machine:openshift-machine-api/ostest-l6xkl-master-1 machineconfiguration.openshift.io/currentConfig:rendered-master-e8dc97609266174245f6dd96b2ac8f94 machineconfiguration.openshift.io/desiredConfig:rendered-master-e8dc97609266174245f6dd96b2ac8f94 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:openstack://5e65788f-c6e4-4497-97b4-cd32499756cb,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{42384470016 0} {<nil>} 41391084Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16815423488 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Allocatable:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{3500 -3} {<nil>} 3500m DecimalSI},ephemeral-storage: {{37072281128 0} {<nil>} 37072281128 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15636824064 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-06-29 07:25:23 -0400 EDT,LastTransitionTime:2020-06-29 06:34:37 -0400 EDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-06-29 07:25:23 -0400 EDT,LastTransitionTime:2020-06-29 06:34:37 -0400 EDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-06-29 07:25:23 -0400 EDT,LastTransitionTime:2020-06-29 06:34:37 -0400 EDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-06-29 07:25:23 -0400 EDT,LastTransitionTime:2020-06-29 06:38:27 -0400 EDT,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:ostest-l6xkl-master-1,},NodeAddress{Type:InternalIP,Address:10.196.3.13,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:5e65788fc6e4449797b4cd32499756cb,SystemUUID:5e65788f-c6e4-4497-97b4-cd32499756cb,BootID:725c7d0d-50f9-4ade-bb58-3ce7d5ef5d1e,KernelVersion:4.18.0-147.20.1.el8_1.x86_64,OSImage:Red Hat Enterprise Linux CoreOS 44.81.202006271430-0 (Ootpa),ContainerRuntimeVersion:cri-o://1.17.4-18.dev.rhaos4.4.gitfb8131a.el8,KubeletVersion:v1.17.1+1aa1c48,KubeProxyVersion:v1.17.1+1aa1c48,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f5f1f1566ea8ec07e9b15ff46d1767ee49148205f26a6de6aa168d8c853d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:872290769,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d8862a492686a39b3fd2926caf6140e3cfa7a42273e0df7f8d57a8305273bc6e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:773298245,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b097ff30213109b123d024a442deb00aa5fab5d035ad4a149365ca3399fb1375 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:677943167,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4b8c2c1e258b6a17a4a02c3d9660dd2f9bc3323a386131f86b70e71a4b2d00a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:651228269,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5dc00078f4b78f907f0fb6cb94b7f71984fd6888cade27d0ea6817f00d6d4f3 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:608014211,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0a47fb26cd52ba22dd7fc963e74c105d5b6e091ab7922a4766efb4e63f52bb6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:467326588,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f551588a89a7f2f8d39bc766be1ce5f688ee166f4d19bfa45e87a955cb3a0db quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:461969109,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e92e2fada5baf7bf6336d366a4817394cefa0f43bf3de881c0bcb6f5c555a38 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:429897331,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c80da588445fd4665355a53c596367006722ca9c2d2383b8e2b5bbcca71cbe41 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:374947867,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d478d1a212bd1a2a5bd14e36e0fd740607c4097c7498d7afea028b8eec699755 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:364474354,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d769f735294a66792de3e2406626b389600164177402993dbc48db9e69ca827 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:356807773,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6ecb98c9a40eb5c0f69fbb66ea5c77e451e6d2c5ffc2c529781490ff9da3223 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:342626046,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbf4b2d6fa1a405387bea55db2a293fb196e3808d61a269b1bf5b00dfe054997 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:338257579,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c93ab547a5f6fb1110ea190ff1e9f76b9c3400234ec91e38b40db187ec6a1cb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:333703633,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:846c808af11df90ce917c60013e7e4ee67471d6115f4274b5e9e763903b441ed quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:328145516,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4d7427ea0c96f62bab3d62af1958c2d19afb37f6326410bd09965aa60fa2b862 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:326846573,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7cb23c271c3b40a1733f7ae366167cdb91050a449c263811c066f582b772054c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325673898,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80b81897621f119d1cc459dbcd2c6eeec5c8211c77e1ac86bea7f04e22c55c68 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:324521511,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:633e031d8ae1e6f5954c01984849ee8ffd251e587a0ace0b455d43464d20abb0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:322181042,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1afa7bad421bf89937557098854c12d111b8b01b0ba50fc4e9581e87bda4af97 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:321048085,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be8b79f4e4a00c54194d278133fbf1abcfbcd77025984039251bd582a84b4070 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318699317,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fb3e77fc49889cecd0b70334fb648cd460985b9534e39e7d72026d58ef91d25 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318390261,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f713807d89802682d410f2b93d525a139eeffa9273ce7bab80c4441feff35825 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318048395,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d883935b9ee044faeb1579e2808cfdacc0af63db6f95a95516957b03ca86de8 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:307045953,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ed0fd824b8fc20f09eea15268863ec3ba8e4a457bd3c13599664440f65ad3591 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:306010130,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1cfcdb3c2406c10e980eabd454ef2640877b15d6576e7dfae2beaf129ec94f03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:305583473,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76c30df17a5c6157fcf6683a96ec2a7b0eee59434646472cf5be1acf90c3cf6c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:303804001,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86cff84c1cffbe966ae78097aa67e2bdacc5148a19aee7e4c65582640bb4a36d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:303286374,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:850ab358446406d3d946aa170bbc510c900a7b6b716a060da3c66ad5cfcd9ab4 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:302920229,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6b00c21cd64212818879441d0ba7c6d1f56f5a4e5de0a1d44d8c18b947d9db8e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:302446757,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6df390dbdf0cfe997e56b776635c1926153ba99856131f1d03b1249ce5d9de0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:301569682,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05f8e6d1f6d516eb96e7b0a692562a8bae4648f55fd9adcc954b5e782f1bfc0d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:300628574,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233886ae12eca510dfe3bdf9d2e7517b1e7ee1d41eda6919b66569b11b328d0c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299604026,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24287276201fe8f5f7905e7c32305487a288dd2c760f9031ce9411977f0bc96d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299510340,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff209f58834277aee284be2162a49dc390b273f57b29ef8db7272a0041e9b290 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:296711276,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:822a6a24b18812bd6b2ea20f72975f950b4fdd5d3f83c041315587278fa0d057 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:292632495,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8f4ff67d06a4349c41bfedbe31bf67f32c30dece5b553de19eca03c387ee24f quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:291821123,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7b57fdb15a437767766d3389d04cc2d54c1e855958175d71c7ffe537660bfff6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:290179628,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6c71c0d8cfd13295ed60f1d947067641a4d87749280d8b06ee21857a16435d7a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:290007737,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1e063194c5d539d0526d6e70113149baa567cf8c02ce290435dfd4fe0a3db44 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:289660091,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ccce1c6c856a113d219a284ad9bc3f89c1f49f124a42c02a9c087f1d23fe8ba quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:283435012,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6e11b1a2fa7deed037056c53aa53e264d571f19b5a738cc2941596825735e9fb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:283428064,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1de153bc8773f9857efbb092f0e2756a6d253c0cb5189310641c9eda0ef8c61 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:267611081,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51d2c485bb848c6fb8cfc65d2a834a059ef97ed1241f6f5a85e19094ebb64d60 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:264205161,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bb48291f2937c1a0bf84eee5f26fc98d400e5242ee75afc4e6a3c5b75e7a03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:255814539,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec70cc0697d893d2b5c83b11e0888488a6c7556a945da11b59015ad69f98a62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:251028388,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52686d7a2b9ffbc8619ba2a4835dd91bab71f52a4a959144ec7bde5a3ed04004 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:237302018,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jun 29 07:29:35.541: INFO:
Logging kubelet events for node ostest-l6xkl-master-1
Jun 29 07:29:35.554: INFO:
Logging pods the kubelet thinks is on node ostest-l6xkl-master-1
Jun 29 07:29:35.628: INFO: installer-5-ostest-l6xkl-master-1 started at 2020-06-29 06:42:33 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-4-ostest-l6xkl-master-1 started at 2020-06-29 06:46:33 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: kube-apiserver-ostest-l6xkl-master-1 started at 2020-06-29 06:43:58 -0400 EDT (1+4 container statuses recorded)
Jun 29 07:29:35.628: INFO: Init container setup ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container kube-apiserver ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container kube-apiserver-cert-regeneration-controller ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container kube-apiserver-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container kube-apiserver-insecure-readyz ready: true, restart count 0
Jun 29 07:29:35.628: INFO: machine-api-controllers-7dc75cffd5-d8rp5 started at 2020-06-29 06:46:25 -0400 EDT (0+4 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container controller-manager ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container machine-controller ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container machine-healthcheck-controller ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container nodelink-controller ready: true, restart count 0
Jun 29 07:29:35.628: INFO: dns-default-pkn47 started at 2020-06-29 06:42:53 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container dns ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container dns-node-resolver ready: true, restart count 0
Jun 29 07:29:35.628: INFO: installer-5-ostest-l6xkl-master-1 started at 2020-06-29 06:43:36 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-6-ostest-l6xkl-master-1 started at 2020-06-29 06:44:59 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: node-ca-g9p9l started at 2020-06-29 06:45:15 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container node-ca ready: true, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-7-ostest-l6xkl-master-1 started at 2020-06-29 06:50:38 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: kuryr-dns-admission-controller-zxtdj started at 2020-06-29 06:37:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container kuryr-dns-admission-controller ready: true, restart count 0
Jun 29 07:29:35.628: INFO: etcd-ostest-l6xkl-master-1 started at 2020-06-29 06:41:32 -0400 EDT (2+4 container statuses recorded)
Jun 29 07:29:35.628: INFO: Init container etcd-ensure-env-vars ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Init container etcd-resources-copy ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container etcd ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container etcd-metrics ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container etcdctl ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container rollbackcopier ready: true, restart count 0
Jun 29 07:29:35.628: INFO: marketplace-operator-6bbbf88974-mvgzs started at 2020-06-29 06:44:38 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container marketplace-operator ready: true, restart count 0
Jun 29 07:29:35.628: INFO: tuned-tj2j9 started at 2020-06-29 06:39:02 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container tuned ready: true, restart count 0
Jun 29 07:29:35.628: INFO: openshift-kube-scheduler-ostest-l6xkl-master-1 started at 2020-06-29 06:43:29 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:35.628: INFO: Init container wait-for-host-port ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container kube-scheduler ready: true, restart count 1
Jun 29 07:29:35.628: INFO: Container kube-scheduler-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.628: INFO: installer-6-ostest-l6xkl-master-1 started at 2020-06-29 06:53:12 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.628: INFO: haproxy-ostest-l6xkl-master-1 started at 2020-06-29 06:34:23 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container haproxy ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container haproxy-monitor ready: true, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-3-ostest-l6xkl-master-1 started at 2020-06-29 06:40:44 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-3-ostest-l6xkl-master-1 started at 2020-06-29 06:44:14 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: installer-8-ostest-l6xkl-master-1 started at 2020-06-29 06:49:06 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.628: INFO: installer-7-ostest-l6xkl-master-1 started at 2020-06-29 06:54:53 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.628: INFO: service-ca-569778f696-4d4k8 started at 2020-06-29 06:39:47 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container service-ca-controller ready: true, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-4-ostest-l6xkl-master-1 started at 2020-06-29 06:43:34 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: cloud-credential-operator-7f77b8d467-xc9jl started at 2020-06-29 06:44:38 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container manager ready: true, restart count 0
Jun 29 07:29:35.628: INFO: ingress-operator-967c49d9f-qw4hx started at 2020-06-29 06:44:39 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container ingress-operator ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-8-ostest-l6xkl-master-1 started at 2020-06-29 06:50:37 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: etcd-quorum-guard-7846d75884-x68hf started at 2020-06-29 06:44:07 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container guard ready: true, restart count 0
Jun 29 07:29:35.628: INFO: revision-pruner-2-ostest-l6xkl-master-1 started at 2020-06-29 06:44:58 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.628: INFO: machine-config-daemon-9jwnx started at 2020-06-29 06:39:29 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.628: INFO: Container machine-config-daemon ready: true, restart count 0
Jun 29 07:29:35.628: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:35.628: INFO: catalog-operator-864ddb9bb4-wjzs2 started at 2020-06-29 06:38:28 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container catalog-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: machine-config-server-qtbd9 started at 2020-06-29 06:43:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container machine-config-server ready: true, restart count 0
Jun 29 07:29:35.629: INFO: revision-pruner-5-ostest-l6xkl-master-1 started at 2020-06-29 06:43:32 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.629: INFO: oauth-openshift-67979f764-rnxvk started at 2020-06-29 06:54:13 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container oauth-openshift ready: true, restart count 0
Jun 29 07:29:35.629: INFO: cluster-storage-operator-6547c8f6c4-fc4mp started at 2020-06-29 06:44:38 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container cluster-storage-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: controller-manager-hzbjc started at 2020-06-29 06:45:55 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container controller-manager ready: true, restart count 0
Jun 29 07:29:35.629: INFO: keepalived-ostest-l6xkl-master-1 started at 2020-06-29 06:34:24 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container keepalived ready: true, restart count 0
Jun 29 07:29:35.629: INFO: cluster-image-registry-operator-946c6b6f8-jh499 started at 2020-06-29 06:44:38 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container cluster-image-registry-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container cluster-image-registry-operator-watch ready: true, restart count 0
Jun 29 07:29:35.629: INFO: console-operator-568cd4b7cb-jpssq started at 2020-06-29 06:44:37 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container console-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: installer-3-ostest-l6xkl-master-1 started at 2020-06-29 06:40:11 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.629: INFO: installer-4-ostest-l6xkl-master-1 started at 2020-06-29 06:43:01 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.629: INFO: machine-api-operator-65b7f5ff98-27g4l started at 2020-06-29 06:44:39 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container machine-api-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: apiserver-6f55bcc488-dz6s4 started at 2020-06-29 06:45:45 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Init container fix-audit-permissions ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container openshift-apiserver ready: true, restart count 0
Jun 29 07:29:35.629: INFO: revision-pruner-7-ostest-l6xkl-master-1 started at 2020-06-29 06:55:38 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.629: INFO: multus-wx6cg started at 2020-06-29 06:37:03 -0400 EDT (5+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Init container multus-binary-copy ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Init container cni-plugins ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Init container routeoverride-cni ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Init container whereabouts-cni-bincopy ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Init container whereabouts-cni ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container kube-multus ready: true, restart count 0
Jun 29 07:29:35.629: INFO: kuryr-cni-ndbzp started at 2020-06-29 06:37:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container kuryr-cni ready: true, restart count 1
Jun 29 07:29:35.629: INFO: installer-5-ostest-l6xkl-master-1 started at 2020-06-29 06:46:44 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.629: INFO: mdns-publisher-ostest-l6xkl-master-1 started at 2020-06-29 06:34:24 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container mdns-publisher ready: true, restart count 0
Jun 29 07:29:35.629: INFO: installer-4-ostest-l6xkl-master-1 started at 2020-06-29 06:45:16 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.629: INFO: insights-operator-865674fcb7-htdzq started at 2020-06-29 06:44:38 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container operator ready: true, restart count 1
Jun 29 07:29:35.629: INFO: node-exporter-vtkns started at 2020-06-29 06:45:52 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:35.629: INFO: Init container init-textfile ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container node-exporter ready: true, restart count 0
Jun 29 07:29:35.629: INFO: kube-controller-manager-ostest-l6xkl-master-1 started at 2020-06-29 06:40:39 -0400 EDT (2+4 container statuses recorded)
Jun 29 07:29:35.629: INFO: Init container wait-for-host-port ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Init container wait-for-cpc-host-port ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container cluster-policy-controller ready: true, restart count 3
Jun 29 07:29:35.629: INFO: Container kube-controller-manager ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container kube-controller-manager-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container kube-controller-manager-recovery-controller ready: true, restart count 0
Jun 29 07:29:35.629: INFO: installer-7-ostest-l6xkl-master-1 started at 2020-06-29 06:49:32 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.629: INFO: dns-operator-896b54796-ftjbd started at 2020-06-29 06:38:28 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container dns-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.629: INFO: installer-6-ostest-l6xkl-master-1 started at 2020-06-29 06:43:36 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.629: INFO: cluster-monitoring-operator-bb5455699-rbgrf started at 2020-06-29 06:44:38 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container cluster-monitoring-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: revision-pruner-6-ostest-l6xkl-master-1 started at 2020-06-29 06:54:40 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.629: INFO: installer-3-ostest-l6xkl-master-1 started at 2020-06-29 06:42:35 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.629: INFO: multus-admission-controller-mwxwh started at 2020-06-29 06:38:27 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container multus-admission-controller ready: true, restart count 0
Jun 29 07:29:35.629: INFO: revision-pruner-5-ostest-l6xkl-master-1 started at 2020-06-29 06:45:00 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.629: INFO: cluster-autoscaler-operator-dd5596cc-jngfd started at 2020-06-29 06:47:06 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container cluster-autoscaler-operator ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.629: INFO: revision-pruner-5-ostest-l6xkl-master-1 started at 2020-06-29 06:48:04 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.629: INFO: coredns-ostest-l6xkl-master-1 started at 2020-06-29 06:34:23 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.629: INFO: Container coredns ready: true, restart count 0
Jun 29 07:29:35.629: INFO: downloads-56b865b565-pbv2d started at 2020-06-29 06:44:27 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container download-server ready: true, restart count 0
Jun 29 07:29:35.629: INFO: installer-2-ostest-l6xkl-master-1 started at 2020-06-29 06:41:09 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.629: INFO: Container installer ready: false, restart count 0
W0629 07:29:35.643117 438694 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Jun 29 07:29:35.814: INFO:
Latency metrics for node ostest-l6xkl-master-1
Jun 29 07:29:35.814: INFO:
Logging node info for node ostest-l6xkl-master-2
Jun 29 07:29:35.824: INFO: Node Info: &Node{ObjectMeta:{ostest-l6xkl-master-2 /api/v1/nodes/ostest-l6xkl-master-2 6a571374-ef52-4060-86f6-edcf42d6dd97 35435 0 2020-06-29 06:34:15 -0400 EDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:m4.xlarge beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/zone:nova kubernetes.io/arch:amd64 kubernetes.io/hostname:ostest-l6xkl-master-2 kubernetes.io/os:linux node-role.kubernetes.io/master: node.kubernetes.io/instance-type:m4.xlarge node.openshift.io/os_id:rhcos topology.kubernetes.io/zone:nova] map[machine.openshift.io/machine:openshift-machine-api/ostest-l6xkl-master-2 machineconfiguration.openshift.io/currentConfig:rendered-master-e8dc97609266174245f6dd96b2ac8f94 machineconfiguration.openshift.io/desiredConfig:rendered-master-e8dc97609266174245f6dd96b2ac8f94 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:openstack://dc044127-b250-4c9a-afa7-499913a1e410,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{42384470016 0} {<nil>} 41391084Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16815423488 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Allocatable:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{3500 -3} {<nil>} 3500m DecimalSI},ephemeral-storage: {{37072281128 0} {<nil>} 37072281128 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15636824064 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-06-29 07:25:02 -0400 EDT,LastTransitionTime:2020-06-29 06:34:15 -0400 EDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-06-29 07:25:02 -0400 EDT,LastTransitionTime:2020-06-29 06:34:15 -0400 EDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-06-29 07:25:02 -0400 EDT,LastTransitionTime:2020-06-29 06:34:15 -0400 EDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-06-29 07:25:02 -0400 EDT,LastTransitionTime:2020-06-29 06:38:35 -0400 EDT,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:ostest-l6xkl-master-2,},NodeAddress{Type:InternalIP,Address:10.196.0.249,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:dc044127b2504c9aafa7499913a1e410,SystemUUID:dc044127-b250-4c9a-afa7-499913a1e410,BootID:64c7f237-7d74-4a5b-8aec-1cc851fa0c26,KernelVersion:4.18.0-147.20.1.el8_1.x86_64,OSImage:Red Hat Enterprise Linux CoreOS 44.81.202006271430-0 (Ootpa),ContainerRuntimeVersion:cri-o://1.17.4-18.dev.rhaos4.4.gitfb8131a.el8,KubeletVersion:v1.17.1+1aa1c48,KubeProxyVersion:v1.17.1+1aa1c48,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f5f1f1566ea8ec07e9b15ff46d1767ee49148205f26a6de6aa168d8c853d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:872290769,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b097ff30213109b123d024a442deb00aa5fab5d035ad4a149365ca3399fb1375 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:677943167,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f4b8c2c1e258b6a17a4a02c3d9660dd2f9bc3323a386131f86b70e71a4b2d00a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:651228269,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5dc00078f4b78f907f0fb6cb94b7f71984fd6888cade27d0ea6817f00d6d4f3 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:608014211,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0a47fb26cd52ba22dd7fc963e74c105d5b6e091ab7922a4766efb4e63f52bb6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:467326588,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4f551588a89a7f2f8d39bc766be1ce5f688ee166f4d19bfa45e87a955cb3a0db quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:461969109,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e92e2fada5baf7bf6336d366a4817394cefa0f43bf3de881c0bcb6f5c555a38 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:429897331,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d478d1a212bd1a2a5bd14e36e0fd740607c4097c7498d7afea028b8eec699755 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:364474354,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6f08fc136335179470a1fa8351137f3c89447540bc0b9c747dedb4d186a70d55 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:354185368,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6ecb98c9a40eb5c0f69fbb66ea5c77e451e6d2c5ffc2c529781490ff9da3223 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:342626046,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbf4b2d6fa1a405387bea55db2a293fb196e3808d61a269b1bf5b00dfe054997 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:338257579,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c93ab547a5f6fb1110ea190ff1e9f76b9c3400234ec91e38b40db187ec6a1cb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:333703633,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7cb23c271c3b40a1733f7ae366167cdb91050a449c263811c066f582b772054c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325673898,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80b81897621f119d1cc459dbcd2c6eeec5c8211c77e1ac86bea7f04e22c55c68 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:324521511,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:633e031d8ae1e6f5954c01984849ee8ffd251e587a0ace0b455d43464d20abb0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:322181042,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1afa7bad421bf89937557098854c12d111b8b01b0ba50fc4e9581e87bda4af97 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:321048085,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be8b79f4e4a00c54194d278133fbf1abcfbcd77025984039251bd582a84b4070 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318699317,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f713807d89802682d410f2b93d525a139eeffa9273ce7bab80c4441feff35825 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318048395,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1cfcdb3c2406c10e980eabd454ef2640877b15d6576e7dfae2beaf129ec94f03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:305583473,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76c30df17a5c6157fcf6683a96ec2a7b0eee59434646472cf5be1acf90c3cf6c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:303804001,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:86cff84c1cffbe966ae78097aa67e2bdacc5148a19aee7e4c65582640bb4a36d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:303286374,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:850ab358446406d3d946aa170bbc510c900a7b6b716a060da3c66ad5cfcd9ab4 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:302920229,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6b00c21cd64212818879441d0ba7c6d1f56f5a4e5de0a1d44d8c18b947d9db8e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:302446757,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:05f8e6d1f6d516eb96e7b0a692562a8bae4648f55fd9adcc954b5e782f1bfc0d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:300628574,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233886ae12eca510dfe3bdf9d2e7517b1e7ee1d41eda6919b66569b11b328d0c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299604026,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24287276201fe8f5f7905e7c32305487a288dd2c760f9031ce9411977f0bc96d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299510340,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:822a6a24b18812bd6b2ea20f72975f950b4fdd5d3f83c041315587278fa0d057 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:292632495,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd63ad820df576afc0b5d5a06f5a6634d589c0b8158c817c26e6c748a90e5caf quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:292609669,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1e063194c5d539d0526d6e70113149baa567cf8c02ce290435dfd4fe0a3db44 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:289660091,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1646a137032c219c2841c5b46577dc98e1e84e50e4f14ff66cf9d40b8acd0be7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:286927581,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ccce1c6c856a113d219a284ad9bc3f89c1f49f124a42c02a9c087f1d23fe8ba quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:283435012,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1de153bc8773f9857efbb092f0e2756a6d253c0cb5189310641c9eda0ef8c61 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:267611081,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51d2c485bb848c6fb8cfc65d2a834a059ef97ed1241f6f5a85e19094ebb64d60 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:264205161,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bb48291f2937c1a0bf84eee5f26fc98d400e5242ee75afc4e6a3c5b75e7a03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:255814539,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec70cc0697d893d2b5c83b11e0888488a6c7556a945da11b59015ad69f98a62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:251028388,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52686d7a2b9ffbc8619ba2a4835dd91bab71f52a4a959144ec7bde5a3ed04004 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:237302018,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jun 29 07:29:35.825: INFO:
Logging kubelet events for node ostest-l6xkl-master-2
Jun 29 07:29:35.832: INFO:
Logging pods the kubelet thinks is on node ostest-l6xkl-master-2
Jun 29 07:29:35.910: INFO: mdns-publisher-ostest-l6xkl-master-2 started at 2020-06-29 06:33:54 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container mdns-publisher ready: true, restart count 0
Jun 29 07:29:35.910: INFO: etcd-quorum-guard-7846d75884-g575f started at 2020-06-29 06:44:07 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container guard ready: true, restart count 0
Jun 29 07:29:35.910: INFO: installer-4-ostest-l6xkl-master-2 started at 2020-06-29 06:44:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.910: INFO: network-operator-c478cc6db-r8jp9 started at 2020-06-29 06:34:15 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container network-operator ready: true, restart count 0
Jun 29 07:29:35.910: INFO: installer-2-ostest-l6xkl-master-2 started at 2020-06-29 06:42:09 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.910: INFO: installer-7-ostest-l6xkl-master-2 started at 2020-06-29 06:55:52 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.910: INFO: coredns-ostest-l6xkl-master-2 started at 2020-06-29 06:33:54 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container coredns ready: true, restart count 0
Jun 29 07:29:35.910: INFO: machine-config-daemon-cc5gd started at 2020-06-29 06:39:29 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container machine-config-daemon ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:35.910: INFO: dns-default-zjrxm started at 2020-06-29 06:42:53 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container dns ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container dns-node-resolver ready: true, restart count 0
Jun 29 07:29:35.910: INFO: revision-pruner-6-ostest-l6xkl-master-2 started at 2020-06-29 06:47:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.910: INFO: controller-manager-jzg9l started at 2020-06-29 06:46:14 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container controller-manager ready: true, restart count 0
Jun 29 07:29:35.910: INFO: console-5584bd86cd-b98qt started at 2020-06-29 06:56:01 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container console ready: true, restart count 0
Jun 29 07:29:35.910: INFO: kuryr-controller-795b7b94c5-mrmg6 started at 2020-06-29 06:37:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container controller ready: true, restart count 0
Jun 29 07:29:35.910: INFO: kuryr-dns-admission-controller-ndznd started at 2020-06-29 06:37:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container kuryr-dns-admission-controller ready: true, restart count 0
Jun 29 07:29:35.910: INFO: node-ca-9blsc started at 2020-06-29 06:45:15 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container node-ca ready: true, restart count 0
Jun 29 07:29:35.910: INFO: kube-controller-manager-ostest-l6xkl-master-2 started at 2020-06-29 06:41:13 -0400 EDT (2+4 container statuses recorded)
Jun 29 07:29:35.910: INFO: Init container wait-for-host-port ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Init container wait-for-cpc-host-port ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container cluster-policy-controller ready: true, restart count 3
Jun 29 07:29:35.910: INFO: Container kube-controller-manager ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container kube-controller-manager-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container kube-controller-manager-recovery-controller ready: true, restart count 0
Jun 29 07:29:35.910: INFO: tuned-lcqhp started at 2020-06-29 06:39:02 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container tuned ready: true, restart count 0
Jun 29 07:29:35.910: INFO: installer-5-ostest-l6xkl-master-2 started at 2020-06-29 06:45:03 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.910: INFO: cluster-samples-operator-6bb8f4f7d9-8k5jw started at 2020-06-29 06:47:11 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container cluster-samples-operator ready: true, restart count 0
Jun 29 07:29:35.910: INFO: Container cluster-samples-operator-watch ready: true, restart count 0
Jun 29 07:29:35.910: INFO: revision-pruner-7-ostest-l6xkl-master-2 started at 2020-06-29 06:58:13 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.910: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.910: INFO: installer-6-ostest-l6xkl-master-2 started at 2020-06-29 06:45:04 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-7-ostest-l6xkl-master-2 started at 2020-06-29 06:47:36 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: machine-config-server-pd5cl started at 2020-06-29 06:43:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container machine-config-server ready: true, restart count 0
Jun 29 07:29:35.911: INFO: keepalived-ostest-l6xkl-master-2 started at 2020-06-29 06:33:54 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container keepalived ready: true, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-3-ostest-l6xkl-master-2 started at 2020-06-29 06:41:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: installer-8-ostest-l6xkl-master-2 started at 2020-06-29 06:50:40 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: installer-7-ostest-l6xkl-master-2 started at 2020-06-29 06:46:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: oauth-openshift-67979f764-mlwnw started at 2020-06-29 06:54:13 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container oauth-openshift ready: true, restart count 0
Jun 29 07:29:35.911: INFO: installer-3-ostest-l6xkl-master-2 started at 2020-06-29 06:40:46 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-2-ostest-l6xkl-master-2 started at 2020-06-29 06:41:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-2-ostest-l6xkl-master-2 started at 2020-06-29 06:45:00 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: apiserver-6f55bcc488-9dc2x started at 2020-06-29 06:46:54 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Init container fix-audit-permissions ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container openshift-apiserver ready: true, restart count 0
Jun 29 07:29:35.911: INFO: packageserver-cc79b64fb-dch69 started at 2020-06-29 06:43:16 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container packageserver ready: true, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-6-ostest-l6xkl-master-2 started at 2020-06-29 06:46:10 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: multus-v26l6 started at 2020-06-29 06:37:02 -0400 EDT (5+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Init container multus-binary-copy ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Init container cni-plugins ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Init container routeoverride-cni ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Init container whereabouts-cni-bincopy ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Init container whereabouts-cni ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container kube-multus ready: true, restart count 0
Jun 29 07:29:35.911: INFO: installer-6-ostest-l6xkl-master-2 started at 2020-06-29 06:46:07 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: haproxy-ostest-l6xkl-master-2 started at 2020-06-29 06:33:54 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container haproxy ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container haproxy-monitor ready: true, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-4-ostest-l6xkl-master-2 started at 2020-06-29 06:44:53 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-5-ostest-l6xkl-master-2 started at 2020-06-29 06:46:03 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: installer-6-ostest-l6xkl-master-2 started at 2020-06-29 06:50:33 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: openshift-kube-scheduler-ostest-l6xkl-master-2 started at 2020-06-29 06:41:11 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:35.911: INFO: Init container wait-for-host-port ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container kube-scheduler ready: true, restart count 1
Jun 29 07:29:35.911: INFO: Container kube-scheduler-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.911: INFO: prometheus-operator-d854799bb-zkvmr started at 2020-06-29 06:51:11 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container prometheus-operator ready: true, restart count 0
Jun 29 07:29:35.911: INFO: kube-apiserver-ostest-l6xkl-master-2 started at 2020-06-29 06:40:54 -0400 EDT (1+4 container statuses recorded)
Jun 29 07:29:35.911: INFO: Init container setup ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container kube-apiserver ready: true, restart count 4
Jun 29 07:29:35.911: INFO: Container kube-apiserver-cert-regeneration-controller ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container kube-apiserver-cert-syncer ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container kube-apiserver-insecure-readyz ready: true, restart count 0
Jun 29 07:29:35.911: INFO: kuryr-cni-5kmxg started at 2020-06-29 06:37:08 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container kuryr-cni ready: true, restart count 0
Jun 29 07:29:35.911: INFO: installer-2-ostest-l6xkl-master-2 started at 2020-06-29 06:40:26 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: node-exporter-p89sk started at 2020-06-29 06:45:52 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:35.911: INFO: Init container init-textfile ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container node-exporter ready: true, restart count 0
Jun 29 07:29:35.911: INFO: installer-7-ostest-l6xkl-master-2 started at 2020-06-29 06:50:42 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-4-ostest-l6xkl-master-2 started at 2020-06-29 06:41:18 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: etcd-ostest-l6xkl-master-2 started at 2020-06-29 06:43:35 -0400 EDT (2+4 container statuses recorded)
Jun 29 07:29:35.911: INFO: Init container etcd-ensure-env-vars ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Init container etcd-resources-copy ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container etcd ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container etcd-metrics ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container etcdctl ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container rollbackcopier ready: true, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-7-ostest-l6xkl-master-2 started at 2020-06-29 06:51:50 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: multus-admission-controller-4zx2c started at 2020-06-29 06:38:35 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:35.911: INFO: Container multus-admission-controller ready: true, restart count 0
Jun 29 07:29:35.911: INFO: installer-4-ostest-l6xkl-master-2 started at 2020-06-29 06:40:46 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container installer ready: false, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-8-ostest-l6xkl-master-2 started at 2020-06-29 06:51:54 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
Jun 29 07:29:35.911: INFO: revision-pruner-6-ostest-l6xkl-master-2 started at 2020-06-29 06:52:52 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:35.911: INFO: Container pruner ready: false, restart count 0
W0629 07:29:35.926477 438694 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Jun 29 07:29:35.989: INFO:
Latency metrics for node ostest-l6xkl-master-2
Jun 29 07:29:35.989: INFO:
Logging node info for node ostest-l6xkl-worker-p6h8f
Jun 29 07:29:35.997: INFO: Node Info: &Node{ObjectMeta:{ostest-l6xkl-worker-p6h8f /api/v1/nodes/ostest-l6xkl-worker-p6h8f 113812d1-2192-489b-93a5-9b5035d46804 36964 0 2020-06-29 06:52:35 -0400 EDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:m4.xlarge beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/zone:nova kubernetes.io/arch:amd64 kubernetes.io/hostname:ostest-l6xkl-worker-p6h8f kubernetes.io/os:linux node-role.kubernetes.io/worker: node.kubernetes.io/instance-type:m4.xlarge node.openshift.io/os_id:rhcos topology.kubernetes.io/zone:nova] map[machine.openshift.io/machine:openshift-machine-api/ostest-l6xkl-worker-p6h8f machineconfiguration.openshift.io/currentConfig:rendered-worker-eb23884ace4dd0f3968f6f0f229f6640 machineconfiguration.openshift.io/desiredConfig:rendered-worker-eb23884ace4dd0f3968f6f0f229f6640 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:openstack://99d86c63-aba9-4e64-a0b0-38f563396f7d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{42384470016 0} {<nil>} 41391084Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16815423488 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Allocatable:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{3500 -3} {<nil>} 3500m DecimalSI},ephemeral-storage: {{37072281128 0} {<nil>} 37072281128 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15636824064 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-06-29 07:28:58 -0400 EDT,LastTransitionTime:2020-06-29 06:52:35 -0400 EDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-06-29 07:28:58 -0400 EDT,LastTransitionTime:2020-06-29 06:52:35 -0400 EDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-06-29 07:28:58 -0400 EDT,LastTransitionTime:2020-06-29 06:52:35 -0400 EDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-06-29 07:28:58 -0400 EDT,LastTransitionTime:2020-06-29 06:53:55 -0400 EDT,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:ostest-l6xkl-worker-p6h8f,},NodeAddress{Type:InternalIP,Address:10.196.1.21,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:99d86c63aba94e64a0b038f563396f7d,SystemUUID:99d86c63-aba9-4e64-a0b0-38f563396f7d,BootID:09bcd004-a261-4c9b-82dc-356225211189,KernelVersion:4.18.0-147.20.1.el8_1.x86_64,OSImage:Red Hat Enterprise Linux CoreOS 44.81.202006271430-0 (Ootpa),ContainerRuntimeVersion:cri-o://1.17.4-18.dev.rhaos4.4.gitfb8131a.el8,KubeletVersion:v1.17.1+1aa1c48,KubeProxyVersion:v1.17.1+1aa1c48,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f5f1f1566ea8ec07e9b15ff46d1767ee49148205f26a6de6aa168d8c853d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:872290769,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b097ff30213109b123d024a442deb00aa5fab5d035ad4a149365ca3399fb1375 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:677943167,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0a47fb26cd52ba22dd7fc963e74c105d5b6e091ab7922a4766efb4e63f52bb6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:467326588,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cb6ec49ff1f0c2554323e7a3e6b842fc8029af77a8de14e7736cb2c3e111cd3a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:454036191,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e92e2fada5baf7bf6336d366a4817394cefa0f43bf3de881c0bcb6f5c555a38 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:429897331,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:963fe01272ee5fe6deeafa453087f981733c3277944f6d103fd246ea6e21e1a6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:367543661,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d478d1a212bd1a2a5bd14e36e0fd740607c4097c7498d7afea028b8eec699755 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:364474354,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6ecb98c9a40eb5c0f69fbb66ea5c77e451e6d2c5ffc2c529781490ff9da3223 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:342626046,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbf4b2d6fa1a405387bea55db2a293fb196e3808d61a269b1bf5b00dfe054997 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:338257579,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c93ab547a5f6fb1110ea190ff1e9f76b9c3400234ec91e38b40db187ec6a1cb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:333703633,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7cb23c271c3b40a1733f7ae366167cdb91050a449c263811c066f582b772054c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325673898,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be8b79f4e4a00c54194d278133fbf1abcfbcd77025984039251bd582a84b4070 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318699317,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f8d5e19bd9abfe3388e6a0e5220f442d10e4974dc129a7e8c5a4e4559a7a9ca quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318185076,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f713807d89802682d410f2b93d525a139eeffa9273ce7bab80c4441feff35825 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318048395,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1cfcdb3c2406c10e980eabd454ef2640877b15d6576e7dfae2beaf129ec94f03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:305583473,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24287276201fe8f5f7905e7c32305487a288dd2c760f9031ce9411977f0bc96d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299510340,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0b718c1dbbce0e500ada9da96c226fda9c945498fadfb2643fd8bba5aacdc4f quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:296964524,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc0d8606e11adf6fdcc5fb1cc703186b9860d56efe11a898841ae87ca9d722f5 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:296596118,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cab7d794cde59b44fa9a3de07445961d4440f801fd854bf530852fdb5a20a914 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:289298460,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ccce1c6c856a113d219a284ad9bc3f89c1f49f124a42c02a9c087f1d23fe8ba quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:283435012,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:893be4bb33670aa9baa406e0626cd5a5c9e0d3016fdf2b809a47b0c23a294cf9 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:280848334,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8b349f70a383da6e74fa637c9d17f6a8fe2078a497cee65d46fedb97a2e17e68 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:277331031,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1d0625baceaa276b4520973916d11dcf15f8816155f0b87e398c8fdab2f3f135 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:277153808,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:229d2c63f30a59b446c229b37d810e23c972970e5cd496c9c62b066f8cf4c1a7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:276837709,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1de153bc8773f9857efbb092f0e2756a6d253c0cb5189310641c9eda0ef8c61 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:267611081,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51d2c485bb848c6fb8cfc65d2a834a059ef97ed1241f6f5a85e19094ebb64d60 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:264205161,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:72b80cd480bb49dfa28ce72e082d69d62b23594db2c0c9e6a0a35ddbf477e4de quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:258193954,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bb48291f2937c1a0bf84eee5f26fc98d400e5242ee75afc4e6a3c5b75e7a03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:255814539,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec70cc0697d893d2b5c83b11e0888488a6c7556a945da11b59015ad69f98a62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:251028388,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52686d7a2b9ffbc8619ba2a4835dd91bab71f52a4a959144ec7bde5a3ed04004 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:237302018,},ContainerImage{Names:[docker.io/library/busybox@sha256:d6975a0407b0ee34bc87c39d8b0ac20b03b8db04a0492fc11c8804ce42fc2ca6 docker.io/library/busybox@sha256:de4ef44705626db7abd9a585b186dd9577ce80288c7003a7d5eae8272b784615 docker.io/library/busybox:1.29-glibc],SizeBytes:4646709,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jun 29 07:29:35.997: INFO:
Logging kubelet events for node ostest-l6xkl-worker-p6h8f
Jun 29 07:29:36.019: INFO:
Logging pods the kubelet thinks is on node ostest-l6xkl-worker-p6h8f
Jun 29 07:29:36.096: INFO: node-ca-wlvgx started at 2020-06-29 06:52:36 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.096: INFO: Container node-ca ready: true, restart count 0
Jun 29 07:29:36.096: INFO: redhat-operators-7ff767fcdf-fb5kg started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.096: INFO: Container redhat-operators ready: true, restart count 0
Jun 29 07:29:36.096: INFO: client-a-4dtmq started at 2020-06-29 07:26:35 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.096: INFO: Container client-a-container ready: false, restart count 0
Jun 29 07:29:36.096: INFO: csi-snapshot-controller-6795c9c6c6-r7jc4 started at 2020-06-29 06:54:32 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.096: INFO: Container snapshot-controller ready: true, restart count 0
Jun 29 07:29:36.096: INFO: node-exporter-z5bbv started at 2020-06-29 06:52:36 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:36.096: INFO: Init container init-textfile ready: true, restart count 0
Jun 29 07:29:36.096: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.096: INFO: Container node-exporter ready: true, restart count 0
Jun 29 07:29:36.096: INFO: image-registry-686864d6c-vq7h6 started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.096: INFO: Container registry ready: true, restart count 0
Jun 29 07:29:36.096: INFO: dns-default-gdj4b started at 2020-06-29 06:53:56 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.096: INFO: Container dns ready: true, restart count 0
Jun 29 07:29:36.096: INFO: Container dns-node-resolver ready: true, restart count 0
Jun 29 07:29:36.096: INFO: router-default-6d4db7d75b-z7j8t started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.096: INFO: Container router ready: true, restart count 0
Jun 29 07:29:36.096: INFO: prometheus-adapter-7dbd479cdc-bj9x6 started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container prometheus-adapter ready: true, restart count 0
Jun 29 07:29:36.097: INFO: kube-state-metrics-b77bd6dc7-plqmb started at 2020-06-29 06:53:56 -0400 EDT (0+3 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container kube-rbac-proxy-main ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container kube-rbac-proxy-self ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container kube-state-metrics ready: true, restart count 0
Jun 29 07:29:36.097: INFO: redhat-marketplace-674c447c68-rdmdv started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container redhat-marketplace ready: true, restart count 0
Jun 29 07:29:36.097: INFO: coredns-ostest-l6xkl-worker-p6h8f started at 2020-06-29 06:51:25 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container coredns ready: true, restart count 0
Jun 29 07:29:36.097: INFO: mdns-publisher-ostest-l6xkl-worker-p6h8f started at 2020-06-29 06:51:25 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container mdns-publisher ready: true, restart count 0
Jun 29 07:29:36.097: INFO: tuned-7w65w started at 2020-06-29 06:52:36 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container tuned ready: true, restart count 0
Jun 29 07:29:36.097: INFO: image-registry-686864d6c-w5mzc started at 2020-06-29 06:54:13 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container registry ready: true, restart count 0
Jun 29 07:29:36.097: INFO: multus-5tr7j started at 2020-06-29 06:52:36 -0400 EDT (5+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Init container multus-binary-copy ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Init container cni-plugins ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Init container routeoverride-cni ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Init container whereabouts-cni-bincopy ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Init container whereabouts-cni ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container kube-multus ready: true, restart count 0
Jun 29 07:29:36.097: INFO: community-operators-6446fd5669-fzx82 started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container community-operators ready: true, restart count 0
Jun 29 07:29:36.097: INFO: certified-operators-6657bb66c7-drlhn started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container certified-operators ready: true, restart count 0
Jun 29 07:29:36.097: INFO: openshift-state-metrics-55998d56fc-56vc8 started at 2020-06-29 06:53:57 -0400 EDT (0+3 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container kube-rbac-proxy-main ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container kube-rbac-proxy-self ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container openshift-state-metrics ready: true, restart count 0
Jun 29 07:29:36.097: INFO: alertmanager-main-0 started at 2020-06-29 06:58:25 -0400 EDT (0+3 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container alertmanager ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container alertmanager-proxy ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container config-reloader ready: true, restart count 0
Jun 29 07:29:36.097: INFO: keepalived-ostest-l6xkl-worker-p6h8f started at 2020-06-29 06:51:25 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container keepalived ready: true, restart count 0
Jun 29 07:29:36.097: INFO: kuryr-cni-vt7dw started at 2020-06-29 06:52:36 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container kuryr-cni ready: true, restart count 1
Jun 29 07:29:36.097: INFO: telemeter-client-84fb58c4b8-mq5tn started at 2020-06-29 06:53:56 -0400 EDT (0+3 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container reload ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container telemeter-client ready: true, restart count 0
Jun 29 07:29:36.097: INFO: migrator-5679579c64-52qq8 started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container migrator ready: true, restart count 0
Jun 29 07:29:36.097: INFO: machine-config-daemon-kztc7 started at 2020-06-29 06:52:35 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container machine-config-daemon ready: true, restart count 0
Jun 29 07:29:36.097: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:36.097: INFO: prometheus-adapter-7dbd479cdc-8h8j7 started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container prometheus-adapter ready: true, restart count 0
Jun 29 07:29:36.097: INFO: csi-snapshot-controller-operator-5b5d4d6fb5-5knp7 started at 2020-06-29 06:53:56 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.097: INFO: Container operator ready: true, restart count 0
W0629 07:29:36.112021 438694 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Jun 29 07:29:36.207: INFO:
Latency metrics for node ostest-l6xkl-worker-p6h8f
Jun 29 07:29:36.207: INFO:
Logging node info for node ostest-l6xkl-worker-smbbl
Jun 29 07:29:36.216: INFO: Node Info: &Node{ObjectMeta:{ostest-l6xkl-worker-smbbl /api/v1/nodes/ostest-l6xkl-worker-smbbl a7559b91-234c-4847-b22f-f401131e1fa7 36489 0 2020-06-29 06:53:30 -0400 EDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:m4.xlarge beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/zone:nova kubernetes.io/arch:amd64 kubernetes.io/hostname:ostest-l6xkl-worker-smbbl kubernetes.io/os:linux node-role.kubernetes.io/worker: node.kubernetes.io/instance-type:m4.xlarge node.openshift.io/os_id:rhcos topology.kubernetes.io/zone:nova] map[machine.openshift.io/machine:openshift-machine-api/ostest-l6xkl-worker-smbbl machineconfiguration.openshift.io/currentConfig:rendered-worker-eb23884ace4dd0f3968f6f0f229f6640 machineconfiguration.openshift.io/desiredConfig:rendered-worker-eb23884ace4dd0f3968f6f0f229f6640 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:openstack://0b74b1af-f280-4341-9d46-9ea7bdf24496,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{42384470016 0} {<nil>} 41391084Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16815423488 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Allocatable:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{3500 -3} {<nil>} 3500m DecimalSI},ephemeral-storage: {{37072281128 0} {<nil>} 37072281128 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15636824064 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-06-29 07:27:53 -0400 EDT,LastTransitionTime:2020-06-29 06:53:30 -0400 EDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-06-29 07:27:53 -0400 EDT,LastTransitionTime:2020-06-29 06:53:30 -0400 EDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-06-29 07:27:53 -0400 EDT,LastTransitionTime:2020-06-29 06:53:30 -0400 EDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-06-29 07:27:53 -0400 EDT,LastTransitionTime:2020-06-29 06:54:50 -0400 EDT,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:ostest-l6xkl-worker-smbbl,},NodeAddress{Type:InternalIP,Address:10.196.1.134,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:0b74b1aff28043419d469ea7bdf24496,SystemUUID:0b74b1af-f280-4341-9d46-9ea7bdf24496,BootID:8482d739-a1e1-4372-896c-0851bef47d96,KernelVersion:4.18.0-147.20.1.el8_1.x86_64,OSImage:Red Hat Enterprise Linux CoreOS 44.81.202006271430-0 (Ootpa),ContainerRuntimeVersion:cri-o://1.17.4-18.dev.rhaos4.4.gitfb8131a.el8,KubeletVersion:v1.17.1+1aa1c48,KubeProxyVersion:v1.17.1+1aa1c48,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f5f1f1566ea8ec07e9b15ff46d1767ee49148205f26a6de6aa168d8c853d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:872290769,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b097ff30213109b123d024a442deb00aa5fab5d035ad4a149365ca3399fb1375 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:677943167,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0a47fb26cd52ba22dd7fc963e74c105d5b6e091ab7922a4766efb4e63f52bb6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:467326588,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e92e2fada5baf7bf6336d366a4817394cefa0f43bf3de881c0bcb6f5c555a38 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:429897331,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:963fe01272ee5fe6deeafa453087f981733c3277944f6d103fd246ea6e21e1a6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:367543661,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d478d1a212bd1a2a5bd14e36e0fd740607c4097c7498d7afea028b8eec699755 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:364474354,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6ecb98c9a40eb5c0f69fbb66ea5c77e451e6d2c5ffc2c529781490ff9da3223 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:342626046,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbf4b2d6fa1a405387bea55db2a293fb196e3808d61a269b1bf5b00dfe054997 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:338257579,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b159beb6abe48be63ae129575fcf9d552bd08f44208bcbf66d851cbf058c0f4a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:334914435,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c93ab547a5f6fb1110ea190ff1e9f76b9c3400234ec91e38b40db187ec6a1cb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:333703633,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:549bd48582a9fa615b8728bc6e1d66f3a9c829f415d9ddd58f95eb978be50274 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325706274,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7cb23c271c3b40a1733f7ae366167cdb91050a449c263811c066f582b772054c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325673898,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be8b79f4e4a00c54194d278133fbf1abcfbcd77025984039251bd582a84b4070 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318699317,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f713807d89802682d410f2b93d525a139eeffa9273ce7bab80c4441feff35825 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318048395,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:569fc5846c8b59b0488823a99a17b2354bf7d532418958c06aadd177186fed15 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:311016402,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1cfcdb3c2406c10e980eabd454ef2640877b15d6576e7dfae2beaf129ec94f03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:305583473,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:24287276201fe8f5f7905e7c32305487a288dd2c760f9031ce9411977f0bc96d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:299510340,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ccce1c6c856a113d219a284ad9bc3f89c1f49f124a42c02a9c087f1d23fe8ba quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:283435012,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:229d2c63f30a59b446c229b37d810e23c972970e5cd496c9c62b066f8cf4c1a7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:276837709,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1de153bc8773f9857efbb092f0e2756a6d253c0cb5189310641c9eda0ef8c61 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:267611081,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51d2c485bb848c6fb8cfc65d2a834a059ef97ed1241f6f5a85e19094ebb64d60 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:264205161,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:72b80cd480bb49dfa28ce72e082d69d62b23594db2c0c9e6a0a35ddbf477e4de quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:258193954,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d8469257c72f4d4deb8f2d72802488645360182a186f43c21746202b09f41ad quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:257198663,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bb48291f2937c1a0bf84eee5f26fc98d400e5242ee75afc4e6a3c5b75e7a03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:255814539,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec70cc0697d893d2b5c83b11e0888488a6c7556a945da11b59015ad69f98a62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:251028388,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:47b150b2d79c5eebbf6e9bd189daa4c5d7a412c926ba258898b0af071c33f6e9 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:243281399,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52686d7a2b9ffbc8619ba2a4835dd91bab71f52a4a959144ec7bde5a3ed04004 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:237302018,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:02b9e10ea1f7439a03d9bc3ee16d984172ca7eac1818792ad4d721c5c8f72ff4 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:55378871,},ContainerImage{Names:[docker.io/library/busybox@sha256:d6975a0407b0ee34bc87c39d8b0ac20b03b8db04a0492fc11c8804ce42fc2ca6 docker.io/library/busybox@sha256:de4ef44705626db7abd9a585b186dd9577ce80288c7003a7d5eae8272b784615 docker.io/library/busybox:1.29-glibc],SizeBytes:4646709,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jun 29 07:29:36.216: INFO:
Logging kubelet events for node ostest-l6xkl-worker-smbbl
Jun 29 07:29:36.226: INFO:
Logging pods the kubelet thinks is on node ostest-l6xkl-worker-smbbl
Jun 29 07:29:36.304: INFO: alertmanager-main-1 started at 2020-06-29 06:57:48 -0400 EDT (0+3 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container alertmanager ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container alertmanager-proxy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container config-reloader ready: true, restart count 0
Jun 29 07:29:36.304: INFO: thanos-querier-67fcdb4899-8vb54 started at 2020-06-29 06:59:10 -0400 EDT (0+4 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container prom-label-proxy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container thanos-querier ready: true, restart count 0
Jun 29 07:29:36.304: INFO: client-a-nvtqj started at 2020-06-29 07:29:20 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container client-a-container ready: true, restart count 0
Jun 29 07:29:36.304: INFO: client-can-connect-80-ngh86 started at 2020-06-29 07:29:33 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container client-can-connect-80-container ready: false, restart count 0
Jun 29 07:29:36.304: INFO: multus-c9zd2 started at 2020-06-29 06:53:30 -0400 EDT (5+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Init container multus-binary-copy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Init container cni-plugins ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Init container routeoverride-cni ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Init container whereabouts-cni-bincopy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Init container whereabouts-cni ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container kube-multus ready: true, restart count 0
Jun 29 07:29:36.304: INFO: dns-default-6ckvk started at 2020-06-29 06:54:52 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container dns ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container dns-node-resolver ready: true, restart count 0
Jun 29 07:29:36.304: INFO: machine-config-daemon-4nq2x started at 2020-06-29 06:53:30 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container machine-config-daemon ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: node-ca-jdbfz started at 2020-06-29 06:53:30 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container node-ca ready: true, restart count 0
Jun 29 07:29:36.304: INFO: keepalived-ostest-l6xkl-worker-smbbl started at 2020-06-29 06:52:20 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container keepalived ready: true, restart count 0
Jun 29 07:29:36.304: INFO: tuned-pbbnl started at 2020-06-29 06:53:30 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container tuned ready: true, restart count 0
Jun 29 07:29:36.304: INFO: node-exporter-gvsvw started at 2020-06-29 06:53:30 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:36.304: INFO: Init container init-textfile ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container node-exporter ready: true, restart count 0
Jun 29 07:29:36.304: INFO: router-default-6d4db7d75b-kdllx started at 2020-06-29 06:54:52 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container router ready: true, restart count 0
Jun 29 07:29:36.304: INFO: server-4bm6s started at 2020-06-29 07:28:51 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.304: INFO: Container server-container-80 ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container server-container-81 ready: true, restart count 0
Jun 29 07:29:36.304: INFO: coredns-ostest-l6xkl-worker-smbbl started at 2020-06-29 06:52:20 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.304: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.304: INFO: Container coredns ready: true, restart count 0
Jun 29 07:29:36.304: INFO: kuryr-cni-fzp99 started at 2020-06-29 06:53:30 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.305: INFO: Container kuryr-cni ready: true, restart count 0
Jun 29 07:29:36.305: INFO: prometheus-k8s-0 started at 2020-06-29 06:59:30 -0400 EDT (0+7 container statuses recorded)
Jun 29 07:29:36.305: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.305: INFO: Container prom-label-proxy ready: true, restart count 0
Jun 29 07:29:36.305: INFO: Container prometheus ready: true, restart count 1
Jun 29 07:29:36.305: INFO: Container prometheus-config-reloader ready: true, restart count 0
Jun 29 07:29:36.305: INFO: Container prometheus-proxy ready: true, restart count 0
Jun 29 07:29:36.305: INFO: Container rules-configmap-reloader ready: true, restart count 0
Jun 29 07:29:36.305: INFO: Container thanos-sidecar ready: true, restart count 0
Jun 29 07:29:36.305: INFO: mdns-publisher-ostest-l6xkl-worker-smbbl started at 2020-06-29 06:52:20 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.305: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.305: INFO: Container mdns-publisher ready: true, restart count 0
Jun 29 07:29:36.305: INFO: grafana-596bbf84c-qgdd2 started at 2020-06-29 06:57:12 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.305: INFO: Container grafana ready: true, restart count 0
Jun 29 07:29:36.305: INFO: Container grafana-proxy ready: true, restart count 0
W0629 07:29:36.318694 438694 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Jun 29 07:29:36.376: INFO:
Latency metrics for node ostest-l6xkl-worker-smbbl
Jun 29 07:29:36.376: INFO:
Logging node info for node ostest-l6xkl-worker-xx4sh
Jun 29 07:29:36.386: INFO: Node Info: &Node{ObjectMeta:{ostest-l6xkl-worker-xx4sh /api/v1/nodes/ostest-l6xkl-worker-xx4sh a612106c-a5ac-42a0-853d-f6030fb0ab06 36432 0 2020-06-29 06:54:21 -0400 EDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:m4.xlarge beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/zone:nova kubernetes.io/arch:amd64 kubernetes.io/hostname:ostest-l6xkl-worker-xx4sh kubernetes.io/os:linux node-role.kubernetes.io/worker: node.kubernetes.io/instance-type:m4.xlarge node.openshift.io/os_id:rhcos topology.kubernetes.io/zone:nova] map[machine.openshift.io/machine:openshift-machine-api/ostest-l6xkl-worker-xx4sh machineconfiguration.openshift.io/currentConfig:rendered-worker-eb23884ace4dd0f3968f6f0f229f6640 machineconfiguration.openshift.io/desiredConfig:rendered-worker-eb23884ace4dd0f3968f6f0f229f6640 machineconfiguration.openshift.io/reason: machineconfiguration.openshift.io/state:Done volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] []},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:openstack://876595a7-e49f-43ab-80f8-daf5025dfa78,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{42384470016 0} {<nil>} 41391084Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16815423488 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Allocatable:ResourceList{attachable-volumes-cinder: {{256 0} {<nil>} 256 DecimalSI},cpu: {{3500 -3} {<nil>} 3500m DecimalSI},ephemeral-storage: {{37072281128 0} {<nil>} 37072281128 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{15636824064 0} {<nil>} BinarySI},pods: {{250 0} {<nil>} 250 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-06-29 07:27:43 -0400 EDT,LastTransitionTime:2020-06-29 06:54:21 -0400 EDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-06-29 07:27:43 -0400 EDT,LastTransitionTime:2020-06-29 06:54:21 -0400 EDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-06-29 07:27:43 -0400 EDT,LastTransitionTime:2020-06-29 06:54:21 -0400 EDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-06-29 07:27:43 -0400 EDT,LastTransitionTime:2020-06-29 06:55:41 -0400 EDT,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:Hostname,Address:ostest-l6xkl-worker-xx4sh,},NodeAddress{Type:InternalIP,Address:10.196.0.78,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:876595a7e49f43ab80f8daf5025dfa78,SystemUUID:876595a7-e49f-43ab-80f8-daf5025dfa78,BootID:404ccf69-9fd5-419b-bfa4-6e4f28103817,KernelVersion:4.18.0-147.20.1.el8_1.x86_64,OSImage:Red Hat Enterprise Linux CoreOS 44.81.202006271430-0 (Ootpa),ContainerRuntimeVersion:cri-o://1.17.4-18.dev.rhaos4.4.gitfb8131a.el8,KubeletVersion:v1.17.1+1aa1c48,KubeProxyVersion:v1.17.1+1aa1c48,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87f5f1f1566ea8ec07e9b15ff46d1767ee49148205f26a6de6aa168d8c853d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:872290769,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b097ff30213109b123d024a442deb00aa5fab5d035ad4a149365ca3399fb1375 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:677943167,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0a47fb26cd52ba22dd7fc963e74c105d5b6e091ab7922a4766efb4e63f52bb6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:467326588,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e92e2fada5baf7bf6336d366a4817394cefa0f43bf3de881c0bcb6f5c555a38 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:429897331,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d478d1a212bd1a2a5bd14e36e0fd740607c4097c7498d7afea028b8eec699755 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:364474354,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6ecb98c9a40eb5c0f69fbb66ea5c77e451e6d2c5ffc2c529781490ff9da3223 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:342626046,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbf4b2d6fa1a405387bea55db2a293fb196e3808d61a269b1bf5b00dfe054997 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:338257579,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b159beb6abe48be63ae129575fcf9d552bd08f44208bcbf66d851cbf058c0f4a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:334914435,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c93ab547a5f6fb1110ea190ff1e9f76b9c3400234ec91e38b40db187ec6a1cb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:333703633,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:549bd48582a9fa615b8728bc6e1d66f3a9c829f415d9ddd58f95eb978be50274 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325706274,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7cb23c271c3b40a1733f7ae366167cdb91050a449c263811c066f582b772054c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:325673898,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be8b79f4e4a00c54194d278133fbf1abcfbcd77025984039251bd582a84b4070 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318699317,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f713807d89802682d410f2b93d525a139eeffa9273ce7bab80c4441feff35825 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:318048395,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:569fc5846c8b59b0488823a99a17b2354bf7d532418958c06aadd177186fed15 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:311016402,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1cfcdb3c2406c10e980eabd454ef2640877b15d6576e7dfae2beaf129ec94f03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:305583473,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ccce1c6c856a113d219a284ad9bc3f89c1f49f124a42c02a9c087f1d23fe8ba quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:283435012,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:229d2c63f30a59b446c229b37d810e23c972970e5cd496c9c62b066f8cf4c1a7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:276837709,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1de153bc8773f9857efbb092f0e2756a6d253c0cb5189310641c9eda0ef8c61 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:267611081,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51d2c485bb848c6fb8cfc65d2a834a059ef97ed1241f6f5a85e19094ebb64d60 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:264205161,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:72b80cd480bb49dfa28ce72e082d69d62b23594db2c0c9e6a0a35ddbf477e4de quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:258193954,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d8469257c72f4d4deb8f2d72802488645360182a186f43c21746202b09f41ad quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:257198663,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bb48291f2937c1a0bf84eee5f26fc98d400e5242ee75afc4e6a3c5b75e7a03 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:255814539,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec70cc0697d893d2b5c83b11e0888488a6c7556a945da11b59015ad69f98a62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:251028388,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:47b150b2d79c5eebbf6e9bd189daa4c5d7a412c926ba258898b0af071c33f6e9 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:243281399,},ContainerImage{Names:[quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52686d7a2b9ffbc8619ba2a4835dd91bab71f52a4a959144ec7bde5a3ed04004 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>],SizeBytes:237302018,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/agnhost@sha256:02b9e10ea1f7439a03d9bc3ee16d984172ca7eac1818792ad4d721c5c8f72ff4 gcr.io/kubernetes-e2e-test-images/agnhost@sha256:daf5332100521b1256d0e3c56d697a238eaec3af48897ed9167cbadd426773b5 gcr.io/kubernetes-e2e-test-images/agnhost:2.8],SizeBytes:55378871,},ContainerImage{Names:[docker.io/openshift/hello-openshift@sha256:aaea76ff622d2f8bcb32e538e7b3cd0ef6d291953f3e7c9f556c1ba5baf47e2e docker.io/openshift/hello-openshift:latest],SizeBytes:6095636,},ContainerImage{Names:[docker.io/library/busybox@sha256:d6975a0407b0ee34bc87c39d8b0ac20b03b8db04a0492fc11c8804ce42fc2ca6 docker.io/library/busybox@sha256:de4ef44705626db7abd9a585b186dd9577ce80288c7003a7d5eae8272b784615 docker.io/library/busybox:1.29-glibc],SizeBytes:4646709,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jun 29 07:29:36.387: INFO:
Logging kubelet events for node ostest-l6xkl-worker-xx4sh
Jun 29 07:29:36.396: INFO:
Logging pods the kubelet thinks is on node ostest-l6xkl-worker-xx4sh
Jun 29 07:29:36.465: INFO: keepalived-ostest-l6xkl-worker-xx4sh started at 2020-06-29 06:53:11 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.465: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.465: INFO: Container keepalived ready: true, restart count 0
Jun 29 07:29:36.465: INFO: node-ca-llqrx started at 2020-06-29 06:54:22 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container node-ca ready: true, restart count 0
Jun 29 07:29:36.466: INFO: alertmanager-main-2 started at 2020-06-29 06:57:05 -0400 EDT (0+3 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container alertmanager ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container alertmanager-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container config-reloader ready: true, restart count 0
Jun 29 07:29:36.466: INFO: thanos-querier-67fcdb4899-z978l started at 2020-06-29 06:58:51 -0400 EDT (0+4 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container prom-label-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container thanos-querier ready: true, restart count 0
Jun 29 07:29:36.466: INFO: prometheus-k8s-1 started at 2020-06-29 06:59:11 -0400 EDT (0+7 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container prom-label-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container prometheus ready: true, restart count 1
Jun 29 07:29:36.466: INFO: Container prometheus-config-reloader ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container prometheus-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container rules-configmap-reloader ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container thanos-sidecar ready: true, restart count 0
Jun 29 07:29:36.466: INFO: kuryr-cni-mlqsr started at 2020-06-29 06:54:21 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container kuryr-cni ready: true, restart count 0
Jun 29 07:29:36.466: INFO: node-exporter-jdk6s started at 2020-06-29 06:54:21 -0400 EDT (1+2 container statuses recorded)
Jun 29 07:29:36.466: INFO: Init container init-textfile ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container kube-rbac-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container node-exporter ready: true, restart count 0
Jun 29 07:29:36.466: INFO: tuned-w7xlp started at 2020-06-29 06:54:22 -0400 EDT (0+1 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container tuned ready: true, restart count 0
Jun 29 07:29:36.466: INFO: server-lbb9q started at 2020-06-29 07:21:56 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container server-container-80 ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container server-container-81 ready: true, restart count 0
Jun 29 07:29:36.466: INFO: mdns-publisher-ostest-l6xkl-worker-xx4sh started at 2020-06-29 06:53:11 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.466: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container mdns-publisher ready: true, restart count 0
Jun 29 07:29:36.466: INFO: machine-config-daemon-zrw7j started at 2020-06-29 06:54:22 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container machine-config-daemon ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container oauth-proxy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: multus-7jfpf started at 2020-06-29 06:54:22 -0400 EDT (5+1 container statuses recorded)
Jun 29 07:29:36.466: INFO: Init container multus-binary-copy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Init container cni-plugins ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Init container routeoverride-cni ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Init container whereabouts-cni-bincopy ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Init container whereabouts-cni ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container kube-multus ready: true, restart count 0
Jun 29 07:29:36.466: INFO: dns-default-mwj7n started at 2020-06-29 06:55:42 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container dns ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container dns-node-resolver ready: true, restart count 0
Jun 29 07:29:36.466: INFO: coredns-ostest-l6xkl-worker-xx4sh started at 2020-06-29 06:53:11 -0400 EDT (1+1 container statuses recorded)
Jun 29 07:29:36.466: INFO: Init container render-config ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container coredns ready: true, restart count 0
Jun 29 07:29:36.466: INFO: server-fnmsr started at 2020-06-29 07:21:54 -0400 EDT (0+2 container statuses recorded)
Jun 29 07:29:36.466: INFO: Container server-container-80 ready: true, restart count 0
Jun 29 07:29:36.466: INFO: Container server-container-81 ready: true, restart count 0
W0629 07:29:36.477533 438694 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Jun 29 07:29:36.525: INFO:
Latency metrics for node ostest-l6xkl-worker-xx4sh
Jun 29 07:29:36.525: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
�[1mSTEP�[0m: Destroying namespace "network-policy-9184" for this suite.
�[1mSTEP�[0m: Destroying namespace "network-policy-b-3592" for this suite.