Skip to content

Extended. DNS should answer endpoint and wildcard queries for the cluster [Conformance] #15630

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
ingvagabund opened this issue Aug 4, 2017 · 2 comments
Closed

Extended. DNS should answer endpoint and wildcard queries for the cluster [Conformance] #15630

ingvagabund opened this issue Aug 4, 2017 · 2 comments
Assignees
@knobunc @dcbw
Labels
area/tests component/networking kind/test-flake Categorizes issue or PR as related to test flakes. priority/P1 sig/continuous-infrastructure

Comments

@ingvagabund
Copy link
Member

The test is failing when running e2e extended conformance tests over system container based deployment. The Jenkins Job producing the failures at https://ci.openshift.redhat.com/jenkins/job/test_pull_request_openshift_ansible_extended_conformance_install_system_containers/31/consoleFull (the job will get deleted eventually):

DNS 
  should answer endpoint and wildcard queries for the cluster [Conformance]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:378

[BeforeEach] [Top Level]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/util/test.go:52
[BeforeEach] DNS
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:130
STEP: Creating a kubernetes client
Aug  3 04:23:24.661: INFO: >>> kubeConfig: /etc/origin/master/admin.kubeconfig
STEP: Building a namespace api object
STEP: Waiting for a default service account to be provisioned in namespace
[It] should answer endpoint and wildcard queries for the cluster [Conformance]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:378
STEP: Running these commands:for i in `seq 1 10`; do test -n "$$(dig +notcp +noall +answer +search prefix.kubernetes.default A)" && echo "[email protected]";test -n "$$(dig +tcp +noall +answer +search prefix.kubernetes.default A)" && echo "[email protected]";test -n "$$(dig +notcp +noall +answer +search prefix.kubernetes.default.svc A)" && echo "[email protected]";test -n "$$(dig +tcp +noall +answer +search prefix.kubernetes.default.svc A)" && echo "[email protected]";test -n "$$(dig +notcp +noall +answer +search prefix.kubernetes.default.svc.cluster.local A)" && echo "[email protected]";test -n "$$(dig +tcp +noall +answer +search prefix.kubernetes.default.svc.cluster.local A)" && echo "[email protected]";test -n "$$(dig +notcp +noall +answer +search prefix.clusterip.e2e-tests-dns-31d7m A)" && echo "[email protected]";test -n "$$(dig +tcp +noall +answer +search prefix.clusterip.e2e-tests-dns-31d7m A)" && echo "[email protected]"; test -n "$$(dig +notcp +noall +additional +search _http._tcp.externalname.e2e-tests-dns-31d7m.svc SRV)" && echo "test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc";test -n "$$(dig +tcp +noall +additional +search _http._tcp.externalname.e2e-tests-dns-31d7m.svc SRV)" && echo "test_tcp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc"; test -n "$$(dig +notcp +noall +answer +search externalname.e2e-tests-dns-31d7m.svc CNAME)" && echo "[email protected]";test -n "$$(dig +tcp +noall +answer +search externalname.e2e-tests-dns-31d7m.svc CNAME)" && echo "[email protected]"; [ "$$(dig +short +notcp +noall +answer +search headless.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1 1.1.1.2" ] && echo "[email protected]";[ "$$(dig +short +notcp +noall +answer +search clusterip.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1 1.1.1.2" ] && echo "[email protected]";[ "$$(dig +short +notcp +noall +answer +search endpoint1.headless.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1" ] && echo "[email protected]";[ "$$(dig +short +notcp +noall +answer +search endpoint1.clusterip.e2e-tests-dns-31d7m.endpoints A | sort | xargs echo)" = "1.1.1.1" ] && echo "[email protected]";[ "$$(dig +short +notcp +noall +answer +search kubernetes.default.endpoints A | sort | xargs echo)" = "172.18.2.135" ] && echo "[email protected]";[ "$$(dig +short +notcp +noall +answer +search headless.e2e-tests-dns-31d7m.svc A | sort | xargs echo)" = "1.1.1.1 1.1.1.2" ] && echo "[email protected]"; [ "$(dig +short +notcp +noall +answer +search 2.1.1.1.in-addr.arpa PTR)" = "" ] && echo "[email protected]";[ "$(dig +short +notcp +noall +answer +search 1.1.1.2.in-addr.arpa PTR)" = "" ] && echo "[email protected]";[ "$(dig +short +notcp +noall +answer +search 1.1.1.1.in-addr.arpa PTR)" = "endpoint1.headless.e2e-tests-dns-31d7m.svc.cluster.local." ] && echo "[email protected]"; podARec=$$(hostname -i| awk -F. '{print $$1"-"$$2"-"$$3"-"$$4".e2e-tests-dns-31d7m.pod.cluster.local"}');test -n "$$(dig +notcp +noall +answer +search $${podARec} A)" && echo "test_udp@PodARecord";test -n "$$(dig +tcp +noall +answer +search $${podARec} A)" && echo "test_tcp@PodARecord";sleep 1; done

STEP: creating a pod to probe DNS
STEP: submitting the pod to kubernetes
STEP: retrieving the pod logs
STEP: looking for the results for each expected name from probiers
Aug  3 04:23:40.074: INFO: Got results from pod:
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@_http._tcp.externalname.e2e-tests-dns-31d7m.svc
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
test_udp@PodARecord

Aug  3 04:23:40.074: INFO: Unexpected results: unexpected count 0/10 for "[email protected]": map[]
STEP: deleting the pod
[AfterEach] DNS
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/vendor/k8s.io/kubernetes/test/e2e/framework/framework.go:131
STEP: Collecting events from namespace "e2e-tests-dns-31d7m".
STEP: Found 5 events.
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:24 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {default-scheduler } Scheduled: Successfully assigned dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932 to ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:25 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} SuccessfulMountVolume: MountVolume.SetUp succeeded for volume "default-token-nt2gg" 
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:26 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} Pulled: Container image "gcr.io/google_containers/dnsutils:e2e" already present on machine
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:27 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} Created: Created container
Aug  3 04:23:40.086: INFO: At 2017-08-03 04:23:27 -0400 EDT - event for dns-test-04cfbb38-7825-11e7-96dc-0e3e3be55932: {kubelet ip-172-18-2-135.ec2.internal} Started: Started container
Aug  3 04:23:40.093: INFO: POD                                            NODE                          PHASE    GRACE  CONDITIONS
Aug  3 04:23:40.093: INFO: docker-registry-1-d3t61                        ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:06 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:17:05 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:06 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: registry-console-1-52065                       ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:27 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:17:00 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:10:27 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: router-1-sc0jx                                 ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:09:22 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:17:09 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:09:22 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: dns-test-7cc04317-7824-11e7-98b3-0e3e3be55932  ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:19:37 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:20:00 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:19:36 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: redis-master-28p94                             ip-172-18-2-135.ec2.internal  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:37 -0400 EDT  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:37 -0400 EDT ContainersNotReady containers with unready status: [redis-master]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:37 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: ss2-0                                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:11 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:19 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:11 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: ss2-1                                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:55 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:05 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:55 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: ss2-2                                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:45 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:53 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:45 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-4-jcnsf                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:47 -0400 EDT  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:35 -0400 EDT ContainersNotReady containers with unready status: [myapp]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:47 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-5-v8kr8                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:58 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:03 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:22:58 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-6-fgwz7                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:12 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:17 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:12 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-7-vj1f0                          ip-172-18-2-135.ec2.internal  Running  30s    [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:27 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:29 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:27 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-8-0xgjw                          ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:36 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:38 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:36 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: history-limit-8-deploy                         ip-172-18-2-135.ec2.internal  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:32 -0400 EDT  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:35 -0400 EDT  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-03 04:23:32 -0400 EDT  }]
Aug  3 04:23:40.093: INFO: 
Aug  3 04:23:40.097: INFO: 
Logging node info for node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.114: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:ip-172-18-2-135.ec2.internal,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/ip-172-18-2-135.ec2.internal,UID:c0973c6c-7822-11e7-8b36-0e3e3be55932,ResourceVersion:6690,Generation:0,CreationTimestamp:2017-08-03 04:07:11 -0400 EDT,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/os: linux,kubernetes.io/hostname: ip-172-18-2-135.ec2.internal,region: infra,zone: default,},Annotations:map[string]string{volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,},Spec:NodeSpec{PodCIDR:,ExternalID:ip-172-18-2-135.ec2.internal,ProviderID:aws:////i-0762c70264ba973bb,Unschedulable:false,Taints:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},memory: {{16388919296 0} {<nil>} 16004804Ki BinarySI},pods: {{40 0} {<nil>} 40 DecimalSI},},Allocatable:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},memory: {{16284061696 0} {<nil>} 15902404Ki BinarySI},pods: {{40 0} {<nil>} 40 DecimalSI},},Phase:,Conditions:[{OutOfDisk False 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:07:11 -0400 EDT KubeletHasSufficientDisk kubelet has sufficient disk space available} {MemoryPressure False 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:07:11 -0400 EDT KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:07:11 -0400 EDT KubeletHasNoDiskPressure kubelet has no disk pressure} {Ready True 2017-08-03 04:23:30 -0400 EDT 2017-08-03 04:17:05 -0400 EDT KubeletReady kubelet is posting ready status}],Addresses:[{InternalIP 172.18.2.135} {Hostname ip-172-18-2-135.ec2.internal}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f9370ed252a14f73b014c1301a9b6d1b,SystemUUID:EC2F4FBB-3BAF-A110-30DE-33DED71B4EDD,BootID:8cf24619-f718-4393-9f04-020003d2a5e4,KernelVersion:3.10.0-514.26.2.el7.x86_64,OSImage:CentOS Linux 7 (Core),ContainerRuntimeVersion:docker://1.12.6,KubeletVersion:v1.7.0+695f48a16f,KubeProxyVersion:v1.7.0+695f48a16f,OperatingSystem:linux,Architecture:amd64,},Images:[{[openshift/origin-federation:latest openshift/origin-federation:v3.6.0-rc.0] 1269982240} {[openshift/openvswitch:latest openshift/openvswitch:v3.6.0-rc.0] 1232140489} {[openshift/node:latest openshift/node:v3.6.0-rc.0] 1230458678} {[openshift/origin-docker-registry:latest openshift/origin-docker-registry:v3.6.0-rc.0] 1132989947} {[openshift/origin-gitserver:latest openshift/origin-gitserver:v3.6.0-rc.0] 1119865414} {[openshift/origin-keepalived-ipfailover:latest openshift/origin-keepalived-ipfailover:v3.6.0-rc.0] 1075578822} {[openshift/origin-haproxy-router:latest openshift/origin-haproxy-router:v3.6.0-rc.0] 1069814043} {[openshift/origin-service-catalog:latest openshift/origin-service-catalog:v3.6.0-rc.0] 1062742565} {[openshift/origin-deployer:latest openshift/origin-deployer:v3.6.0-rc.0] 1048789100} {[openshift/origin-recycler:latest openshift/origin-recycler:v3.6.0-rc.0] 1048789100} {[openshift/origin-sti-builder:latest openshift/origin-sti-builder:v3.6.0-rc.0] 1048789100} {[openshift/origin-docker-builder:latest openshift/origin-docker-builder:v3.6.0-rc.0] 1048789100} {[openshift/origin-f5-router:latest openshift/origin-f5-router:v3.6.0-rc.0] 1048789100} {[openshift/origin:latest openshift/origin:v3.6.0-rc.0] 1048789100} {[openshift/origin-cluster-capacity:latest openshift/origin-cluster-capacity:v3.6.0-rc.0] 1002533207} {[docker.io/openshift/origin@sha256:fe7d5b3244f0e7fe83b8742947fa6dc091dd278c248fe1db87a6508a3861f00e docker.io/openshift/origin:v3.6.0-rc.0] 974057765} {[docker.io/openshift/origin-release@sha256:d03fa29a86385176442f712e8f1e85763f930e076657cf285586fadf62249d7a docker.io/openshift/origin-release:golang-1.8] 889401157} {[docker.io/openshift/origin-release@sha256:e7830c1917b24cd07897d69044d0a831d32563daeed2e5ef8260e080e841ba63] 888265752} {[docker.io/openshift/origin-release@sha256:28ba70dba48e007062d84740596478a34db8ba933955cd7fbd2fe4cb631fb8fe docker.io/openshift/origin-release:golang-1.7] 861320249} {[docker.io/openshift/origin-gce@sha256:409e2746c9e376c304ebe64928926f916e8d2b54e9c63630bbb598a9bc9857fb docker.io/openshift/origin-gce:latest] 779683339} {[docker-registry.default.svc:5000/extended-test-build-valuefrom-j74nq-g6qtg/test@sha256:e5ef6dc87227dd06631d823925ede3d56671478152f504a9f5577cd532c1388b docker-registry.default.svc:5000/extended-test-build-valuefrom-j74nq-g6qtg/test:latest] 539238390} {[docker.io/centos/s2i-base-centos7@sha256:78383cd807c6f700bc0c1310d06acd986d15288c80ffa735eecff346d85d4423 docker.io/centos/s2i-base-centos7:latest] 429895545} {[docker.io/cockpit/kubernetes@sha256:c5f076d8317ff1f9c77352f1b4e128662b9567dbf29941df3093e876b06f5d07 docker.io/cockpit/kubernetes:latest] 407281755} {[openshift/origin-egress-http-proxy:latest openshift/origin-egress-http-proxy:v3.6.0-rc.0] 395971365} {[openshift/origin-egress-router:latest openshift/origin-egress-router:v3.6.0-rc.0] 364719653} {[openshift/origin-base:8ef052d openshift/origin-base:latest] 363043407} {[openshift/origin-pod:latest openshift/origin-pod:v3.6.0-rc.0] 213205928} {[openshift/origin-source:8ef052d openshift/origin-source:latest] 192530021} {[docker.io/centos@sha256:c1010e2fe2b635822d99a096b1f4184becf5d1c98707cbccae00be663a9b9131 docker.io/centos:7] 192529651} {[gcr.io/google_containers/jessie-dnsutils@sha256:2460d596912244b5f8973573f7150e7264b570015f4becc2d0096f0bd1d17e36 gcr.io/google_containers/jessie-dnsutils:e2e] 190122856} {[gcr.io/google_containers/nginx-slim@sha256:8b4501fe0fe221df663c22e16539f399e89594552f400408303c42f3dd8d0e52 gcr.io/google_containers/nginx-slim:0.8] 110461313} {[gcr.io/google_containers/nginx-slim@sha256:dd4efd4c13bec2c6f3fe855deeab9524efe434505568421d4f31820485b3a795 gcr.io/google_containers/nginx-slim:0.7] 86838142} {[gcr.io/google_containers/hostexec@sha256:cab8d4e2526f8f767c64febe4ce9e0f0e58cd35fdff81b3aadba4dd041ba9f00 gcr.io/google_containers/hostexec:1.2] 13185747} {[gcr.io/google_containers/dnsutils@sha256:cd9182f6d74e616942db1cef6f25e1e54b49ba0330c2e19d3ec061f027666cc0 gcr.io/google_containers/dnsutils:e2e] 8893907} {[docker.io/openshift/hello-openshift@sha256:a6b8e48ec0d1c06ccd3d3176aac271af0e4ab92139a6658b3af5fcb9c3a2b77c docker.io/openshift/hello-openshift:latest] 5840109} {[openshift/hello-openshift:latest openshift/hello-openshift:v3.6.0-rc.0] 5840109} {[gcr.io/google_containers/update-demo@sha256:89ac104fa7c43880d2324f377b79be95b0b2b3fb32e4bd03b8d1e6d91a41f009 gcr.io/google_containers/update-demo:nautilus] 4555533} {[gcr.io/google_containers/test-webserver@sha256:f804e8837490d1dfdb5002e073f715fd0a08115de74e5a4847ca952315739372 gcr.io/google_containers/test-webserver:e2e] 4534272} {[docker.io/alpine@sha256:1072e499f3f655a032e88542330cf75b02e7bdf673278f701d7ba61629ee3ebe docker.io/alpine:3.6] 3961627} {[gcr.io/google_containers/eptest@sha256:bb088b26ed78613cce171420168db9a6c62a8dbea17d7be13077e7010bae162f gcr.io/google_containers/eptest:0.1] 2970692} {[gcr.io/google_containers/mounttest@sha256:c4dcedb26013ab4231a2b2aaa4eebd5c2a44d5c597fa0613c9ff8bde4fb9fe02 gcr.io/google_containers/mounttest:0.7] 2052704} {[gcr.io/google_containers/mounttest@sha256:bec3122ddcf8bd999e44e46e096659f31241d09f5236bc3dc212ea584ca06856 gcr.io/google_containers/mounttest:0.8] 1450761} {[gcr.io/google_containers/mounttest-user@sha256:5487c126b03abf4119a8f7950cd5f591f72dbe4ab15623f3387d3917e1268b4e gcr.io/google_containers/mounttest-user:0.5] 1450761} {[docker.io/busybox@sha256:2605a2c4875ce5eb27a9f7403263190cd1af31e48a2044d400320548356251c4] 1129193} {[gcr.io/google_containers/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff gcr.io/google_containers/busybox:1.24] 1113554} {[docker.io/busybox@sha256:29f5d56d12684887bdfa50dcd29fc31eea4aaf4ad3bec43daf19026a7ce69912] 1093484} {[gcr.io/google_containers/pause-amd64@sha256:163ac025575b775d1c0f9bf0bdd0f086883171eb475b5068e7defa4ca9e76516 gcr.io/google_containers/pause-amd64:3.0] 746888}],VolumesInUse:[],VolumesAttached:[],},}
Aug  3 04:23:40.114: INFO: 
Logging kubelet events for node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.117: INFO: 
Logging pods the kubelet thinks is on node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.142: INFO: history-limit-5-v8kr8 started at 2017-08-03 04:22:58 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
Aug  3 04:23:40.142: INFO: dns-test-7cc04317-7824-11e7-98b3-0e3e3be55932 started at 2017-08-03 04:19:37 -0400 EDT (0+3 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container jessie-querier ready: true, restart count 0
Aug  3 04:23:40.142: INFO: 	Container querier ready: true, restart count 0
Aug  3 04:23:40.142: INFO: 	Container webserver ready: true, restart count 0
Aug  3 04:23:40.142: INFO: registry-console-1-52065 started at 2017-08-03 04:10:27 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container registry-console ready: true, restart count 0
Aug  3 04:23:40.142: INFO: ss2-1 started at 2017-08-03 04:22:55 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container nginx ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-6-fgwz7 started at 2017-08-03 04:23:12 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-7-vj1f0 started at 2017-08-03 04:23:27 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
Aug  3 04:23:40.142: INFO: redis-master-28p94 started at 2017-08-03 04:23:37 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container redis-master ready: false, restart count 0
Aug  3 04:23:40.142: INFO: router-1-sc0jx started at 2017-08-03 04:09:22 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container router ready: true, restart count 0
Aug  3 04:23:40.142: INFO: docker-registry-1-d3t61 started at 2017-08-03 04:10:06 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container registry ready: true, restart count 0
Aug  3 04:23:40.142: INFO: ss2-2 started at 2017-08-03 04:22:45 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container nginx ready: true, restart count 0
Aug  3 04:23:40.142: INFO: ss2-0 started at 2017-08-03 04:23:11 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container nginx ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-4-jcnsf started at 2017-08-03 04:22:47 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: false, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-8-deploy started at 2017-08-03 04:23:32 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container deployment ready: true, restart count 0
Aug  3 04:23:40.142: INFO: history-limit-8-0xgjw started at 2017-08-03 04:23:36 -0400 EDT (0+1 container statuses recorded)
Aug  3 04:23:40.142: INFO: 	Container myapp ready: true, restart count 0
W0803 04:23:40.147380   18660 metrics_grabber.go:74] Master node is not registered. Grabbing metrics from Scheduler and ControllerManager is disabled.
Aug  3 04:23:40.172: INFO: 
Latency metrics for node ip-172-18-2-135.ec2.internal
Aug  3 04:23:40.172: INFO: {Operation:stop_container Method:docker_operations_latency_microseconds Quantile:0.99 Latency:30.119313s}
Aug  3 04:23:40.172: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.99 Latency:26.297801s}
Aug  3 04:23:40.172: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.9 Latency:24.853288s}
Aug  3 04:23:40.172: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.99 Latency:19.10043s}
Aug  3 04:23:40.172: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.5 Latency:17.152724s}
Aug  3 04:23:40.172: INFO: {Operation:create_container Method:docker_operations_latency_microseconds Quantile:0.99 Latency:13.048422s}
STEP: Dumping a list of prepulled images on each node...
Aug  3 04:23:40.175: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "e2e-tests-dns-31d7m" for this suite.
Aug  3 04:23:48.220: INFO: namespace: e2e-tests-dns-31d7m, resource: bindings, ignored listing per whitelist
Aug  3 04:23:48.306: INFO: namespace e2e-tests-dns-31d7m deletion completed in 8.128657634s


• Failure [23.645 seconds]
DNS
/go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:379
  should answer endpoint and wildcard queries for the cluster [Conformance] [It]
  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:378

  Aug  3 04:23:40.074: Unexpected results: unexpected count 0/10 for "[email protected]": map[]

  /go/src/github.com/openshift/origin/_output/local/go/src/github.com/openshift/origin/test/extended/dns/dns.go:233
@ingvagabund ingvagabund changed the title Extended.[DNS] should answer endpoint and wildcard queries for the cluster [Conformance] Extended. DNS should answer endpoint and wildcard queries for the cluster [Conformance] Aug 4, 2017
@ingvagabund ingvagabund mentioned this issue Aug 4, 2017
Closed
@bparees bparees added priority/P1 kind/test-flake Categorizes issue or PR as related to test flakes. and removed priority/P2 labels Oct 10, 2017
@bparees
Copy link
Contributor

bparees commented Oct 10, 2017

https://openshift-gce-devel.appspot.com/build/origin-ci-test/pr-logs/pull/16765/test_pull_request_origin_extended_conformance_gce/9417/

@jsafrane jsafrane mentioned this issue Nov 23, 2017
Merged
@simo5 simo5 mentioned this issue Jan 8, 2018
Merged
@smarterclayton
Copy link
Contributor

I am not seeing this anymore, there is a 9/10 one that I think is a network problem, but there's another issue tracking that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@knobunc knobunc

@dcbw dcbw

Labels
area/tests component/networking kind/test-flake Categorizes issue or PR as related to test flakes. priority/P1 sig/continuous-infrastructure
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@smarterclayton @bparees @pweil- @ingvagabund @knobunc @dcbw