Repository: kubernetes-retired/contrib

Issue #886: add-ons don't get installed properly
Created: 2016-05-02T21:55:33Z
Must say up front - I am trying the install on redhat. Having said that after correcting the paths little bit I am able to get the cluster up and running. But for some reason the add-ons don't get installed even though I see the activities  related to grafana, heapster, and influxdb in the log file.
This is what I get after the install:
[rakeshk@cd3labvdapp002 ~]$ kubectl cluster-info
Kubernetes master is running at http://localhost:8080

From the log:

2016-05-02 16:22:51,989 p=18914 u=rakeshk |  task path: /home/rakeshk/contrib/ansible/roles/kubernetes-addons/tasks/cluster-monitoring.yml:11
2016-05-02 16:22:53,512 p=18914 u=rakeshk |  ok: [cd3labvdapp002 -> localhost] => (item=grafana-service.yaml) => {"changed": false, "checksum_dest": "487a140bd7f826b16eec34c6cd293c5e9a04f774", "checksum_src": "487a140bd7f826b16eec34c6cd293c5e9a04f774", "dest": "/tmp/kubernetes/addons/cluster-monitoring/grafana-service.yaml.j2", "gid": 1012, "group": "rakeshk", "item": "grafana-service.yaml", "md5sum": "8b492d5ee6bf197684d9c3cedd86201d", "mode": "0664", "msg": "OK (431 bytes)", "owner": "rakeshk", "size": 431, "src": "/tmp/tmpsHRowM", "state": "file", "uid": 1012, "url": "https://raw.githubusercontent.com/GoogleCloudPlatform/kubernetes/master/cluster/addons/cluster-monitoring/influxdb/grafana-service.yaml"}
2016-05-02 16:22:53,548 p=18914 u=rakeshk |  ok: [cd3labvdapp002 -> localhost] => (item=heapster-controller.yaml) => {"changed": false, "checksum_dest": "d65ae026a787914518a8b9227b5e16c024d11fb8", "checksum_src": "680ed4f1282025987cad1ff8bebef9bf1c62ae8e", "dest": "/tmp/kubernetes/addons/cluster-monitoring/heapster-controller.yaml.j2", "gid": 1012, "group": "rakeshk", "item": "heapster-controller.yaml", "md5sum": "e0b52e80a2bb0e8ec74b925412305629", "mode": "0664", "msg": "OK (3688 bytes)", "owner": "rakeshk", "size": 3688, "src": "/tmp/tmpQpRU3R", "state": "file", "uid": 1012, "url": "https://raw.githubusercontent.com/GoogleCloudPlatform/kubernetes/master/cluster/addons/cluster-monitoring/influxdb/heapster-controller.yaml"}
2016-05-02 16:22:53,583 p=18914 u=rakeshk |  ok: [cd3labvdapp002 -> localhost] => (item=heapster-service.yaml) => {"changed": false, "checksum_dest": "fa6a6611afc134933df625660e5044f5a485d077", "checksum_src": "fa6a6611afc134933df625660e5044f5a485d077", "dest": "/tmp/kubernetes/addons/cluster-monitoring/heapster-service.yaml.j2", "gid": 1012, "group": "rakeshk", "item": "heapster-service.yaml", "md5sum": "f455a4c445fb61865170494cbc0d872e", "mode": "0664", "msg": "OK (258 bytes)", "owner": "rakeshk", "size": 258, "src": "/tmp/tmpjYya6a", "state": "file", "uid": 1012, "url": "https://raw.githubusercontent.com/GoogleCloudPlatform/kubernetes/master/cluster/addons/cluster-monitoring/influxdb/heapster-service.yaml"}
2016-05-02 16:22:53,616 p=18914 u=rakeshk |  ok: [cd3labvdapp002 -> localhost] => (item=influxdb-grafana-controller.yaml) => {"changed": false, "checksum_dest": "2c8d5bbd5117cbaab7926d9bb04976c2c8c781b1", "checksum_src": "2c8d5bbd5117cbaab7926d9bb04976c2c8c781b1", "dest": "/tmp/kubernetes/addons/cluster-monitoring/influxdb-grafana-controller.yaml.j2", "gid": 1012, "group": "rakeshk", "item": "influxdb-grafana-controller.yaml", "md5sum": "24e5ba5b0d0bc75ec64728f8aed3e7d7", "mode": "0664", "msg": "OK (2423 bytes)", "owner": "rakeshk", "size": 2423, "src": "/tmp/tmp7_aGKc", "state": "file", "uid": 1012, "url": "https://raw.githubusercontent.com/GoogleCloudPlatform/kubernetes/master/cluster/addons/cluster-monitoring/influxdb/influxdb-grafana-controller.yaml"}
2016-05-02 16:22:53,650 p=18914 u=rakeshk |  ok: [cd3labvdapp002 -> localhost] => (item=influxdb-service.yaml) => {"changed": false, "checksum_dest": "bc359e21f8779fe54a15c4ca4616f4d90f2d6bca", "checksum_src": "bc359e21f8779fe54a15c4ca4616f4d90f2d6bca", "dest": "/tmp/kubernetes/addons/cluster-monitoring/influxdb-service.yaml.j2", "gid": 1012, "group": "rakeshk", "item": "influxdb-service.yaml", "md5sum": "1d195f93019f20ffece7a0d5c177f06a", "mode": "0664", "msg": "OK (351 bytes)", "owner": "rakeshk", "size": 351, "src": "/tmp/tmpFcdZ2E", "state": "file", "uid": 1012, "url": "https://raw.githubusercontent.com/GoogleCloudPlatform/kubernetes/master/cluster/addons/cluster-monitoring/influxdb/influxdb-service.yaml"}


...

2016-05-02 16:22:56,194 p=18914 u=rakeshk |  TASK [kubernetes-addons : MONITORING | Install template from converted saltfile] ***
2016-05-02 16:22:56,195 p=18914 u=rakeshk |  task path: /home/rakeshk/contrib/ansible/roles/kubernetes-addons/tasks/cluster-monitoring.yml:55
2016-05-02 16:22:59,649 p=18914 u=rakeshk |  ok: [cd3labvdapp002] => (item=grafana-service.yaml) => {"changed": false, "gid": 0, "group": "root", "item": "grafana-service.yaml", "mode": "0755", "owner": "root", "path": "/etc/kubernetes/addons/cluster-monitoring/grafana-service.yaml", "size": 431, "state": "file", "uid": 0}
2016-05-02 16:22:59,685 p=18914 u=rakeshk |  ok: [cd3labvdapp002] => (item=heapster-controller.yaml) => {"changed": false, "gid": 0, "group": "root", "item": "heapster-controller.yaml", "mode": "0755", "owner": "root", "path": "/etc/kubernetes/addons/cluster-monitoring/heapster-controller.yaml", "size": 3119, "state": "file", "uid": 0}
2016-05-02 16:22:59,723 p=18914 u=rakeshk |  ok: [cd3labvdapp002] => (item=heapster-service.yaml) => {"changed": false, "gid": 0, "group": "root", "item": "heapster-service.yaml", "mode": "0755", "owner": "root", "path": "/etc/kubernetes/addons/cluster-monitoring/heapster-service.yaml", "size": 258, "state": "file", "uid": 0}
2016-05-02 16:22:59,764 p=18914 u=rakeshk |  ok: [cd3labvdapp002] => (item=influxdb-grafana-controller.yaml) => {"changed": false, "gid": 0, "group": "root", "item": "influxdb-grafana-controller.yaml", "mode": "0755", "owner": "root", "path": "/etc/kubernetes/addons/cluster-monitoring/influxdb-grafana-controller.yaml", "size": 2423, "state": "file", "uid": 0}
2016-05-02 16:22:59,799 p=18914 u=rakeshk |  ok: [cd3labvdapp002] => (item=influxdb-service.yaml) => {"changed": false, "gid": 0, "group": "root", "item": "influxdb-service.yaml", "mode": "0755", "owner": "root", "path": "/etc/kubernetes/addons/cluster-monitoring/influxdb-service.yaml", "size": 351, "state": "file", "uid": 0}

Duplicate issue #1671: [ansible] kube-dns container absent and kibana-logging CrashLoopBackOff
Created: 2016-08-31T22:29:34Z
Traced this to here:
contrib/ansible/roles/kubernetes-addons/templates/dns/skydns-rc.yaml.j2
When attempting to create the rc from the file, I got these two errors:
error validating "skydns-rc.yaml": error validating data: [found invalid field successThreshold for v1.Probe, found invalid field failureThreshold for v1.Probe]; if you choose to ignore these errors, turn validation off with --validate=false
I think this resulted in the silent failure of the kube-dns RC, but the success of the kube-dns svc.
After deployment, the behavior observed was that every service resolved to the same ( random? ) IP. ( And that there was no container for kube-dns running. )

Closing comment (2016-09-13T08:02:05Z): That looks very similar to #886 (comment). Can you update to newer version of kubernetes?