multi master cluster creation fails with ETCD LB

Bug #1679724 reported by Kevin Lefevre
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Magnum
Fix Released
Undecided
Kevin Lefevre

Bug Description

For Kubernetes, when using TLS (which is not the case in Jenkins I think, also we are not testing multi master). Both Kubernetes Load balancer and ETCD LB must be set to TCP.

curl -v --cacert /srv/kubernetes/ca.crt --cert /srv/kubernetes/client.crt --key /srv/kubernetes/client.key 'https://10.0.0.4:2379/v2/keys/atomic.io/network/config?quorum=false&recursive=false&sorted=false'
* Trying 10.0.0.4...
* TCP_NODELAY set
* Connected to 10.0.0.4 (10.0.0.4) port 2379 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
* CAfile: /srv/kubernetes/ca.crt
  CApath: none
* NSS error -12263 (SSL_ERROR_RX_RECORD_TOO_LONG)
* SSL received a record that exceeded the maximum permissible length.
* Curl_http_done: called premature == 1
* stopped the pause stream!
* Closing connection 0
curl: (35) SSL received a record that exceeded the maximum permissible length.

This is not the case for ETCD which is hardcoded in TCP. I already proposed a fix https://review.openstack.org/#/c/450841/

But there is another issue during TLS certs generation because we are not adding the IP of the Neutron LB to the ALT-NAME when generating certs.

Changed in magnum:
assignee: nobody → Kevin Lefevre (archifleks)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to magnum (master)

Reviewed: https://review.openstack.org/450841
Committed: https://git.openstack.org/cgit/openstack/magnum/commit/?id=ecfe6ac183effaafa110b3c6359c6c9c697647f7
Submitter: Jenkins
Branch: master

commit ecfe6ac183effaafa110b3c6359c6c9c697647f7
Author: ArchiFleKs <email address hidden>
Date: Tue Mar 28 17:16:05 2017 +0200

    Fix CoreOS multi master with LB cluster creation

    Cluster that uses ETCD like swarm and K8s failed with LB and TLS enable
    because ETCD LB protocol is HTTP but SSL termination in on the ETCD
    node. ETCD LB protocol should be the same as K8s with TLS enable

    Partial-Bug: #1679724

    Change-Id: Ie8c8a7e4609c0e2e63095d4c18af84cc653654e1

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to magnum (master)

Fix proposed to branch: master
Review: https://review.openstack.org/465913

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to magnum (master)

Reviewed: https://review.openstack.org/465913
Committed: https://git.openstack.org/cgit/openstack/magnum/commit/?id=6ea4a7872d646e6def8c3a38c9e2182b7a23225a
Submitter: Jenkins
Branch: master

commit 6ea4a7872d646e6def8c3a38c9e2182b7a23225a
Author: ArchiFleKs <email address hidden>
Date: Tue Apr 18 16:20:47 2017 +0200

    [k8s-fedora-atomic] fix multimaster cluster

    Same fix as CoreOS for Fedora which enable multimaster with
    TLS and ETCD Load balancer.

    Closes-Bug: #1679724
    Change-Id: I45b62a20f0a89ebd1494ad61021384fc7a416e8e

Changed in magnum:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to magnum (stable/ocata)

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/487425

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to magnum (stable/ocata)

Reviewed: https://review.openstack.org/487425
Committed: https://git.openstack.org/cgit/openstack/magnum/commit/?id=0d980622b02c2280a6caffa64e21387e98c11872
Submitter: Jenkins
Branch: stable/ocata

commit 0d980622b02c2280a6caffa64e21387e98c11872
Author: ArchiFleKs <email address hidden>
Date: Tue Apr 18 16:20:47 2017 +0200

    [k8s-fedora-atomic] fix multimaster cluster

    Same fix as CoreOS for Fedora which enable multimaster with
    TLS and ETCD Load balancer.

    Closes-Bug: #1679724
    Change-Id: I45b62a20f0a89ebd1494ad61021384fc7a416e8e
    (cherry picked from commit 6ea4a7872d646e6def8c3a38c9e2182b7a23225a)

tags: added: in-stable-ocata
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/magnum 5.0.0

This issue was fixed in the openstack/magnum 5.0.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on magnum (master)

Change abandoned by Feilong Wang (<email address hidden>) on branch: master
Review: https://review.opendev.org/497725
Reason: Hi, magnum team is trying to clean up these old pending patches. Please feel free to reopen this if you're still working on. Thanks.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.