[upgrade] Upgrade kilo->liberty cluster deployed with network templates: failed to move node between clusters: KeyError: u'murano'

Bug #1616817 reported by Vladimir Khlyunev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Won't Fix
High
Unassigned
8.0.x
Won't Fix
High
Registry Administrators

Bug Description

7.0MU5
8.0MU2+latest proposed packages
nailgun package version fuel-nailgun-8.0.0-1.mos8270.noarch
snapshot is not available due to backslash escaping issue

Steps to reproduce:
1 - Deploy 7.0 fuel + HA + ceph cluster using network template [1] (autotest at [2])
2 - Upgrade master node to 8.0 + latest MU (ensure that nailgun package version is 8270 or above)
3 - Download network template from cluster (fuel --env 1 network-template --download)
4 - Modify network template according to doc (switch default nic mapping to enp0s* names and create additional sections per each host in old cluster with eth* names)
5 - octane upgrade-env --template {file} {ENV_ID}
6 - octane upgrade-node --isolated {SEED_ID} {PRIMARY_CTRL_ID}

Result:
2016-08-24 20:19:12 ERROR octane.util.subprocess fuel2[27709] stderr: 500 Server Error: Internal Server Error

nailgun/app.log:

2016-08-24 20:19:12.863 ERROR [7f1b3dada880] (base) Unexpected exception occured
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/base.py", line 283, in content_json
    resp = func(cls, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/nailgun/extensions/cluster_upgrade/handlers.py", line 88, in POST
    upgrade.UpgradeHelper.assign_node_to_cluster(node, cluster)
  File "/usr/lib/python2.7/site-packages/nailgun/extensions/cluster_upgrade/upgrade.py", line 179, in assign_node_to_cluster
    orig_cluster, seed_cluster)
  File "/usr/lib/python2.7/site-packages/nailgun/extensions/cluster_upgrade/upgrade.py", line 196, in get_netgroups_id_mapping
    mapping = dict((ng.id, seed_ng_dict[ng.name]) for ng in orig_ng)
  File "/usr/lib/python2.7/site-packages/nailgun/extensions/cluster_upgrade/upgrade.py", line 196, in <genexpr>
    mapping = dict((ng.id, seed_ng_dict[ng.name]) for ng in orig_ng)
KeyError: u'murano'

[1] https://github.com/openstack/fuel-qa/blob/stable/7.0/fuelweb_test/network_templates/upgrades.yaml
[2] https://github.com/openstack/fuel-qa/blob/stable/7.0/fuelweb_test/network_templates/upgrades.yaml

summary: [upgrade] Upgrade kilo->liberty cluster deployed with network templates:
- failed to move node between clusters
+ failed to move node between clusters: KeyError: u'murano'
Ilya Kharin (akscram)
Changed in fuel:
status: New → Confirmed
assignee: Fuel Octane (fuel-octane-team) → Anastasia Balobashina (atolochkova)
importance: Undecided → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-nailgun-extension-cluster-upgrade (master)

Fix proposed to branch: master
Review: https://review.openstack.org/365038

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-nailgun-extension-cluster-upgrade (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/369951

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-nailgun-extension-cluster-upgrade (stable/mitaka)

Reviewed: https://review.openstack.org/369951
Committed: https://git.openstack.org/cgit/openstack/fuel-nailgun-extension-cluster-upgrade/commit/?id=f98dc1c67d1e6a4161913bdda70555eb22de3ef6
Submitter: Jenkins
Branch: stable/mitaka

commit f98dc1c67d1e6a4161913bdda70555eb22de3ef6
Author: Anastasiya <email address hidden>
Date: Thu Sep 1 12:16:06 2016 +0300

    Sync network groups during cloning environment

    for creating of network groups in the seed cluster
    such as in the original cluster

    Change-Id: I17f95756fa26ef0f7df0e969f9f1ba4331047c8d
    Closes-Bug: #1616817

tags: added: in-stable-mitaka
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (stable/8.0)

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/372280

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-nailgun-extension-cluster-upgrade (master)

Reviewed: https://review.openstack.org/365038
Committed: https://git.openstack.org/cgit/openstack/fuel-nailgun-extension-cluster-upgrade/commit/?id=821f8373abdce04974e02ef8b20d1d8fffa2094a
Submitter: Jenkins
Branch: master

commit 821f8373abdce04974e02ef8b20d1d8fffa2094a
Author: Anastasiya <email address hidden>
Date: Thu Sep 1 12:16:06 2016 +0300

    Sync network groups during cloning environment

    for creating of network groups in the seed cluster
    such as in the original cluster

    Change-Id: I17f95756fa26ef0f7df0e969f9f1ba4331047c8d
    Closes-Bug: #1616817

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Aleksey Kasatkin (alekseyk-ru) wrote :

Commits that have been merged do not solve the issue completely. Please look at the comments in https://review.openstack.org/#/c/365038/7/cluster_upgrade/upgrade.py

Changed in fuel:
status: Fix Committed → In Progress
Ilya Kharin (akscram)
Changed in fuel:
milestone: 8.0-updates → 8.0-mu-4
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-nailgun-extension-cluster-upgrade (master)

Fix proposed to branch: master
Review: https://review.openstack.org/385494

Revision history for this message
Anton Matveev (amatveev) wrote :

octane specific, moving to won't fix due to shifted priorities

Changed in fuel:
status: In Progress → Won't Fix
Changed in fuel:
status: Won't Fix → In Progress
Ilya Kharin (akscram)
Changed in fuel:
assignee: Anastasia Balobashina (atolochkova) → Fuel Octane (fuel-octane-team)
Ilya Kharin (akscram)
Changed in fuel:
status: In Progress → Won't Fix
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-web (stable/8.0)

Change abandoned by Anastasia Balobashina (<email address hidden>) on branch: stable/8.0
Review: https://review.openstack.org/372280
Reason: Won't Fix

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-nailgun-extension-cluster-upgrade (master)

Change abandoned by Anastasia Balobashina (<email address hidden>) on branch: master
Review: https://review.openstack.org/385494
Reason: Won't Fix

Changed in fuel:
milestone: 8.0-mu-4 → 8.0-updates
Curtis Hovey (sinzui)
Changed in fuel:
assignee: Registry Administrators (registry) → nobody
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/fuel-nailgun-extension-cluster-upgrade ocata-eol

This issue was fixed in the openstack/fuel-nailgun-extension-cluster-upgrade ocata-eol release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.