Fuel for OpenStack

[10.0] [Swarm] Failed to start instance with ironic

Bug #1675673 reported by Yury Tregubov
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Vasyl Saienko
Fuel for OpenStack 10.1

Bug Description

Since the mos 10.0 build #1509 swarm runs and mos-int tests for ironic detects this problem:

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/10.0.system_test.ubuntu.ironic_deploy_swift/fuelweb_test/helpers/decorators.py", line 120, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0.system_test.ubuntu.ironic_deploy_swift/fuelweb_test/tests/test_ironic_base.py", line 212, in ironic_deploy_swift
    ironic_conn.wait_for_vms(ironic_conn)
  File "/home/jenkins/workspace/10.0.system_test.ubuntu.ironic_deploy_swift/fuelweb_test/helpers/ironic_actions.py", line 100, in wait_for_vms
    timeout=60 * 30, timeout_msg='Server didn\'t became active')
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 110, in wait
    raise error.TimeoutError(timeout_msg)
TimeoutError: Server didn't became active

Previously these runs were blocked by another bug:https://bugs.launchpad.net/fuel/+bug/1653204

Diagnostic snapshot is https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.ironic_deploy_swift/219/artifact/logs/fail_error_ironic_deploy_swift-fuel-snapshot-2017-03-24_00-08-50.tar

Failed swarm CI run: https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.ironic_deploy_swift/219/

Feel free to ask me for env with reproduction.

Yury Tregubov (ytregubov)
Changed in fuel:
importance: Undecided → Critical
milestone: none → 10.1
tags: added: swarm-blocker
Oleksiy Molchanov (omolchanov)
Changed in fuel:
assignee: nobody → Fuel Sustaining (fuel-sustaining-team)
status: New → Confirmed
Igor Gajsin (igajsin)
Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Igor Gajsin (igajsin)
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

so the error message is | fault | {"message": "No valid host was found. There are not enough hosts available.", "code": 500, "details": " File \"/usr/lib/python2.7/dist-packages/nova/conductor/manager.py\", line 496, in build_instances |

Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

so, the test fails because

image wants
| hypervisor_type | baremetal
 but all nodes are now QEMU

Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

So it seems that the ironic node became QEMU node. So we need to either run this node on QEMU nodes or return running of that node to baremetal nodes.

Changed in fuel:
assignee: Igor Gajsin (igajsin) → Fuel QA Team (fuel-qa)
Sergii Turivnyi (sturivnyi)
Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → MOS Ironic (mos-ironic)
status: Confirmed → In Progress
OpenStack Infra (hudson-openstack)
Changed in fuel:
assignee: MOS Ironic (mos-ironic) → Vasyl Saienko (vsaienko)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-agent (stable/newton)

Reviewed: https://review.openstack.org/450610
Committed: https://git.openstack.org/cgit/openstack/fuel-agent/commit/?id=75e69a0f9961c4786527382170ab76356662445f
Submitter: Jenkins
Branch: stable/newton

commit 75e69a0f9961c4786527382170ab76356662445f
Author: Vasyl Saienko <email address hidden>
Date: Tue Mar 28 10:53:04 2017 +0300

    Drop unconfigure_tenant_networks in prepare

    unconfigre_tenant_networks() removes vif_port_id from ironic port,
    as result during deploy we don't know for which port to update DHCP.
    It was reworked in Ocata, but shouldn't be present in Newton.

    Related-Bug: #1675673

    Change-Id: I3a2da0ab20ed32273c8e426c0d13b0fd02583a54

tags: added: in-stable-newton
Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (master)

Reviewed: https://review.openstack.org/451235
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=ad30a92874a73fa3f2f0f154176d06efee90e2a8
Submitter: Jenkins
Branch: master

commit ad30a92874a73fa3f2f0f154176d06efee90e2a8
Author: Vasyl Saienko <email address hidden>
Date: Wed Mar 29 11:07:13 2017 +0300

    Dont set vlan on ironic network

    The traffic from ironic slave is untagged, we can't use
    vlan with simulated environment.

    Closes-Bug: #1675673
    Change-Id: I89f5b59448dbab11ad4f398b6a879ab4c4f606c8

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (stable/newton)

Reviewed: https://review.openstack.org/451237
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=2d20cad12f9ed04625c7e8ca2e53abe9231900bc
Submitter: Jenkins
Branch: stable/newton

commit 2d20cad12f9ed04625c7e8ca2e53abe9231900bc
Author: Vasyl Saienko <email address hidden>
Date: Wed Mar 29 11:07:13 2017 +0300

    Dont set vlan on ironic network

    The traffic from ironic slave is untagged, we can't use
    vlan with simulated environment.

    Closes-Bug: #1675673
    Change-Id: I89f5b59448dbab11ad4f398b6a879ab4c4f606c8

tags: added: in-stable-ocata
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (stable/ocata)

Reviewed: https://review.openstack.org/451236
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=136f750c4e1f6d7bd3d626bd5dfe6cf98394f5fb
Submitter: Jenkins
Branch: stable/ocata

commit 136f750c4e1f6d7bd3d626bd5dfe6cf98394f5fb
Author: Vasyl Saienko <email address hidden>
Date: Wed Mar 29 11:07:13 2017 +0300

    Dont set vlan on ironic network

    The traffic from ironic slave is untagged, we can't use
    vlan with simulated environment.

    Closes-Bug: #1675673
    Change-Id: I89f5b59448dbab11ad4f398b6a879ab4c4f606c8

Revision history for this message
Dmitry Belyaninov (dbelyaninov) wrote :

Verified on Newton. Passed run https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.ironic_deploy_swift/225/

Changed in fuel:
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/fuel-qa ocata-eol

This issue was fixed in the openstack/fuel-qa ocata-eol release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.