ServerShowV263Test.test_show_update_rebuild_list_server fails cells v1 job with "ValueError: An object of type nova.objects.instance.TrustedCerts is required in field trusted_certs, not a dict"

Bug #1777478 reported by Matt Riedemann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Critical
Matt Riedemann

Bug Description

Seen here:

http://logs.openstack.org/01/571201/1/gate/nova-cells-v1/56392c6/logs/screen-n-cell-child.txt.gz?level=TRACE#_Jun_18_14_14_15_307670

The new tempest test is using 2.63 with trusted certs for rebuild which isn't supported with cells v1.

Jun 18 14:14:15.307670 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler [None req-063f2ef6-8896-4729-a287-31c50499b95f tempest-ServerShowV263Test-2087094943 tempest-ServerShowV263Test-2087094943] Couldn't communicate with cell 'child': ValueError: An object of type nova.objects.instance.TrustedCerts is required in field trusted_certs, not a dict
Jun 18 14:14:15.308000 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler Traceback (most recent call last):
Jun 18 14:14:15.308248 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 177, in _build_instances
Jun 18 14:14:15.308494 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler image, security_groups, block_device_mapping)
Jun 18 14:14:15.309087 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler File "/opt/stack/new/nova/nova/cells/scheduler.py", line 96, in _create_instances_here
Jun 18 14:14:15.309390 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler instance.update(instance_values)
Jun 18 14:14:15.309652 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 790, in update
Jun 18 14:14:15.309912 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler setattr(self, key, value)
Jun 18 14:14:15.310183 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 72, in setter
Jun 18 14:14:15.310415 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler field_value = field.coerce(self, name, value)
Jun 18 14:14:15.310738 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/fields.py", line 195, in coerce
Jun 18 14:14:15.311043 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler return self._type.coerce(obj, attr, value)
Jun 18 14:14:15.311344 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/fields.py", line 799, in coerce
Jun 18 14:14:15.311642 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler obj_name])})
Jun 18 14:14:15.311995 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler ValueError: An object of type nova.objects.instance.TrustedCerts is required in field trusted_certs, not a dict
Jun 18 14:14:15.312279 ubuntu-xenial-inap-mtl01-0000198149 nova-cells[27973]: ERROR nova.cells.scheduler

http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Couldn't%20communicate%20with%20cell%20'child'%3A%20ValueError%3A%20An%20object%20of%20type%20nova.objects.instance.TrustedCerts%20is%20required%20in%20field%20trusted_certs%2C%20not%20a%20dict%5C%22%20AND%20tags%3A%5C%22screen-n-cell-child.txt%5C%22&from=7d

275 hits in 24 hours, all failures.

We need to just skip the test in the cells v1 job:

https://review.openstack.org/#/c/576194/

Tags: api cells
Matt Riedemann (mriedem)
Changed in nova:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to nova (master)

Reviewed: https://review.openstack.org/576194
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=530c24596a74a6115f2e944176c46e4f3d199811
Submitter: Zuul
Branch: master

commit 530c24596a74a6115f2e944176c46e4f3d199811
Author: Matt Riedemann <email address hidden>
Date: Mon Jun 18 12:00:11 2018 -0400

    Skip ServerShowV263Test.test_show_update_rebuild_list_server for cellsv1

    Tempest change I48f62d36a871a95601ebf277a2f39a41a873daa8 added
    a new rebuild test for microversion 2.63 so we need to exclude that
    test also for cells v1 since rebuild is racy in cells v1.

    Change-Id: Iff89b9714e2413716bf87db6f0d773787c06eda3
    Related-Bug: #1777478

Matt Riedemann (mriedem)
Changed in nova:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.