glance_store

ceph job is busted in the gate on "AttributeError: 'module' object has no attribute 'ImageExists'"

Bug #1492432 reported by Matt Riedemann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
glance_store
Fix Released
Critical
Matt Riedemann

Bug Description

http://logs.openstack.org/90/220490/2/gate/gate-tempest-dsvm-full-ceph/5c943bc//logs/screen-g-api.txt.gz#_2015-09-04_18_44_25_719

2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils [req-a119411d-e60d-4bed-8a48-aeaa2f97073a d2e6a51ec2934d3aa24a2ff5c9668a1c 9457a434bade49f0a5a9fcf0a05af77f - - -] Failed to upload image ecc363d8-1663-494c-8680-ca72ad8161e4
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils Traceback (most recent call last):
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils File "/opt/stack/new/glance/glance/api/v1/upload_utils.py", line 113, in upload_data_to_store
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils context=req.context)
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils File "/usr/local/lib/python2.7/dist-packages/glance_store/backend.py", line 340, in store_add_to_backend
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils context=context)
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils File "/usr/local/lib/python2.7/dist-packages/glance_store/capabilities.py", line 226, in op_checker
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils return store_op_fun(store, *args, **kwargs)
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils File "/usr/local/lib/python2.7/dist-packages/glance_store/_drivers/rbd.py", line 374, in add
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils except rbd.ImageExists:
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils AttributeError: 'module' object has no attribute 'ImageExists'
2015-09-04 18:44:25.719 24605 ERROR glance.api.v1.upload_utils

This is killing the ceph job since glance-store 0.9.0 was released on 9/3:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiZXhjZXB0IHJiZC5JbWFnZUV4aXN0c1wiIEFORCBtZXNzYWdlOlwiQXR0cmlidXRlRXJyb3I6ICdtb2R1bGUnIG9iamVjdCBoYXMgbm8gYXR0cmlidXRlICdJbWFnZUV4aXN0cydcIiBBTkQgYnVpbGRfbmFtZTpcImdhdGUtdGVtcGVzdC1kc3ZtLWZ1bGwtY2VwaFwiIEFORCB0YWdzOlwic2NyZWVuLWctYXBpLnR4dFwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDQxMzkzOTY5NzQ4LCJtb2RlIjoiIiwiYW5hbHl6ZV9maWVsZCI6IiJ9

Revision history for this message
Matt Riedemann (mriedem) wrote :

I actually don't think this is glance-store 0.9.0 the only change in that that's new is https://review.openstack.org/#/c/200554/ and that passed the ceph job. This is maybe an upstream dependency regression.

summary: - ceph job is busted in the gate on latest glance-store 0.9.0
+ ceph job is busted in the gate on "AttributeError: 'module' object has
+ no attribute 'ImageExists'"
Revision history for this message
Matt Riedemann (mriedem) wrote :

This might be related:

https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1477174

When the above change passed the ceph job, it was tested against the librados 0.80.9 package:

(2:25:37 PM) mriedem: http://logs.openstack.org/54/200554/6/check/gate-tempest-dsvm-full-ceph-src-glance_store/d76d300/logs/dpkg-l.txt.gz
(2:25:41 PM) mriedem: ii librados2 0.80.9-0ubuntu0.14.04.2 amd64 RADOS distributed object store client library

Now things are failing with the 0.80.10 package:

ii librados2 0.80.10-0ubuntu0.14.04.1 amd64 RADOS distributed object store client library

Revision history for this message
Matt Riedemann (mriedem) wrote :

sdague pointed out the upper-constraints processing in infra might actually be breaking the libs-from-git code that would be used in the src job:

http://logs.openstack.org/20/220320/1/check/gate-tempest-dsvm-full-ceph-src-glance_store/83b8b59/logs/devstacklog.txt.gz#_2015-09-04_13_51_33_905

Changed in glance-store:
importance: Undecided → Critical
status: New → Confirmed
Revision history for this message
Matt Riedemann (mriedem) wrote :

This should get the glance store src job testing trunk code again hopefully:

https://review.openstack.org/#/c/220648/

Revision history for this message
Matt Riedemann (mriedem) wrote :

This is my stab at a fix:

https://review.openstack.org/#/c/220646/

Changed in glance-store:
assignee: nobody → Matt Riedemann (mriedem)
status: Confirmed → In Progress
Revision history for this message
Matt Riedemann (mriedem) wrote :

Fixed in glance-store 0.9.1.

Changed in glance-store:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.