OpenStack Compute (nova)

Nova Cloud Controller - instances creation issues

Bug #1822541 reported by Lorenzo Cavassa on 2019-04-01

This bug report is a duplicate of: Bug #1812935: oslo cache mempool issues with python3. Edit Remove

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	OpenStack Compute (nova)	Fix Committed	Undecided	Andrew McLeod

Bug Description

Openstack Rocky
Ubuntu Bionic
Nova Charm 18.11 (or Next)

Description
===========

Nova Cloud Controller isn't able to spawn a new instance when deployed using an HA configuration.
If there is a single service unit only (no HA), it works properly.

Being a Rocky cloud, Memcached has been deployed and related with n-c-c.

Same cloud bundle but Openstack Queens instead of Rocky, everything works.

Tags:

Revision history for this message

Lorenzo Cavassa (lorenzo-cavassa) wrote on 2019-04-01:

Juju bundle Edit (45.5 KiB, text/plain)

bundle.yaml file

Andrew McLeod (admcleod) on 2019-04-01

Changed in nova:
assignee:	nobody → Andrew McLeod (admcleod)
status:	New → In Progress

Lorenzo Cavassa (lorenzo-cavassa) on 2019-04-01

tags:

added: atos

Ritesh Paiboina (rsritesh) on 2019-04-01

Changed in nova:
status:	In Progress → Incomplete
status:	Incomplete → In Progress

Revision history for this message

Andrew McLeod (admcleod) wrote on 2019-04-01:

Found the following error related to memcached and continuing to investigate

2019-04-01 10:33:58.051 17227 ERROR oslo_messaging.rpc.server

File "/usr/lib/python3/dist-packages/oslo_cache/_memcache_pool.py", line 206, in _create_connectio$2019-04-01 10:33:58.051 17227 ERROR oslo_messaging.rpc.server return _MemcacheClient(self.urls, **self._arguments)

2019-04-01 10:33:58.051 17227 ERROR oslo_messaging.rpc.server TypeError: object() takes no parameters

more complete log:

https://pastebin.canonical.com/p/DgQmV9JK2k/

Revision history for this message

Andrew McLeod (admcleod) wrote on 2019-04-01:

Repating log at publically accessible url: https://paste.ubuntu.com/p/RXvw5mpvKt/

Revision history for this message

Andrew McLeod (admcleod) wrote on 2019-04-01:

Have confirmed this is related to this bug:

https://bugs.launchpad.net/oslo.cache/+bug/1812935

If cache is disabled this is potentially a more suitable workaround, allowing HA to function, but I do not know the full impact of doing this.

/etc/nova/nova.conf has [cache] section with enabled = true, this can be changed to false and nova-conductor restarted - instances can then be created successfully.

Revision history for this message

Andrew McLeod (admcleod) wrote on 2019-04-09:

The bug referenced above points here:

https://review.openstack.org/#/c/640500/

Which needs to be merged / backported