juju-core broken with OpenStack Havana for tenants with multiple networks

Bug #1241674 reported by James Page
44
This bug affects 7 people
Affects Status Importance Assigned to Milestone
juju-core
Fix Released
Critical
Martin Packman

Bug Description

The behavior of the nova API has changed a bit in the Havana release.

For tenants with multiple tenant networks, you have to specify which networks an instance will be connected to when booting the instance; this can be multiple networks but at least one must be specified otherwise you get an error back from nova:

{"badRequest": {"message": "Multiple possible networks found, use a Network ID to be more specific.", "code": 400}}

This only impacts tenants with multiple networks, with a single network everything is just peachy.

Related branches

Chris J Arges (arges)
tags: added: cts-cloud-review
Curtis Hovey (sinzui)
Changed in juju-core:
status: New → Triaged
importance: Undecided → High
tags: added: openstack
Mark Ramm (mark-ramm)
Changed in juju-core:
importance: High → Critical
importance: Critical → High
milestone: none → 2.0
Revision history for this message
Mark Ramm (mark-ramm) wrote :

This is impacting actual users, and given that we need to have a place to test the work -- it should be something we try to get done as quickly as possible.

Martin, I think IS will be very interested in helping us test this work, so feel free to contact them about this work.

Thanks!

Curtis Hovey (sinzui)
tags: added: openstack-provider
removed: openstack
Revision history for this message
James Page (james-page) wrote :

Please can we have an update on plans to fix this issue; its impacting havana cloud's and I keep getting asked about it :-)

Revision history for this message
John A Meinel (jameinel) wrote :

"havana cloud's" ?

People deploying onto an Openstack Havana cloud?

Anyway, I'm guessing we can do some of the bits that we're doing with VPC on AWS, but it depends on the details. One of the primary needs to actually fix this is to have a cloud where we can test it and actually know it is fixed. Is there one available? Is lcy02 upgraded to Havana?

Revision history for this message
John A Meinel (jameinel) wrote :

To clarify, my question is whether this is people deploying a Havana cloud, or people using Juju to deploy *onto* a Havana cloud.

And what specific configuration of all the different bits of those clouds, so that we can reproduce and actually fix the problem they are experiencing.

AFAIK there aren't any *public* clouds that are running Havana.

Revision history for this message
James Page (james-page) wrote :

John - the answer is people deploying onto havana based clouds.

The juju-core team have access to a havana based cloud with neutron networking - ping me on irc for details.

William Reade (fwereade)
Changed in juju-core:
milestone: 2.0 → 1.17.0
Curtis Hovey (sinzui)
Changed in juju-core:
milestone: 1.17.0 → 1.17.1
Revision history for this message
William Reade (fwereade) wrote :

See also lp:1188126

Changed in juju-core:
importance: High → Critical
Martin Packman (gz)
Changed in juju-core:
assignee: nobody → Martin Packman (gz)
status: Triaged → In Progress
Revision history for this message
Mark Ramm (mark-ramm) wrote :

We have to add a field in openstack juju config which allows you to set a default network interface to use.

Revision history for this message
John A Meinel (jameinel) wrote :

As I understand from Martin, the issue is that if you have 2 networks available in Havana, Openstack doesn't define which one is "default". So we need to add an environments.yaml level configuration which allows the user to specify which network to bind to. And then this needs to chain down into some lp:goose level changes to accept a network and configure it.

Martin Packman (gz)
Changed in juju-core:
milestone: 1.17.1 → 1.18.0
Martin Packman (gz)
Changed in juju-core:
milestone: 1.18.0 → 1.17.1
Go Bot (go-bot)
Changed in juju-core:
status: In Progress → Fix Committed
Curtis Hovey (sinzui)
Changed in juju-core:
status: Fix Committed → Fix Released
Revision history for this message
Brad Marshall (brad-marshall) wrote :

FWIW we've been experiencing this bug with our new Openstack cloud, and when I upgrade to 1.17.2, the error message goes away.

Do we have any idea on a release timeframe for this bug into a stable release? Ie, either when will 1.18 be out, or will there be a backport to 1.16? This is a critical issue for our new production cloud to be able to go live.

Revision history for this message
Jacek Nykis (jacekn) wrote :

I tested it today and this was still a problem:
{"badRequest": {"message": "Multiple possible networks found, use a Network ID to be more specific.", "code": 400}}

I went through the diff and found undocumented "network" option, after adding it to my environments.yaml it worked.
I think this bug should stay as "Fixed Commited" until work is finished off. For average user who does not want to read source code this is still broken.

I think we should:
1. Update docs
2. Provide better error message. Instead of returning json maybe print "Please specify network using 'network' option in environments.yaml"

And if we want juju to "just work" it could check which network is private and try using it first before giving up.

Revision history for this message
Martin Packman (gz) wrote :

You may find it useful to read the message I posted to the list, describing why the 'networks' config workaround was used here.

<https://lists.ubuntu.com/archives/juju/2014-January/003392.html>

I submitted a patch for the docs, I'll chase Nick to get it landed.

We don't have great options on making the error message better, as what we get from Openstack isn't a specific exception type, so it'd be detecting that string and rewriting it... which is somewhat vulnerable to changes their end.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.