[2.2, r5770] Commissioning 5 machines at the same time, 1 was set to Ready and the 'owner' wasn't cleared

Bug #1669226 reported by Andres Rodriguez
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
MAAS
Fix Released
Critical
Blake Rouse

Bug Description

Commissioned 5 machines. All went to ready state.

4 cleared the owner
1 kept the owner

There are no errors in the logs.

 node01.maas Ready 4 16.0 1 250.1
 node02.maas Ready 4 8.0 1 250.1
 node03.maas Ready admin 4 8.0 1 120.0
 node04.maas Ready 4 8.0 1 120.0
 node05.maas Ready 4 8.0 1 120.0

Additionally, this prevents machines from being allocated:

2017-03-02 10:29:26 maasserver: [error] ################################ Exception: ################################
2017-03-02 10:29:26 maasserver: [error] Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 132, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/utils/views.py", line 177, in view_atomic_with_post_commit_savepoint
    return view_atomic(*args, **kwargs)
  File "/usr/lib/python3.5/contextlib.py", line 30, in inner
    return func(*args, **kwds)
  File "/usr/lib/python3/dist-packages/maasserver/api/support.py", line 59, in __call__
    response = upcall(request, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/django/views/decorators/vary.py", line 21, in inner_func
    response = func(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/piston3/resource.py", line 190, in __call__
    result = self.error_handler(e, request, meth, em_format)
  File "/usr/lib/python3/dist-packages/piston3/resource.py", line 188, in __call__
    result = meth(request, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/api/support.py", line 298, in dispatch
    return function(self, request, *args, **kwargs)
  File "/usr/lib/python3/dist-packages/maasserver/api/machines.py", line 1345, in allocate
    bridge_fd=bridge_fd)
  File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 2410, in acquire
    assert self.owner is None
AssertionError

Related branches

Changed in maas:
importance: Undecided → High
status: New → Triaged
milestone: none → 2.2.0
Revision history for this message
Andres Rodriguez (andreserl) wrote :
Download full text (3.7 KiB)

Mar 1 21:20:30 maas00 maas.node: [info] node03: Status transition from NEW to COMMISSIONING
Mar 1 21:20:30 maas00 maas.power: [info] Changing power state (on) of node: node03 (q7sq6c)
Mar 1 21:20:30 maas00 maas.node: [info] node03: Commissioning started
Mar 1 21:20:30 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7d:16:d0, 192.168.100.13
Mar 1 21:20:33 maas00 maas.api: [info] node02: Enlisted new machine
Mar 1 21:20:33 maas00 maas.node: [info] node02: Status transition from NEW to COMMISSIONING
Mar 1 21:20:33 maas00 maas.power: [info] Changing power state (on) of node: node02 (r637h8)
Mar 1 21:20:33 maas00 maas.node: [info] node02: Commissioning started
Mar 1 21:20:33 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7d:06:2d, 192.168.100.12
Mar 1 21:20:36 maas00 maas.api: [info] node01: Enlisted new machine
Mar 1 21:20:36 maas00 maas.node: [info] node01: Status transition from NEW to COMMISSIONING
Mar 1 21:20:36 maas00 maas.power: [info] Changing power state (on) of node: node01 (bm6hbe)
Mar 1 21:20:36 maas00 maas.node: [info] node01: Commissioning started
Mar 1 21:20:36 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7d:17:d2, 192.168.100.11
Mar 1 21:20:43 maas00 maas.power: [info] Changed power state (on) of node: node04 (qnbfsh)
Mar 1 21:20:50 maas00 maas.power: [info] Changed power state (on) of node: node05 (b7r7et)
Mar 1 21:20:54 maas00 maas.power: [info] Changed power state (on) of node: node03 (q7sq6c)
Mar 1 21:20:57 maas00 maas.power: [info] Changed power state (on) of node: node02 (r637h8)
Mar 1 21:20:57 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: 00:0e:c6:88:b7:9f, 10.90.90.1
Mar 1 21:20:59 maas00 maas.interface: [info] eno1 (physical) on maas00: New MAC, IP binding observed: f0:d5:bf:11:83:57, 192.168.1.87
Mar 1 21:21:00 maas00 maas.power: [info] Changed power state (on) of node: node01 (bm6hbe)
Mar 1 21:21:01 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7d:06:2d, 10.90.90.190
Mar 1 21:23:00 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7e:b4:99, 10.90.90.191
Mar 1 21:23:01 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7c:4d:75, 10.90.90.192
Mar 1 21:23:03 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7d:16:d0, 10.90.90.193
Mar 1 21:23:06 maas00 maas.node: [info] node02: Storage layout was set to flat.
Mar 1 21:23:06 maas00 maas.node: [info] node02: Status transition from COMMISSIONING to TESTING
Mar 1 21:23:10 maas00 maas.interface: [info] usb0 (physical) on maas00: New MAC, IP binding observed: b8:ae:ed:7d:17:d2, 10.90.90.194
Mar 1 21:23:10 maas00 maas.node: [info] node02: Status transition from TESTING to READY
Mar 1 21:25:11 maas00 maas.node: [info] node04: Storage layout was set to flat.
Mar 1 21:25:11 maas00 maas.node: [info] node04: Status transition from COMMISSIONING to TESTING
Mar 1 21:25:13 maas00 maas.node...

Read more...

Revision history for this message
Andres Rodriguez (andreserl) wrote :
Revision history for this message
Andres Rodriguez (andreserl) wrote :

LP is being silly, other logs here:

roaksoax@rivals:~$ pastebinit maas.log
http://paste.ubuntu.com/24096399/
roaksoax@rivals:~$ pastebinit rackd.log
http://paste.ubuntu.com/24096400/

description: updated
Changed in maas:
importance: High → Critical
Changed in maas:
assignee: nobody → Blake Rouse (blake-rouse)
Changed in maas:
status: Triaged → In Progress
Changed in maas:
status: In Progress → Fix Committed
Changed in maas:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.