[2.0b4] Registering external rack controller tracebacks

Bug #1577970 reported by Andres Rodriguez
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
MAAS
Fix Released
Critical
Lee Trager

Bug Description

2016-05-04 06:40:19 [-] Rack controller '4y3ha6' needs to be refreshed; performing the refresh operation.
2016-05-04 06:40:19 [-] Unhandled error in Deferred:
2016-05-04 06:40:19 [-] Unhandled Error
        Traceback (most recent call last):
          File "/usr/lib/python3.5/threading.py", line 862, in run
            self._target(*self._args, **self._kwargs)
          File "/usr/lib/python3/dist-packages/provisioningserver/utils/twisted.py", line 875, in worker
            return target()
          File "/usr/lib/python3/dist-packages/twisted/_threads/_threadworker.py", line 46, in work
            task()
          File "/usr/lib/python3/dist-packages/twisted/_threads/_team.py", line 190, in doWork
            task()
        --- <exception caught here> ---
          File "/usr/lib/python3/dist-packages/twisted/python/threadpool.py", line 246, in inContext
            result = inContext.theWork()
          File "/usr/lib/python3/dist-packages/twisted/python/threadpool.py", line 262, in <lambda>
            inContext.theWork = lambda: context.call(ctx, func, *args, **kw)
          File "/usr/lib/python3/dist-packages/twisted/python/context.py", line 118, in callWithContext
            return self.currentContext().callWithContext(ctx, func, *args, **kw)
          File "/usr/lib/python3/dist-packages/twisted/python/context.py", line 81, in callWithContext
            return func(*args,**kw)
          File "/usr/lib/python3/dist-packages/provisioningserver/utils/twisted.py", line 908, in callInContext
            return func(*args, **kwargs)
          File "/usr/lib/python3/dist-packages/maasserver/utils/orm.py", line 516, in call_within_transaction
            return func_outside_txn(*args, **kwargs)
          File "/usr/lib/python3/dist-packages/maasserver/utils/orm.py", line 343, in retrier
            return func(*args, **kwargs)
          File "/usr/lib/python3.5/contextlib.py", line 30, in inner
            return func(*args, **kwds)
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 3578, in refresh
            self.save()
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 1278, in save
            super(Node, self).save(*args, **kwargs)
          File "/usr/lib/python3/dist-packages/maasserver/models/cleansave.py", line 28, in save
            self.full_clean()
          File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 1156, in full_clean
            self.clean()
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 1260, in clean
            self.clean_status(prev)
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 1229, in clean_status
            raise NodeStateViolation(error_text)
        maasserver.exceptions.NodeStateViolation: Invalid transition: Deployed -> Commissioning.
2016-05-04 06:40:19 [RegionServer,20,192.168.10.2] Successfully configured DHCPv4 on rack controller '4y3ha6'.
2016-05-04 06:40:19 [RegionServer,20,192.168.10.2] Successfully configured DHCPv6 on rack controller '4y3ha6'.
2016-05-04 06:40:20 [-] Successfully configured DNS.
2016-05-04 06:40:21 [RegionServer,1,192.168.20.104] Successfully configured DHCPv4 on rack controller '4y3h7n'.
2016-05-04 06:40:22 [RegionServer,2,192.168.10.27] Successfully configured DHCPv4 on rack controller '4y3h7n'.
2016-05-04 06:40:22 [RegionServer,1,192.168.20.104] Successfully configured DHCPv6 on rack controller '4y3h7n'.
2016-05-04 06:40:22 [RegionServer,2,192.168.10.27] Successfully configured DHCPv6 on rack controller '4y3h7n'.
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:23 +0000] "GET /MAAS/images-stream/streams/v1/index.json HTTP/1.1" 200 210 "-" "python-requests/2.9.1"
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:24 +0000] "GET /MAAS/images-stream/streams/v1/maas:v2:download.json HTTP/1.1" 200 559 "-" "python-requests/2.9.1"
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:23 +0000] "GET /MAAS/images-stream/streams/v1/index.json HTTP/1.1" 200 210 "-" "python-requests/2.9.1"
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:23 +0000] "GET /MAAS/images-stream/streams/v1/maas:v2:download.json HTTP/1.1" 200 559 "-" "python-requests/2.9.1"
2016-05-04 06:40:26 [-] 192.168.10.2 - - [03/May/2016:22:40:25 +0000] "GET /MAAS/images-stream/ubuntu/amd64/hwe-x/xenial/20160420.3/boot-initrd HTTP/1.1" 200 35749715 "-" "python-requests/2.9.1"
2016-05-04 06:40:26 [maasserver] ERROR: Unable to get RPC connection for rack controller 'maas-rack2' (4y3ha6)
2016-05-04 06:40:26 [-] 192.168.10.2 - - [03/May/2016:22:40:25 +0000] "GET /MAAS/images-stream/ubuntu/amd64/hwe-x/xenial/20160420.3/boot-kernel HTTP/1.1" 200 6756274 "-" "python-requests/2.9.1"
2016-05-04 06:40:35 [-] 192.168.10.2 - - [03/May/2016:22:40:34 +0000] "GET /MAAS/images-stream/ubuntu/amd64/hwe-x/xenial/20160420.3/root-image.gz HTTP/1.1" 200 198751918 "-" "python-requests/2.9.1"
2016-05-04 06:40:35 [-] 127.0.0.1 - - [03/May/2016:22:40:34 +0000] "GET /MAAS/rpc/ HTTP/1.0" 200 432 "-" "provisioningserver.rpc.clusterservice.ClusterClientService"
2016-05-04 06:40:37 [maasserver] ERROR: Unable to get RPC connection for rack controller 'maas-rack2' (4y3ha6)
2016-05-04 06:40:48 [maasserver] ERROR: Unable to get RPC connection for rack controller 'maas-rack2' (4y3ha6)
2016-05-04 06:40:49 [twisted.internet.protocol.Factory] RegionServer connection established (HOST:IPv4Address(TCP, '192.168.10.27', 5250) PEER:IPv4Address(TCP, '192.168.10.2', 38426))
2016-05-04 06:40:49 [twisted.internet.protocol.Factory] RegionServer connection established (HOST:IPv4Address(TCP, '192.168.20.104', 5253) PEER:IPv4Address(TCP, '192.168.20.5', 40226))
2016-05-04 06:40:49 [RegionServer,18,192.168.10.2] Rack controller authenticated from '192.168.10.2:38426'.
2016-05-04 06:40:49 [RegionServer,20,192.168.20.5] Rack controller authenticated from '192.168.20.5:40226'.

Related branches

Changed in maas:
milestone: none → 2.0.0
importance: Undecided → Critical
status: New → Confirmed
Gavin Panella (allenap)
Changed in maas:
status: Confirmed → Triaged
Changed in maas:
status: Triaged → Fix Committed
assignee: nobody → Lee Trager (ltrager)
Changed in maas:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.