[2.0b3] Tag changes depend on rack / cluster connection

Bug #1372544 reported by Gavin Panella
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
MAAS
Fix Released
Critical
Unassigned

Bug Description

(This bug is knowingly being introduced by lp:~allenap/maas/rpc-tags-region to unblock other work.)

At present, the computation to see if a tag matches a specific node is done on that node's cluster controller.

However, if a cluster is unconnected (via RPC) at the moment a tag is changed, the cluster is skipped, and the tag is not evaluated. Until the next time that tag is changed (and the cluster is up) this situation will remain.

Previously, when we used a message queue, a cluster could be down at the moment a tag was edited, but it would consume the evaluate-tag message when it later came back up (or when communication was restored, ...).

One solution to this is to break the need to always do the computation on the node's cluster. If we spread the load between clusters that /are/ available, we can evaluate a changed tag regardless of the availability of a node's cluster.

We may later want to add the means to detect out-of-date tags from the database (we can't right now, and never have been able to) so that we can more robustly recover from failures.

Tags: tech-debt

Related branches

summary: - Tag changes will never be evaluated on unconnected clusters
+ [2.0b3] Tag changes will never be evaluated on unconnected clusters
Changed in maas:
milestone: none → 2.0.0
importance: High → Critical
summary: - [2.0b3] Tag changes will never be evaluated on unconnected clusters
+ [2.0b3] Tag changes depend on rack / cluster connection
Changed in maas:
status: Triaged → Fix Committed
Changed in maas:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.