100x increase on shared-db-relation-changed activity recent charm revisions
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| mysql (Juju Charms Collection) |
Fix Released
|
High
|
Edward Hope-Morley | ||
| percona-cluster (Juju Charms Collection) |
Fix Released
|
High
|
Edward Hope-Morley | ||
Bug Description
branch: lp:~openstack-charmers/charms/trusty/percona-cluster/trunk
On a maas+juju openstack HA deployment over 8 metal hosts (1*MaaS +3*HA
+ 4*compute-storage, trusty charms from trunk), we are seeing a huge
increase on shared-
from about 1 month ago.
I deployed the same setup but with percona r36 instead, grepping + aggregating
":shared-
ubuntu@node0:~$ egrep -o [a-z0-9/
* percona r36:
334 neutron-
336 neutron-
362 neutron-
307 neutron-
406 neutron-
436 neutron-
420 nova-cloud-
570 nova-cloud-
508 nova-cloud-
* percona r39:
33832 neutron-
34470 neutron-
35117 neutron-
14679 neutron-
20094 neutron-
17232 neutron-
54147 nova-cloud-
52044 nova-cloud-
38299 nova-cloud-
-> full log: http://
AFAICS r36,r37 look suspicious for potentially triggering this behavior.
Related branches
- Liam Young (community): Approve
-
Diff: 325 lines (+115/-87)4 files modifiedhooks/mysql.py (+30/-28)
hooks/percona_hooks.py (+47/-35)
hooks/percona_utils.py (+8/-6)
unit_tests/test_mysql.py (+30/-18)
- Liam Young (community): Approve
-
Diff: 439 lines (+427/-0)2 files modifiedcharmhelpers/contrib/database/mysql.py (+372/-0)
tests/contrib/database/test_mysql.py (+55/-0)
- Liam Young (community): Approve
-
Diff: 1880 lines (+908/-484)29 files modifiedcharm-helpers.yaml (+1/-0)
hooks/charmhelpers/__init__.py (+16/-0)
hooks/charmhelpers/contrib/__init__.py (+15/-0)
hooks/charmhelpers/contrib/database/mysql.py (+372/-0)
hooks/charmhelpers/contrib/hahelpers/__init__.py (+15/-0)
hooks/charmhelpers/contrib/hahelpers/cluster.py (+47/-13)
hooks/charmhelpers/contrib/network/__init__.py (+15/-0)
hooks/charmhelpers/contrib/network/ip.py (+16/-0)
hooks/charmhelpers/contrib/peerstorage/__init__.py (+16/-0)
hooks/charmhelpers/core/__init__.py (+15/-0)
hooks/charmhelpers/core/decorators.py (+57/-0)
hooks/charmhelpers/core/fstab.py (+16/-0)
hooks/charmhelpers/core/hookenv.py (+16/-0)
hooks/charmhelpers/core/host.py (+34/-7)
hooks/charmhelpers/core/services/__init__.py (+16/-0)
hooks/charmhelpers/core/services/base.py (+16/-0)
hooks/charmhelpers/core/services/helpers.py (+16/-0)
hooks/charmhelpers/core/sysctl.py (+27/-5)
hooks/charmhelpers/core/templating.py (+19/-3)
hooks/charmhelpers/fetch/__init__.py (+24/-1)
hooks/charmhelpers/fetch/archiveurl.py (+16/-0)
hooks/charmhelpers/fetch/bzrurl.py (+25/-1)
hooks/charmhelpers/fetch/giturl.py (+20/-0)
hooks/charmhelpers/payload/__init__.py (+16/-0)
hooks/charmhelpers/payload/execd.py (+16/-0)
hooks/mysql.py (+0/-368)
hooks/percona_hooks.py (+31/-29)
hooks/percona_utils.py (+15/-4)
unit_tests/test_mysql.py (+0/-53)
- Liam Young (community): Approve
- Cory Johns (community): Approve
- Review Queue (community): Needs Fixing (automated testing)
-
Diff: 1602 lines (+1001/-191)24 files modifiedcharm-helpers.yaml (+2/-0)
hooks/charmhelpers/__init__.py (+16/-0)
hooks/charmhelpers/contrib/__init__.py (+15/-0)
hooks/charmhelpers/contrib/database/mysql.py (+372/-0)
hooks/charmhelpers/contrib/network/__init__.py (+15/-0)
hooks/charmhelpers/contrib/network/ip.py (+16/-0)
hooks/charmhelpers/contrib/peerstorage/__init__.py (+148/-0)
hooks/charmhelpers/core/__init__.py (+15/-0)
hooks/charmhelpers/core/decorators.py (+57/-0)
hooks/charmhelpers/core/fstab.py (+16/-0)
hooks/charmhelpers/core/hookenv.py (+32/-4)
hooks/charmhelpers/core/host.py (+59/-9)
hooks/charmhelpers/core/services/__init__.py (+16/-0)
hooks/charmhelpers/core/services/base.py (+16/-0)
hooks/charmhelpers/core/services/helpers.py (+16/-0)
hooks/charmhelpers/core/sysctl.py (+27/-5)
hooks/charmhelpers/core/templating.py (+19/-3)
hooks/charmhelpers/fetch/__init__.py (+24/-1)
hooks/charmhelpers/fetch/archiveurl.py (+16/-0)
hooks/charmhelpers/fetch/bzrurl.py (+25/-1)
hooks/charmhelpers/fetch/giturl.py (+26/-3)
hooks/common.py (+8/-59)
hooks/ha_relations.py (+10/-0)
hooks/shared_db_relations.py (+35/-106)
| tags: | added: canonical-bootstack |
| tags: | added: canonical-is |
| Peter Sabaini (peter-sabaini) wrote | #1 |
| description: | updated |
| Changed in mysql (Juju Charms Collection): | |
| status: | New → In Progress |
| importance: | Undecided → Medium |
| importance: | Medium → High |
| assignee: | nobody → Liam Young (gnuoy) |
| Changed in mysql (Juju Charms Collection): | |
| assignee: | Liam Young (gnuoy) → Edward Hope-Morley (hopem) |
| affects: | mysql (Juju Charms Collection) → percona-cluster (Juju Charms Collection) |
| Changed in percona-cluster (Juju Charms Collection): | |
| milestone: | none → 15.04 |
| tags: | added: backport-potential |
| Edward Hope-Morley (hopem) wrote | #2 |
| Changed in mysql (Juju Charms Collection): | |
| status: | New → In Progress |
| importance: | Undecided → High |
| assignee: | nobody → Edward Hope-Morley (hopem) |
| milestone: | none → 15.04 |
| summary: |
- percona charm: 100x increase on shared-db-relation-changed activity - recent charm revisions + 100x increase on shared-db-relation-changed activity recent charm + revisions |
| Changed in percona-cluster (Juju Charms Collection): | |
| status: | In Progress → Fix Released |
| Changed in mysql (Juju Charms Collection): | |
| status: | In Progress → Fix Released |
With r37 I get:
root@entz:~# egrep -o [a-z0-9/
284 ceilometer/
1059 cinder/
1037 cinder/
301 cinder/
869 glance/
950 glance/
266 glance/
322 heat/0:
2470 keystone/
2948 keystone/
268 keystone/
1367 mysql/0:
1081 mysql/1:
1149 mysql/2:
893 neutron-
882 neutron-
677 neutron-
750 neutron-
1273 neutron-
991 neutron-
1521 nova-cloud-
1604 nova-cloud-
526 nova-cloud-
983 nova-compute/
887 nova-compute/
875 nova-compute/
882 nova-compute/