peergrouper spins in local/upgraded environment

Bug #1309444 reported by John A Meinel
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
juju-core
Fix Released
High
Vladislav Klyachin

Bug Description

The peergrouper is intended to monitor the MongoDB replica health and make sure everything is functioning well.
However, when run in the local provider, or in an upgraded environment (while we haven't finished all the upgrade steps), it spams the log file with:
2014-04-18 09:45:38 INFO juju.worker runner.go:260 start "peergrouper"
2014-04-18 09:45:38 DEBUG juju.worker.peergrouper worker.go:421 found new machine "0"
2014-04-18 09:45:38 ERROR juju.worker.peergrouper worker.go:137 peergrouper loop terminated: cannot get replica set status: cannot get replica set status: not running with --replSet
2014-04-18 09:45:38 ERROR juju.worker runner.go:218 exited "peergrouper": cannot get replica set status: cannot get replica set status: not running with --replSet
2014-04-18 09:45:38 INFO juju.worker runner.go:252 restarting "peergrouper" in 3s
2014-04-18 09:45:38 DEBUG juju.state.apiserver apiserver.go:137 -> [1] machine-0 4.999144723s {"RequestId":71,"Response":{}} NotifyWatcher["3"].Next
2014-04-18 09:45:38 DEBUG juju.state.apiserver apiserver.go:130 <- [1] machine-0 {"RequestId":74,"Type":"NotifyWatcher","Id":"3","Request":"Next","Params":{}}
2014-04-18 09:45:38 DEBUG juju.state.apiserver apiserver.go:130 <- [1] machine-0 {"RequestId":75,"Type":"Machiner","Request":"APIHostPorts","Params":{}}
2014-04-18 09:45:38 DEBUG juju.state.apiserver apiserver.go:137 -> [1] machine-0 874.972us {"RequestId":75,"Response":{"Servers":[[{"Value":"localhost","Type":"hostname","NetworkName":"","NetworkScope":"public","Port":17070},{"Value":"10.0.3.1","Type":"ipv4","NetworkName":"","NetworkScope":"local-cloud","Port":17070},{"Value":"127.0.0.1","Type":"ipv4","NetworkName":"","NetworkScope":"local-machine","Port":17070},{"Value":"192.168.0.108","Type":"ipv4","NetworkName":"","NetworkScope":"local-cloud","Port":17070},{"Value":"192.168.122.1","Type":"ipv4","NetworkName":"","NetworkScope":"local-cloud","Port":17070},{"Value":"::1","Type":"ipv6","NetworkName":"","NetworkScope":"local-machine","Port":17070},{"Value":"fe80::221:6aff:fe5f:7c8","Type":"ipv6","NetworkName":"","NetworkScope":"","Port":17070},{"Value":"fe80::ac35:beff:fe6c:a6ae","Type":"ipv6","NetworkName":"","NetworkScope":"","Port":17070}]]}} Machiner[""].APIHostPorts
2014-04-18 09:45:39 INFO juju.worker.apiaddressupdater apiaddressupdater.go:58 API addresses updated to [["public:localhost" "local-cloud:10.0.3.1" "local-machine:127.0.0.1" "local-cloud:192.168.0.108" "local-cloud:192.168.122.1" "local-machine:::1" "fe80::221:6aff:fe5f:7c8" "fe80::ac35:beff:fe6c:a6ae"]]
2014-04-18 09:45:41 INFO juju.worker runner.go:260 start "peergrouper"
2014-04-18 09:45:41 DEBUG juju.worker.peergrouper worker.go:421 found new machine "0"
2014-04-18 09:45:41 ERROR juju.worker.peergrouper worker.go:137 peergrouper loop terminated: cannot get replica set status: cannot get replica set status: not running with --replSet
2014-04-18 09:45:41 ERROR juju.worker runner.go:218 exited "peergrouper": cannot get replica set status: cannot get replica set status: not running with --replSet
2014-04-18 09:45:41 INFO juju.worker runner.go:252 restarting "peergrouper" in 3s

If we aren't going to have upgrade working to bring up --replicaSet or if we are going to leave it disabled for local provider, we need to squelch it. Possibly it is sufficient to just note that the DB isn't in replica mode and just exit the peer grouper, as mongo can't start to be in replica mode without restarting it again anyway.

Tags: ha logging

Related branches

Changed in juju-core:
assignee: nobody → Vladislav Klyachin (klyachin)
John A Meinel (jameinel)
Changed in juju-core:
milestone: 1.20.0 → 1.19.1
Curtis Hovey (sinzui)
Changed in juju-core:
milestone: 1.19.1 → 1.20.0
Changed in juju-core:
milestone: 1.20.0 → next-stable
Go Bot (go-bot)
Changed in juju-core:
status: Triaged → Fix Committed
Curtis Hovey (sinzui)
Changed in juju-core:
milestone: next-stable → 1.19.3
Revision history for this message
Kapil Thangavelu (hazmat) wrote :

This needs backporting to 1.18

Revision history for this message
Kapil Thangavelu (hazmat) wrote :

oh sorry.. user was on 1.19.. obviously replica sets are only in 1.19 no need to backport

Curtis Hovey (sinzui)
Changed in juju-core:
status: Fix Committed → Fix Released
Revision history for this message
Christian Reis (kiko) wrote :

Is there an easy way for me to at least quiet the log spam?

Revision history for this message
John A Meinel (jameinel) wrote : Re: [Bug 1309444] Re: peergrouper spins in local/upgraded environment

You could edit the /etc/init/juju*db.conf and change the line that starts
mongo to add "--replicaSet juju", which would have the peer grouper
actually run.
Alternatively you could probably suppress all logging of the "juju.worker"
stuff with:
 juju set-env logging-config="juju.worker=CRITICAL"
though it means you won't get any other warnings or info from other issues
with workers.

If you edit the upstart job, then you'll probably need to "restart
juju-..-db"

John
=:->

On Fri, May 30, 2014 at 10:59 PM, Christian Reis <email address hidden> wrote:

> Is there an easy way for me to at least quiet the log spam?
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1309444
>
> Title:
> peergrouper spins in local/upgraded environment
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/juju-core/+bug/1309444/+subscriptions
>

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.