branch mirror script can overload on a single site

Bug #519159 reported by Steve McInerney
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Launchpad itself
Invalid
High
Unassigned

Bug Description

cronscripts/supermirror-pull.py was getting in trouble trying to only mirror from a single site.
As this site was somewhat unresponsive to codehost; this basically locked the entire process of branch mirroring dead.
The fix was to kill off *most* of the child processes accessing this site and allow other sites to get a look in.

Perhaps some tests to not poll too many simultaneous requests to the same remote site, to guard against similar happenings?

eg: https://pastebin.canonical.com/27576/

Tim Penhey (thumper)
Changed in launchpad-code:
status: New → Triaged
tags: added: branch-puller
Changed in launchpad-code:
importance: Undecided → Medium
Tom Haddon (mthaddon)
tags: added: canonical-losa-lp
Revision history for this message
Robert Collins (lifeless) wrote :

High as operational issue, OTOH I think we're nuking that backend anyhow.

Changed in launchpad:
importance: Medium → High
Revision history for this message
Robert Collins (lifeless) wrote :

This backend is gone, we use the import infrastructure now.

Changed in launchpad:
status: Triaged → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.