Launchpad itself

login servers not handling load well causing InterfaceError OOPSes

Bug #404341 reported by Ursula Junque
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
Critical
Unassigned

Bug Description

We're having again InterfaceErrors, as seen on OOPS-1301I189:

  InterfaceError: connection already closed

Also OOPS-1301I196, OOPS-1301I202, OOPS-1301I205, and others.

At the same time we're having OperationalErrors (OOPS-1301I454) and DisconnectionErrors (OOPS-1301J218), they appear together.

This problem was being tracked by bug 374909 and bug 360846.

See original description
Revision history for this message
Ursula Junque (ursinha) wrote :

mthaddon added that we're not sure that the errors are related to load (i.e. number of requests) or just a random error.

description: updated
Revision history for this message
Guilherme Salgado (salgado) wrote :

This is because the fix for bug 374909 is not present in our storm branch -- it used to be in the previous one we had.

We need to backport r308 from storm's trunk into our branch, but for now that change has been cowboyed on production so that we don't have to keep restarting the app servers.

Changed in launchpad-foundations:
importance: Undecided → Critical
status: New → Triaged
Revision history for this message
Diogo Matsubara (matsubara) wrote : Bug fixed by a commit

Fixed in db r8322.

Changed in launchpad-foundations:
status: Triaged → Fix Committed
Revision history for this message
Ursula Junque (ursinha) wrote :

Salgado said today that the storm fix not entirely solved the problem. He's working on a fix right now.

Changed in launchpad-foundations:
status: Fix Committed → In Progress
Revision history for this message
Guilherme Salgado (salgado) wrote :

A temporary fix has been cowboyed into production while I write a proper fix for storm's bug 374909, which will be later cherry picked into our storm version.

Changed in launchpad-foundations:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.