Transient test failures: test_service.RemoteUserTest

Bug #1077065 reported by Dolph Mathews
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Identity (keystone)
Fix Released
Medium
Alvaro Lopez

Bug Description

The fix for bug 1045962 took an initial stab at fixing transient test failures by drastically reducing their frequency, but they still occur (by simply truncating timestamps before comparing them).

However, several more tests have been introduced in test_service which exhibit transient failures, thus increasing the likelihood that we see failures.

For example:

15:04:12 ======================================================================
15:04:12 FAIL: test_scoped_remote_authn (test_service.RemoteUserTest)
15:04:12 ----------------------------------------------------------------------
15:04:12 Traceback (most recent call last):
15:04:12 File "/home/jenkins/workspace/gate-keystone-python26/tests/test_service.py", line 124, in test_scoped_remote_authn
15:04:12 self.assertEqualTokens(local_token, remote_token)
15:04:12 File "/home/jenkins/workspace/gate-keystone-python26/tests/test_service.py", line 99, in assertEqualTokens
15:04:12 return self.assertDictEqual(normalize(a), normalize(b))
15:04:12 AssertionError: {'access': {'token': {'issued_at': '15:04:0', 'expires': '2012-11-10T15:04:', 'i [truncated]... != {'access': {'token': {'issued_at': '15:04:1', 'expires': '2012-11-10T15:04:', 'i [truncated]...
15:04:12 Diff is 1863 characters long. Set self.maxDiff to None to see it.
15:04:12 """Fail immediately, with the given message."""
15:04:12 >> raise self.failureException("{'access': {'token': {'issued_at': '15:04:0', 'expires': '2012-11-10T15:04:', 'i [truncated]... != {'access': {'token': {'issued_at': '15:04:1', 'expires': '2012-11-10T15:04:', 'i [truncated]...\nDiff is 1863 characters long. Set self.maxDiff to None to see it.")

Source: http://logs.openstack.org/15724/3/check/gate-keystone-python26/1474/console.html

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to keystone (master)

Fix proposed to branch: master
Review: https://review.openstack.org/15742

Changed in keystone:
status: Confirmed → In Progress
Dolph Mathews (dolph)
summary: - transient test failure: test_service.RemoteUserTest
+ Transient test failures: test_service.RemoteUserTest
Dolph Mathews (dolph)
Changed in keystone:
importance: High → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to keystone (master)

Reviewed: https://review.openstack.org/15742
Committed: http://github.com/openstack/keystone/commit/a10bd7a8eb418a4d9e84a9511ca3f0669e6e02e7
Submitter: Jenkins
Branch: master

commit a10bd7a8eb418a4d9e84a9511ca3f0669e6e02e7
Author: Dolph Mathews <email address hidden>
Date: Fri Nov 9 10:50:38 2012 -0600

    Fix transient test failures (bug 1077065, bug 1045962)

    Change-Id: I45a1167a473df02a4461286b8a09723315018fcb

Changed in keystone:
status: In Progress → Fix Committed
Revision history for this message
Alan Pevec (apevec) wrote :

Another transient issue with timestamps in test_scoped_nometa_remote_authn

http://logs.openstack.org/16286/1/check/gate-keystone-python26/1542/nose_results.html.gz

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to keystone (master)

Fix proposed to branch: master
Review: https://review.openstack.org/16290

Changed in keystone:
assignee: Dolph Mathews (dolph) → Alvaro Lopez (aloga)
status: Fix Committed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to keystone (master)

Reviewed: https://review.openstack.org/16290
Committed: http://github.com/openstack/keystone/commit/07525b135f4234fdbac20f2671b6806f0b96b2e6
Submitter: Jenkins
Branch: master

commit 07525b135f4234fdbac20f2671b6806f0b96b2e6
Author: Alvaro Lopez Garcia <email address hidden>
Date: Fri Nov 16 10:36:03 2012 +0100

    Refix transient test failures

    Commit a10bd7a8eb418a4d9e84a9511ca3f0669e6e02e7 fixed the issue with
    transient test failures, but during the rebase of the commit
    be754ff2bc05a0d262469edd7ce8fac19d457231 the fix was lost.

    Fixes bug 1077065

    Change-Id: I14311f56e6dd0103620b58e64bf0c78c7e32f61c

Changed in keystone:
status: In Progress → Fix Committed
Joseph Heck (heckj)
Changed in keystone:
milestone: none → grizzly-1
Thierry Carrez (ttx)
Changed in keystone:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in keystone:
milestone: grizzly-1 → 2013.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.