Comment 3 for bug 1816809

Revision history for this message
Pierre Equoy (pieq) wrote :

I tried to run the newly created “30 suspend/resume cycles and 1 poweroff, 3 times” tests [1] on a test device and ran into similar issue:

--------------[ Running job 3 / 3. Estimated time left: 0:00:01 ]---------------
[ 30 suspend/resume cycles and 1 poweroff, 3 times (check logs for timing issues) ]
ID: com.canonical.certification::power-management/suspend-30-cycles-time-check-with-coldboots
Category: com.canonical.plainbox::stress
... 8< -------------------------------------------------------------------------
Traceback (most recent call last):
  File "/tmp/nest-2odcydkh.4ad38fbc8c6cbad5fc5a0cbf97a6f45419f2ad609f25b34045d3fe8f4d75f781/sleep_time_check", line 75, in <module>
    sys.exit(main())
  File "/tmp/nest-2odcydkh.4ad38fbc8c6cbad5fc5a0cbf97a6f45419f2ad609f25b34045d3fe8f4d75f781/sleep_time_check", line 45, in main
    sleep_time = float(line.split(':')[1].strip())
ValueError: could not convert string to float: 'N/A'
------------------------------------------------------------------------- >8 ---
Outcome: job failed

It seems that the reported results are incorrect in the logs to begin with:

2019-02-27 18:12:39,366 INFO ==================== Test Results ====================
Average time to sleep: N/A
Average time to resume: N/A
High Failures: 1
 WARNING: The following test cases were reported as high
 level failures by fwts. Please review the log at
 /home/u/.cache/plainbox/sessions/checkbox-cli-2019-02-27T09.42.28.session/CHECKBOX_DATA/fwts.log for more information.
  - sleep

See attached session for more information.

[1] https://code.launchpad.net/~pieq/plainbox-provider-checkbox/+git/plainbox-provider-checkbox/+merge/362858