suspend/2_suspend_after_switch_to_card_PCI_ID││_0x1cbb_auto is not an auto test case

Bug #1832493 reported by Jerry Kao
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Checkbox Provider - Base
Fix Released
Medium
Betty Lin

Bug Description

[Summary]
I assume suspend_auto is a fully automated test case. But seems it's no diffenet from suspend advance test case. Please refer following output from checkbox.

-------------[ Running job 1 / 199. Estimated time left: unknown ]--------------
--[ Test suspend/resume after switching to NVIDIA Corporation PCI ID 0x1cbb ]---
ID: com.canonical.certification::suspend/2_suspend_after_switch_to_card_PCI_ID_0x1cbb_auto
Category: com.canonical.plainbox::suspend
PURPOSE:
    This test will check suspend and resume after switching to NVIDIA Corporation PCI ID 0x1cbb graphics card.
STEPS:
    1. Ensure you have switched to NVIDIA Corporation PCI ID 0x1cbb graphics card.
    2. Click "Test" and your system will suspend for about 30 - 60 seconds
    3. Observe the Power LED to see if it blinks or changes color during suspend
    4. If your system does not wake itself up after 60 seconds, please press the power button momentarily to wake the system manually
    5. If your system fails to wake at all and must be rebooted, restart System Testing after reboot and mark this test as Failed
VERIFICATION:
    Did your system suspend and resume correctly after switching to NVIDIA Corporation PCI ID 0x1cbb graphics card?
    (NOTE: Please only consider whether the system successfully suspended and resumed. Power/Suspend LED verification will occur after this test is completed.)
Pick an action
    => press ENTER to continue
  c => add a comment
  s => skip this job
  q => save the session and quit

[Steps to reproduce]

[Expected result]

[Actual result]

[Failure rate]

[Additional information]
CPU: Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz (12x)
kernel-version: 4.18.0-21-generic
system-manufacturer: Dell Inc.
bios-version: 1.6.0
GPU: 00:02.0 VGA compatible controller: Intel Corporation Device 3e9b
system-product-name: Precision 5530

Related branches

Revision history for this message
Jerry Kao (jerry.kao) wrote :

Automatically attached

Revision history for this message
Jerry Kao (jerry.kao) wrote :

Automatically attached

tags: added: ce-qa-concern
Jerry Kao (jerry.kao)
Changed in plainbox-provider-checkbox:
status: New → Confirmed
importance: Undecided → Medium
Revision history for this message
Jerry Kao (jerry.kao) wrote :

Same as this one com.canonical.certification::suspend/1_suspend_after_switch_to_card_PCI_ID_0x3e9b_auto

Revision history for this message
Jerry Kao (jerry.kao) wrote :

ID: com.canonical.certification::suspend/1_display_after_suspend_PCI_ID_0x3e9b_auto

This is the same case

Revision history for this message
Jerry Kao (jerry.kao) wrote :

test cases with _auto suffix

com.canonical.certification::suspend/2_resolution_before_suspend_PCI_ID_0x1cbb_auto
com.canonical.certification::sleep
com.canonical.certification::suspend/2_suspend_after_switch_to_card_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_suspend-time-check_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_suspend-single-log-attach_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_compiz_check_after_suspend_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_driver_version_after_suspend_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_resolution_after_suspend_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_display_after_suspend_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_glxgears_after_suspend_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_video_after_suspend_PCI_ID_0x1cbb_auto
com.canonical.certification::suspend/2_cycle_resolutions_after_suspend_PCI_ID_0x1cbb_auto

com.canonical.certification::suspend/1_resolution_before_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_suspend_after_switch_to_card_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_suspend-time-check_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_suspend-single-log-attach_PCI_ID_0x3e9b_auto

com.canonical.certification::suspend/1_compiz_check_after_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_driver_version_after_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_resolution_after_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_display_after_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_glxgears_after_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_video_after_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_cycle_resolutions_after_suspend_PCI_ID_0x3e9b_auto
com.canonical.certification::suspend/1_xrandr_screens_after_suspend.tar.gz_auto

Changed in plainbox-provider-checkbox:
assignee: nobody → Ray Chen (ray.chen)
Betty Lin (bettyl)
Changed in plainbox-provider-checkbox:
assignee: Ray Chen (ray.chen) → Betty Lin (bettyl)
Betty Lin (bettyl)
Changed in plainbox-provider-checkbox:
status: Confirmed → Fix Committed
milestone: none → 0.49.0
Revision history for this message
Ray Chen (ray.chen) wrote :

Verified pass with below checkbox version:

u@u-Inspiron-5594:~$ checkbox-cli --version
checkbox-ng: 1.5.0rc1
checkbox-support: 0.42.0rc1
com.canonical.ce:oem: 1.0
certification-client: 0.38.0rc1
plainbox-provider-checkbox: 0.49.0rc2
plainbox-provider-resource-generic: 0.41.0rc1
plainbox-provider-sru: 1.14.0rc1
plainbox-provider-tpm2: 1.11.0rc1

Test output:

-------------[ Running job 50 / 292. Estimated time left: unknown ]-------------
[ Test auto suspend/resume after switching to Advanced Micro Devices, Inc. [AMD/ATI] Jet PRO [Radeon R5 M230] ]
ID: com.canonical.certification::suspend/2_suspend_after_switch_to_card_Jet_PRO__Radeon_R5_M230__auto
Category: com.canonical.plainbox::suspend
... 8< -------------------------------------------------------------------------
==================== Test Results ====================
Average time to sleep: 8.05600
Average time to resume: 1.16600
Passed: 1
 - sleep
------------------------------------------------------------------------- >8 ---
Outcome: job passed

tags: added: cqa-verified
Changed in plainbox-provider-checkbox:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.