Provider for Plainbox - Canonical Certification (Legacy)

test case suspend/1_suspend_after_switch_to_card is not executed

Bug #1425386 reported by Jerry Kao on 2015-02-25

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Provider for Plainbox - Canonical Certification (Legacy)	Fix Released	Critical	Po-Hsu Lin	Provider for Plainbox - Canonical Certification (Legacy) 0.16

Bug Description

When running test with a hybrid graphics platform, plainbox request to switch graphic cards to test both iGPU and dGPU. The draft process is as following
1. graphics test for primary graphic card
2. switch to secondary graphic card (need to reboot system)
3. graphics test for secondary graphics card
4. other tests (including hibernate test)
5. monitor tests
6. suspend tests (including suspend_advanced, hybrid sleep)
7. after suspend tests (including display, resolution tests)
8. switch back primary graphics card (need to reboot system)
2013.com.canonical.certification::graphics/1_switch_card_.*
9. suspend for primary graphic card
2013.com.canonical.certification::suspend/1_suspend_after_switch_to_card_.*
10. display check for primary graphic card after susend
2013.com.canonical.certification::suspend/1_display_after_suspend.*

When I test with stella and clinet-cert-14.04 whitelist, test case "2013.com.canonical.certification::suspend/1_suspend_after_switch_to_card_.*" was not executed in both whitelist. After switch graphics in step 8 and resume plainbox, the next test case is "2013.com.canonical.certification::suspend/1_display_after_suspend.*". At that moment, system is just rebooted and not after suspend.

version of plainbox
ii plainbox 0.19~ppa~ubuntu14.04.1 all toolkit for software and hardware integration testing
ii plainbox-glmark2-es2-meta 0.14~ppa~ubuntu14.04.1 amd64 metapackage to selectively install glmark2-es2
ii plainbox-insecure-policy 0.19~ppa~ubuntu14.04.1 all policykit policy required to use plainbox (insecure version)
ii plainbox-provider-certification-client 0.14~ppa~ubuntu14.04.1 all Client Certification
ii plainbox-provider-checkbox 0.18~ppa2~ubuntu14.04.1 amd64 CheckBox provider for PlainBox
ii plainbox-provider-oem 0.1ubuntu45 all plainbox oem provider
ii plainbox-provider-oem-stella 0.1ubuntu45 all plainbox oem provider for stella
ii plainbox-provider-resource-generic 0.16~ppa~ubuntu14.04.1 amd64 CheckBox generic resource jobs provider
ii python3-plainbox 0.19~ppa~ubuntu14.04.1 all toolkit for software and hardware testing (python3 module)

Tags:

Related branches

lp:~cypressyew/checkbox/fix-missing-hybrid-graphic-s3

Merged into lp:checkbox at revision 3609

Zygmunt Krynicki (community): Approve on 2015-03-10

Revision history for this message

Jerry Kao (jerry.kao) wrote on 2015-02-25:

stella.session.tar.gz Edit (784.6 KiB, application/x-tar)

Changed in checkbox:
importance:	Undecided → High
tags:	added: ce-qa-concern

Revision history for this message

Jerry Kao (jerry.kao) wrote on 2015-02-25:

stella-laptop-full.whitelist Edit (26.1 KiB, text/plain)

Revision history for this message

Jerry Kao (jerry.kao) wrote on 2015-02-25:

client-cert-14.04.session.tar.gz Edit (870.7 KiB, application/x-tar)

Revision history for this message

Jerry Kao (jerry.kao) wrote on 2015-02-25:

client-cert-14-04.whitelist Edit (9.6 KiB, text/plain)

Revision history for this message

Jerry Kao (jerry.kao) wrote on 2015-02-25:

u@u-HP-EliteBook-840-G2:~$ apt-cache policy plainbox
plainbox:
  Installed: 0.19~ppa~ubuntu14.04.1
  Candidate: 0.19~ppa~ubuntu14.04.1
  Version table:
*** 0.19~ppa~ubuntu14.04.1 0
        500 http://ppa.launchpad.net/hardware-certification/public/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status
     0.5.3-2 0
        500 http://archive.ubuntu.com/ubuntu/ trusty/universe amd64 Packages

Revision history for this message

Jerry Kao (jerry.kao) wrote on 2015-02-25:

provider '2013.com.canonical.certification:certification-client'
provider '2013.com.canonical.certification:checkbox'
provider '2013.com.canonical.certification:plainbox-resources'
provider '2014.com.canonical.ce:oem'

Ara Pulido (ara) on 2015-03-10

Changed in checkbox:
importance:	High → Critical

Ara Pulido (ara) on 2015-03-10

Changed in checkbox:
assignee:	nobody → Po-Hsu Lin (cypressyew)

Po-Hsu Lin (cypressyew) on 2015-03-10

Changed in checkbox:
status:	New → In Progress

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2015-03-10:

I think we're missing the generator for it here.

Po-Hsu Lin (cypressyew) on 2015-03-10

affects:	checkbox → plainbox-provider-canonical-certification
Changed in plainbox-provider-canonical-certification:
milestone:	none → 0.16

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2015-03-10:

I guess this also affects CDTS, will need to confirm this later.

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2015-03-11:

CDTS will only suspend once for it, so it's affected, but I'm not sure if this is the desired feature (since it's for IHV).
I will add CDTS as an also affected project, but leave it there for others to decide.

Changed in plainbox-provider-canonical-certification:
status:	In Progress → Fix Committed

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2015-03-11:

#10

BTW, suspend/1_display_after_suspend and suspend/2_display_after_suspend are not tested in CDTS as well.

Revision history for this message

Pierre Equoy (pieq) wrote on 2015-04-21:

#11

Stella switched to Test Plans in mid-March and in the process, we included Po-Hsu's modification (see patch).

Tested on a Stella device using the Stella Laptop test plan available in v0.6 of the OEM providers, the following happens:

1. graphics test for primary graphic card
2. switch to secondary graphic card (need to reboot system)
3. graphics test for secondary graphics card
4. other tests (including hibernate test)
5. monitor tests
6. suspend tests (including suspend_advanced, hybrid sleep)
7. after suspend tests (including display, resolution tests)
8. switch back primary graphics card (need to reboot system) (2013.com.canonical.certification::graphics/1_switch_card_.*)
9. suspend for primary graphic card (2013.com.canonical.certification::suspend/1_suspend_after_switch_to_card_.*)
10. display check for primary graphic card after susend (2013.com.canonical.certification::suspend/1_display_after_suspend.*)

Which is what was expected by Jerry.

So the issue is fixed for Stella as well.

tags:

added: cqa-verified

Sylvain Pineau (sylvain-pineau) on 2015-04-27

Changed in plainbox-provider-canonical-certification:
status:	Fix Committed → Fix Released

Chris Gregan (cgregan) on 2015-05-05

Changed in cdts:
status:	New → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Bug attachments

Add attachment

Remote bug watches

Bug watches keep track of this bug in other bug trackers.