Merge ~meribold/plainbox-provider-sru:sru-server-test-plan into plainbox-provider-sru:master

Proposed by Lukas Waymann
Status: Merged
Approved by: Lukas Waymann
Approved revision: 07ecb7d383f696b721f3936acf5f3e9fbc205b05
Merged at revision: 33a1ae9dff9bf6c9505a07181cd1b52e44076569
Proposed branch: ~meribold/plainbox-provider-sru:sru-server-test-plan
Merge into: plainbox-provider-sru:master
Diff against target: 87 lines (+69/-0)
1 file modified
units/sru.pxu (+69/-0)
Reviewer Review Type Date Requested Status
Jonathan Cave (community) Approve
Lukas Waymann (community) Approve
Review via email: mp+395346@code.launchpad.net

Description of the change

Add SRU test plan for servers

To post a comment you must log in.
Revision history for this message
Lukas Waymann (meribold) wrote :

This is mostly the same as the `sru` testplan but doesn't include the following:

    graphics/xorg-version
    graphics/1_compiz_check_.*
    graphics/xorg-failsafe
    graphics/xorg-process
    graphics/1_screenshot_.*
    1_screenshot_.*.jpg
    graphics/1_screenshot_fullscreen_video_.*
    1_screenshot_fullscreen_video_.*.jpg

Revision history for this message
Lukas Waymann (meribold) wrote :

It also doesn't include these tests:

    suspend/screenshot_after_suspend
    screenshot_after_suspend.jpg

Revision history for this message
Jonathan Cave (jocave) wrote :

Thanks for working on this. Looks good except for one suggestion below.

review: Needs Fixing
Revision history for this message
Lukas Waymann (meribold) wrote :

> Thanks for working on this. Looks good except for one suggestion below.

Done 👍

review: Approve
Revision history for this message
Jonathan Cave (jocave) wrote :

Thanks, +1

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1diff --git a/units/sru.pxu b/units/sru.pxu
2index faa89ce..6526d34 100644
3--- a/units/sru.pxu
4+++ b/units/sru.pxu
5@@ -41,6 +41,26 @@ command: [ -f ${PLAINBOX_SESSION_SHARE}/screenshot_opencv_validation.jpg ] && ca
6 _description: Attaches the screenshot captured in graphics/screenshot_opencv_validation.
7 _summary: Attach the screenshot captured for the automatically validated screenshot test
8
9+id: after-suspend-sru-server
10+_name: All SRU Tests (Ubuntu Server) to run after suspend
11+unit: test plan
12+_description:
13+ After suspend SRU jobs
14+include:
15+ suspend/suspend-single-log-attach
16+ suspend/audio_after_suspend_auto
17+ suspend/network_resume_time_auto
18+ suspend/wifi_resume_time_auto
19+ suspend/usb_storage_preinserted_after_suspend
20+ suspend/record_playback_after_suspend_auto
21+ after-suspend-bluetooth4/beacon_eddystone_url_.*
22+ suspend/cpu_after_suspend_auto
23+ suspend/memory_after_suspend_auto
24+ suspend/gpu_lockup_after_suspend
25+ disk/disk_stress_ng_.*
26+ stress/cpu_stress_ng_test
27+ after-suspend-thunderbolt3/storage-preinserted
28+
29 id: after-suspend-sru
30 _name: All SRU Tests (Ubuntu Desktop) to run after suspend
31 unit: test plan
32@@ -63,6 +83,55 @@ include:
33 stress/cpu_stress_ng_test
34 after-suspend-thunderbolt3/storage-preinserted
35
36+id: sru-server
37+_name: All SRU Tests (Ubuntu Server)
38+unit: test plan
39+_description:
40+ This test plan contains tests that are useful for validating a Stable
41+ Release Update (SRU) on Ubuntu Certified systems. This test plan is not
42+ recommended for, nor will it be accepted for self-testing purposes.
43+include:
44+ # Following jobs all run first before the nested parts
45+ # Please keep it short and avoid jobs triggering suspend or reboots
46+ # Whenever possible prefer the use of nested parts instead
47+ miscellanea/submission-resources
48+ info/systemd-analyze
49+ net_if_management_attachment
50+ audio/alsa_record_playback_automated
51+ install/apt-get-gets-updates
52+ miscellanea/dkms_build_validation
53+ miscellanea/fan_stress_reaction
54+ networking/http
55+ networking/gateway_ping
56+ thunderbolt3/storage-preinserted
57+nested_part:
58+ info-attachment-cert-full
59+ bluetooth-cert-automated
60+ camera-cert-automated
61+ cpu-cert-automated
62+ disk-automated
63+ ethernet-automated
64+ mediacard-automated
65+ memory-automated
66+ power-management-precheck-cert-automated
67+ usb-automated
68+ wireless-automated
69+ before-suspend-reference-cert-automated
70+ suspend-tp
71+ after-suspend-sru-server
72+ after-suspend-wireless-automated
73+ stress-pm-graph
74+bootstrap_include:
75+ device
76+ graphics_card
77+ net_if_management
78+exclude:
79+ cpu/clocktest
80+ disk/stats_.*
81+ disk/storage_device_.*
82+ suspend/bluetooth_obex_send_before_suspend
83+ installer_debug.gz
84+
85 id: sru
86 _name: All SRU Tests (Ubuntu Desktop)
87 unit: test plan

Subscribers

People subscribed via source and target branches