lp:~pieq/plainbox-provider-checkbox

Author: Pierre Equoy
Author Date: 2022-07-06 13:55:55 UTC

Change:power-management: use loginctl to turn screen on/off

screenoff.sh was used to simulate the Super+L keypresses to turn the
screen off.

Use loginctl instead. By using [un]lock-sessions instead of
[un]lock-session, this makes sure this test runs well locally, through
SSH and using checkox remote.

Author: Pierre Equoy
Author Date: 2022-07-05 13:24:47 UTC

Fix: lock session in fingerprint test even when using Wayland

Previous method emulated keystrokes to trigger the GNOME lock screen
(Super+L). This does not work with Wayland security model.

Instead, use loginctl which allows to lock all the open sessions at
once. This works locally as well as through SSH and also with Checkbox
remote.

LP: #1980475

Author: Pierre Equoy
Author Date: 2022-06-23 04:01:43 UTC

Fix: xorg-related jobs still being called when running graphics test plan

The resolution change and rotation jobs were still depending on
xorg-related job, even though this dependency is not actually required.

Removing them.

LP: #1968842

Author: Pierre Equoy
Author Date: 2022-06-16 06:47:23 UTC

Change:touchpad: merge 2-finger horizontal and vertical scroll jobs into one

The touchpad_test.py script allows to test all of the four directions at
once. After discussing with QA team, there never was a case where only
horizontal or only vertical scrolling did not work. It's either all or
nothing. touchpad/multitouch-horizontal and touchpad/multitouch-vertical
are therefore merged into one touchpad/multitouch job.

Author: Pierre Equoy
Author Date: 2022-06-08 04:00:46 UTC

Remove: graphics_modes_info.py script and related jobs

The graphics_modes_info.py script is used in two jobs that are not
called in any of our test plans. Moreover, since it uses xrandr, the
output might be incorrect on recent versions of Ubuntu (22.04+) using
Wayland as default.

Author: Pierre Equoy
Author Date: 2022-06-02 02:54:08 UTC

Remove: xorg jobs from graphics test plans

Ubuntu 22.04 uses Wayland by default, so calling xorg-related jobs
generated failed results. In addition, these xorg jobs do not provide
useful information.

LP: #1968842

Author: Pierre Equoy
Author Date: 2022-04-19 02:20:43 UTC

units:touchpad: skip palm-rejection job if not on a laptop

touchpad/palm-rejection should only be run on laptops, and skipped
otherwise, like all the other touchpad jobs.

Author: Pierre Equoy
Author Date: 2022-04-15 07:57:58 UTC

Fix: powersaving job on Wayland

Instead of relying on a Xorg-related tool, activate GNOME's screensaver
through busctl. This has the added benefit of being able to restart the
screen after a few seconds, so one less manipulation for the tester.

LP: #1969167

Author: Pierre Equoy
Author Date: 2022-02-24 08:25:56 UTC

Change: Allow WiFi SSID with spaces in automated wireless tests

Author: Pierre Equoy
Author Date: 2021-12-14 09:17:00 UTC

Change: explicitely log to a file suffixed ".log" for all the fwts_test jobs

The fwts_test.py script in checkbox-support was modified to not append
.log automatically to log files. This commit adjusts the behavior of the
Checkbox jobs so that we get the same end result.

Author: Pierre Equoy
Author Date: 2021-12-09 03:11:57 UTC

Add: GPIO test for AAEON UPN device

Author: Kristin Chuang
Author Date: 2021-07-15 06:01:18 UTC

Change: replace also-after-suspend-manual flag dependencies into also-after-suspend

Author: Pierre Equoy
Author Date: 2021-11-11 09:31:34 UTC

Fix: use root for Ethernet hotplug jobs

ethernet/hotplug-* test cases fail with error "ping: SO_BINDTODEVICE
xxx: Operation not permitted" because root is required to select the
interface to ping with (e.g. `sudo ping 192.168.1.1 -I enp4s0`).

LP: 1950566

Author: Pierre Equoy
Author Date: 2021-10-28 07:53:25 UTC

Fix: Remove manual jobs from automated USB-C test plan

Author: Pierre Equoy
Author Date: 2021-01-27 08:29:22 UTC

docs: Update README

Author: Pierre Equoy
Author Date: 2020-09-14 08:22:24 UTC

units: usb: Add note to make sure USB drive has a partition

LP: #1895497

Author: Pierre Equoy
Author Date: 2019-10-09 03:29:20 UTC

disk: modify tpm-fde job wording

Additional testing with TPM-enabled full disk encryption shows that
something as simple as switching Secure Boot on/off in the BIOS is
enough to change the TPM state and therefore to prevent the device from
booting.

Author: Pierre Equoy
Author Date: 2019-08-23 09:19:35 UTC

Add manual test to check decryption error when TPM data modified

There is no easy way to automate a test to check that device data
partition cannot be decrypted if TPM2 data is modified.

The easiest way is to manually flash the BIOS after installing the OEM
image. By doing so, the TPM data, including data used for data partition
decryption, is modified, making it impossible to decrypt the partition
and boot the device.

Author: Pierre Equoy
Author Date: 2019-06-25 07:26:13 UTC

bin:pm_test: use the proper fwts.log file to compute sleep/resume times

pm_test relies on fwts_test.py from checkbox_support. However,
fwts_test.py --log argument takes a filename without and appends `.log`
to it.

When calling it from pm_test with argument `--log={}/fwts.log`, we are
in fact working on file `fwts.log.log` instead of `fwts.log`, so the log
file used for later computation is erroneous (it doesn't contain the
"Iteration n" markers needed to find the average sleep/resume times),
which leads to wrong results and ultimately a set of jobs
(power-management/suspend-*-cycles-time-check*) that always fail.

LP: #1834127

Author: Pierre Equoy
Author Date: 2019-06-06 02:56:15 UTC

bin: let PRIME offloading on AMD GPUs work on any Ubuntu release

When the script to set PRIME offloading on AMD GPUs was initially
writted, we were still certifying Trusty (14.04) configs, and since
Trusty didn't have this feature, we needed to bypass it.

Now that all the Ubuntu releases we certify support AMD GPU offloading
(i.e. DRI_PRIME=1 for amdgpu drivers), we get rid of the check on Ubuntu
release.

LP: #1831719

Author: Pierre Equoy
Author Date: 2019-03-05 09:31:10 UTC

providers:checkbox: better handle unexpected times in sleep_time_check

Sometimes, the time to sleep or resume cannot be computed accurately by
FWTS. Instead of returning a numeric value, FWTS then returns "N/A".

This commit handles this kind of case better. The job will fail (because
it cannot calculate average time), but will provide clearer information
instead of a scary stack trace.

LP: #1816809

Author: Pierre Equoy
Author Date: 2019-02-08 03:09:09 UTC

stress: add summaries for the 30 suspend cycles jobs

Author: Pierre Equoy
Author Date: 2018-09-11 06:35:42 UTC

Add category to template job `ethernet/hotplug-*-end-cycle`

Author: Pierre Equoy
Author Date: 2018-08-27 10:04:59 UTC

dock: generic test plan and additional jobs

Author: Pierre Equoy
Author Date: 2018-04-25 05:27:14 UTC

Add cert blocker status to reboot and poweroff stress tests

Author: Pierre Equoy
Author Date: 2017-09-18 03:33:39 UTC

Replace deprecated `description` field in touchpad jobs

The `description` field has been deprecated for a while, so this commit
replaces it with the `purpose`, `steps` and `verificatoin` ones for the
touchpad jobs.

Author: Pierre Equoy
Author Date: 2017-09-13 03:21:46 UTC

Make "after suspend" graphic jobs depending on the proper suspend job

A lot of the graphics "after suspend" tests were started after running
`suspend/{index}_suspend_after_switch_to_card_{product_slug}_xenial` instead of
depending on it.

If this job fails or is skipped, there is no reason to want to run "after
suspend" jobs such as
`suspend/{index}_glxgears_after_suspend_{product_slug}_xenial` for instance.

Author: Pierre Equoy
Author Date: 2017-09-12 06:18:41 UTC

Clarify manifest.has_card_reader name

The current name for this manifest is just "Card Reader".
This can be misleading, as it could be taken for a smart card reader
instead of what it is (media card reader).

Author: Pierre Equoy
Author Date: 2017-02-23 04:30:16 UTC

Add auto-unmount feature in the storage test

It's better to put things back into the state they were before we started the
test. The storage test now unmount any partition it may have mounted itself and
removes the temporary directory created to mount it into.

LP: #1660386

Author: Pierre Equoy
Author Date: 2017-02-22 08:01:09 UTC

Automatically mount drives when running storage tests

When running disk/storage_device_* jobs, if the drive is not mounted, we now
check if it can be mounted (i.e. if it has a partition) and if possible we
mount it to a dedicated temporary location in order to perform the storage
tests.

LP: #1660386

Author: Pierre Equoy
Author Date: 2017-02-07 09:42:00 UTC

Update graphics_driver script to handle Matrox cards

One of the devices being tested uses a Matrox card. This card is using a kernel
mode setting (kms) driver called 'modesetting' to work, but this use case was
not handled in our graphics_driver script that displays information about
drivers currently in use.

LP: #1655211

Author: Pierre Equoy
Author Date: 2017-01-24 09:48:46 UTC

Update FWTS tests using HWE recommendations

Following HWE recommendations, we decided to update our fwts test script to
split only between HWE and QA ("Recommended") tests.

The options to launch the script have been updated accordingly.

LP: #1658624

Author: Pierre Equoy
Author Date: 2016-12-07 08:28:38 UTC

Add missing template filtering to suspend jobs

Some filtering was missing for suspend jobs to complete lp:1636060.
In addition, the filtering for the graphics card switch job was changed to the
xenial-related job, since this is where we need this new template filtering.

LP: #1636060

Author: Pierre Equoy
Author Date: 2016-11-15 07:12:11 UTC

Filter out some jobs if discrete GPU can do offloading

If the device being tested has two GPUs (one integrated, one discrete), but the
discrete GPU can perform GPU Offloading (i.e. can launch a specific program or
game using the discrete GPU while using the intergrated one by default), then
some jobs are not required to be run: typically, jobs that are handled by
integrated GPU such as desktop-related tasks.

LP: #1636060