lp:~sylvain-pineau/plainbox-provider-checkbox

Author: Sylvain Pineau
Author Date: 2022-10-06 11:18:17 UTC

Add missing python3-tqdm to requirements/deb-base

Author: Sylvain Pineau
Author Date: 2022-04-06 10:15:50 UTC

suspend:cycle_resolutions: Add support for wayland sessions

Author: Sylvain Pineau
Author Date: 2022-04-12 07:40:54 UTC

units:graphics: Use inxi on wayland sessions to display driver info

graphics_driver.py does not work on wayland since it parses Xorg log files.

Fixes: lp:1968641

Author: Sylvain Pineau
Author Date: 2022-03-31 16:13:50 UTC

bin:pm_test.py: Always execute the respawn commands

x-terminal-emulator (and dbus-launch) are not supported w/ Wayland
This patch ensures the checkbox systemd service is always restarted.

Fixes: lp:1967032

Author: Sylvain Pineau
Author Date: 2022-03-28 17:41:46 UTC

virtualization: Add dependency on qemu-efi-aarch64 on arm64

The virtualization test currently uses uvtool to launch a VM. On arm64,
this requires EFI firmware that is provided by the qemu-efi-aarch64
package. LP: #1940112

Author: Sylvain Pineau
Author Date: 2021-12-03 10:32:42 UTC

Fix: Use a safer method to template touchscreen jobs (dict.get()) - bis

Author: Sylvain Pineau
Author Date: 2021-10-21 07:04:17 UTC

jobs:graphics: Remove the package requirement on nux-tools to work with snaps

Fixes lp:1941850

Author: Sylvain Pineau
Author Date: 2021-09-21 13:21:51 UTC

bin/inxi_snapshot: Refresh the inxi script using the last upstream version

https://github.com/smxi/inxi/blob/73d9643907a0981ddc2801515eb50008f4a7ff00/inxi

Author: Sylvain Pineau
Author Date: 2021-06-01 11:24:51 UTC

units:serial: Add a packaging metadata unit to depend on python3-serial

Fixes: lp:1903264

Author: Sylvain Pineau
Author Date: 2021-04-27 13:01:54 UTC

Fix removable_storage_test to work on arm

No PCI slot property and USB driver is not 'xhci_hcd' but 'xhci-hcd'

Fixes lp:1903244

Author: Sylvain Pineau
Author Date: 2021-04-23 07:40:30 UTC

info: Adds firmware/fwts_dump_acpi_attachment.gz to cert nested part

Author: Sylvain Pineau
Author Date: 2021-04-22 10:15:11 UTC

units:info: Add info/acpidumps attachment

Using /usr/share/apport/dump_acpi_tables.py

Fixes: lp:1913714

Author: Sylvain Pineau
Author Date: 2021-02-04 09:08:42 UTC

units:usb: Add server focused USB tests

Created separate USB/USB3 preinserted tests for server to avoid breakage
when client focused requirements are added (w/o manifests).

Fixes: lp: #1914457

Author: Sylvain Pineau
Author Date: 2021-02-02 08:39:05 UTC

Rename snappy pxu and category to snapd

The term "snappy" ubuntu core is deprecated and too ambiguous.

Author: Sylvain Pineau
Author Date: 2021-01-29 14:06:10 UTC

ethernet: Restore the ethernet/iperf3 job

Author: Sylvain Pineau
Author Date: 2021-01-22 14:35:23 UTC

units:graphics: Add a glmark2-es2 job for checkbox classic snaps

checkbox20 includes glmark2-es2 built from sources instead of the ubuntu
archives version

Author: Sylvain Pineau
Author Date: 2020-12-17 13:04:37 UTC

bin:wifi_nmcli_test.py: Add a timeout (200s) to the 'nmcli up' subprocess

Author: Sylvain Pineau
Author Date: 2020-10-20 12:27:12 UTC

submission:raw_devices_dmi_json: Add the boot mode info to the BIOS dict

This new property comes from inxi which can take the following values:
  - BIOS
  - UEFI
  - UEFI [Legacy]
The last one is legacy BIOS boot mode in a system using UEFI but booted as BIOS/Legacy.
It is added to the existing json directly into the BIOS dict.

Fixes: lp:1854862

Author: Sylvain Pineau
Author Date: 2020-10-07 15:21:12 UTC

stress: Run stress-ng cpu and memory tests using systemd-inhibit

This runs stress-ng and inhibits system sleeping, shutdown and idle while
doing so.

Fixes lp:1815867

Author: Sylvain Pineau
Author Date: 2020-10-07 09:37:32 UTC

stress:s3s4: Fallback to rtcwake if fwts s3 is not supported (e.g on arm)

Author: Sylvain Pineau
Author Date: 2020-09-30 09:22:36 UTC

units:camera: Use camera/detect{,-rpi} as depends jobs for camera/roundtrip-qrcode

Author: Sylvain Pineau
Author Date: 2020-09-30 07:45:42 UTC

bin:disk_read_performance_test.sh: Add support for MTD (Flash) devices

Author: Sylvain Pineau
Author Date: 2020-09-07 15:31:34 UTC

units:mediacard: Fix sdhc-storage summary

Author: Sylvain Pineau
Author Date: 2020-09-07 15:19:01 UTC

units:suspend: typo (network_wait.py -> network_wait.sh)

Author: Sylvain Pineau
Author Date: 2020-09-02 08:16:14 UTC

units:bluetooth: Remove the bluez package.version>= '5.37' requirements

Useless since 16.04 version is exactly 5.37

Author: Sylvain Pineau
Author Date: 2020-07-24 11:49:39 UTC

units:monitor: Remove the two chameleon jobs and scripts

Author: PMR
Author Date: 2020-07-23 15:45:03 UTC

Merge #387969 from ~sylvain-pineau/plainbox-provider-checkbox:fix_bin_shellcheck_errors_2

Author: Sylvain Pineau
Author Date: 2020-07-23 15:10:38 UTC

bin:disk_read_performance_test.sh: Fix SC1001 for older releases

Author: Sylvain Pineau
Author Date: 2020-07-23 15:10:38 UTC

bin:disk_read_performance_test.sh: Fix SC1001 for older releases

Author: Sylvain Pineau
Author Date: 2020-07-22 10:13:51 UTC

bin:net_driver_info.py: Ignore empty args

Author: Sylvain Pineau
Author Date: 2020-07-20 09:34:31 UTC

units:i2c: Fix shellcheck error (detected on xenial/bionic only)

Author: Sylvain Pineau
Author Date: 2020-07-17 09:58:54 UTC

bin:*.py: Fix Flake8 W503 (Xenial version, 2.5.4)

Can be forced on recent versions with:

flake8 --select=W503 ./accelerometer_test.py

Author: Sylvain Pineau
Author Date: 2020-07-14 15:25:09 UTC

Remove all i18n content

Author: Sylvain Pineau
Author Date: 2020-05-26 12:10:36 UTC

New fingerprint reader tests (20.04/fprintd)

Notes:

1. All jobs are running as root. Remote connections are blocked by
the default polkit rules if run as the normal user.

The targeted user is either found via SUDO_UID or NORMAL_USER if checkbox
is running from the slave service.

2. fingerprint/unlock locks the screen by injecting a Super+L shortcut.

Author: Sylvain Pineau
Author Date: 2020-04-03 08:41:36 UTC

bin:pm_test: Use the NORMAL_USER en var when invoked via remote

SUDO_UID is not available since the slave service is a systemd unit running as root

Author: Sylvain Pineau
Author Date: 2020-01-28 13:40:39 UTC

bin:pm_test: Fix the suspend count method to take into account s2idle

Many new platforms [1] default to s2idle sleep/suspend instead of deep causing
fwts logs to record this suspend type rather than the test name "s3":

Completed s2idle cycle(s)

But pm_test was only looking for:

Completed S3 cycle(s)

Fixes: lp:1794644

[1] https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1808957

Author: Sylvain Pineau
Author Date: 2020-01-08 09:55:54 UTC

stress: Always remove the magic __result file with jobs respawning checkbox

Note: Since most of the time those jobs run as root, it can't be done from
checkbox-ng.

Fixes: lp:1794644

Author: Sylvain Pineau
Author Date: 2019-12-19 13:37:09 UTC

miscellanea/secure_boot_mode_gadget: Fix requirements

executable.name == 'dumpimage' or executable.name == 'mokutil'

Author: Sylvain Pineau
Author Date: 2019-11-28 10:07:15 UTC

bin:disk_read_performance_test: Set mdadm (sw raid) threshold to 500MB/s

Author: Sylvain Pineau
Author Date: 2019-11-22 08:46:50 UTC

bin:disk_read_performance_test: Set NVME threshold MIN_BUF_READ=200

Author: Sylvain Pineau
Author Date: 2019-11-21 17:04:16 UTC

units:submission: Remove the deprecated collect-manifest

To comply with the urwird manifest auto blacklist of this job.

Author: Sylvain Pineau
Author Date: 2019-10-18 08:11:04 UTC

wireless: Never instantiate wireless jobs if the interface is UNKNOWN

Fixes: lp:1848314

Author: Sylvain Pineau
Author Date: 2019-10-16 16:51:49 UTC

units:touchscreen: New evdev tap tests (no GUI)

Author: Sylvain Pineau
Author Date: 2019-10-16 08:01:28 UTC

submission: Add info/systemd-analyze to submission-cert-full

Author: Sylvain Pineau
Author Date: 2019-10-13 14:39:02 UTC

bin:boot_mode_test_snappy.py: Add lk support

Author: Sylvain Pineau
Author Date: 2019-10-10 16:10:30 UTC

bin:storage_test.py: Use free disk space / 4 to run bonnie++

The rule of thumb of dividing the space /2 does not work all the time
especially on UC devices.

Author: Sylvain Pineau
Author Date: 2019-10-08 15:47:12 UTC

bin:disk_read_peformance_test: Fix mmc/dm drives detection

Author: Sylvain Pineau
Author Date: 2019-10-08 12:54:38 UTC

graphics: Rename compiz_check to gl_support

/usr/lib/nux/unity_support_test is only called with -p and no longer with -c
thus checking only the OpenGL support.

Fixes: lp:1832171

Author: Sylvain Pineau
Author Date: 2019-10-08 06:43:32 UTC

bin:disk_read_peformance_test: Fix nvme drives detection

Author: Sylvain Pineau
Author Date: 2019-10-03 08:05:26 UTC

network: Add a packaging meta data unit to depend on iperf3

Required for the new ethernet/iperf3_reverse test

Author: Sylvain Pineau
Author Date: 2019-10-03 07:08:38 UTC

disks: Add missing packaging meta-data unit to depend on python3-psutil

Fixes: lp:1846321

Author: Sylvain Pineau
Author Date: 2019-10-02 09:32:36 UTC

firmware: Remove the no_ACPI_REV_interface test

Author: Sylvain Pineau
Author Date: 2019-09-26 18:35:12 UTC

submission: Expose the full set of DMI devices in raw-devices-dmi attachment

Fixes: lp:1839667

Author: Sylvain Pineau
Author Date: 2019-09-10 11:38:33 UTC

fde_test.py: Fix mount point discovery on core18

the writable partition is not /writable but
/var/lib/snapd/hostfs/writable/ on core18.

findfs LABEL=writable works on both core16 and core18.

Author: Sylvain Pineau
Author Date: 2019-09-07 10:05:49 UTC

units:wireless: New 80211ax jobs and nested parts for test plans

Author: Sylvain Pineau
Author Date: 2019-08-28 10:31:43 UTC

suspend_advanced_auto: fallback to rtcwake if fwts s3 is not supported

FWTS on arm does not provide the S3 tests.

Supported tests:

bmc_info, clog, cpu_info, cpufreq, dt_base, dt_sysinfo, klog, maxreadreq,
mem_info, mtd_info, olog, oops, power_mgmt, prd_info, reserv_mem, version.

Author: Sylvain Pineau
Author Date: 2019-05-27 12:52:02 UTC

bin:removable_storage_test: Ensure it is a media card reader only if this was explicitly requested

Fixes: lp:1811645

Author: Sylvain Pineau
Author Date: 2019-05-21 15:41:53 UTC

bin:gst_pipeline_test: Use pactl instead of pacmd

Author: Sylvain Pineau
Author Date: 2019-03-10 09:52:39 UTC

units:wireless: Fix nm_connection_save/restore ids (category->interface)

Using category in identifiers can generate duplicated job ids if more than
one wifi device is available on the system:

  File "/snap/checkbox-foo/z/lib/python3.x/site-packages/plainbox/impl/session/state.py", line 1106, in _add_job_unit
    raise DependencyDuplicateError(existing_job, new_job)
plainbox.impl.depmgr.DependencyDuplicateError: duplicate job id: 'com.canonical.certification::wireless/nm_connection_save_WIRELESS'

Author: Sylvain Pineau
Author Date: 2019-02-19 13:19:04 UTC

units:oob: Fix comments syntax

When using a snapped validation tool, the simple '# comment' was producing
the following error:

error: [...] field 'requires', expression did not reference any resources

Author: Sylvain Pineau
Author Date: 2019-01-16 09:40:24 UTC

units:touchpad: Remove singletouch-automated and multitouch-automated

All modern touchpads are multitouch and those two jobs sometimes return
false alarms.

touchpad/detected-as-mouse is a better test to identify issues.

Fixes: lp:1415358

Author: Sylvain Pineau
Author Date: 2019-01-08 09:00:52 UTC

units:mediacard: leverage the checkbox-support utilities to run non-udisks2 tests on UC

Author: Sylvain Pineau
Author Date: 2018-12-03 16:18:18 UTC

bin/inxi_snapshot: Drop the check for tty

Run via checkbox remote service, inxi fails with:
Error 1: You can't run option help in an IRC client!

Author: Sylvain Pineau
Author Date: 2018-12-03 10:41:29 UTC

bin:system_info: print error msg coming from subprocesses

Author: Sylvain Pineau
Author Date: 2018-11-29 12:37:29 UTC

bin:system_info: Forcing usb data to be collected via sysfs (needless to be root)

Author: Sylvain Pineau
Author Date: 2018-11-28 15:45:37 UTC

units:submission: Run system_info as root (again) but preserve PERL5LIB

Root access it not strictly required but helps gathering additional devices,
such as Network USB modems.

Author: Sylvain Pineau
Author Date: 2018-11-28 12:01:27 UTC

units:submission: run system_info_json as a normal user

Author: Sylvain Pineau
Author Date: 2018-11-25 21:17:49 UTC

units:miscellaneous: Add kernel_cmdline_attachment to submission-resources

Author: Sylvain Pineau
Author Date: 2018-11-05 11:17:50 UTC

bin:dkms_info: Skip malformed modaliases

Fixes lp:1779080

Author: Sylvain Pineau
Author Date: 2018-10-11 09:20:09 UTC

units: Add EddyStone URL scan tests (before and after S3)

Author: Sylvain Pineau
Author Date: 2018-10-10 18:24:04 UTC

units:bluetooth: power on is now done by the eddystone_scanner script

Author: Sylvain Pineau
Author Date: 2018-10-10 10:00:39 UTC

units:bluetooth: Fail the eddystone scan test if one of the commands failed

Author: Sylvain Pineau
Author Date: 2018-10-10 09:12:15 UTC

units:bluetooth: Bring down the device after the eddystone scan test

Author: Sylvain Pineau
Author Date: 2018-10-08 10:05:04 UTC

units:bluetooth: Add new BT LE beacon test using EddyStone URL advertisements

Author: Sylvain Pineau
Author Date: 2018-10-05 03:21:03 UTC

units:camera: Remove the unnecessary dep on libcheese

Author: Sylvain Pineau
Author Date: 2018-10-01 01:30:18 UTC

units:cpu: Only run cpu/cstates on Intel

#ifdef FWTS_ARCH_INTEL

See http://kernel.ubuntu.com/git/hwe/fwts.git/tree/src/acpi/cstates/cstates.c#n26

Author: Sylvain Pineau
Author Date: 2018-09-10 09:56:03 UTC

monitor: Split before and after suspend jobs in distinct test plans

Only including (after-suspend-manual-) qualifiers adds a dependency on
suspend/suspend_advanced we can't control as the ordering is then

suspend
monitor test
monitor test after suspend

With dedicated nested test plans, the ordering is preserved by calling the
"after-suspend" test plan after the part that already runs S3.

Author: Sylvain Pineau
Author Date: 2018-08-29 09:48:02 UTC

units:info: New info/systemd-analyze job to record boot-up performance stats

Author: Sylvain Pineau
Author Date: 2018-08-23 19:10:38 UTC

pm_test: Only check fwts logs if suspends_before_reboot option is used

reboot or poweroff + suspends_before_reboot = fwts log check
reboot or poweroff only = no fwts log check

Otherwise __result special file contains a failed outcome because pm_test
was unable to open the nonexistent fwts log file.

Fixes lp:1783742

Author: Sylvain Pineau
Author Date: 2018-07-02 10:18:35 UTC

New Bluetooth LE test to check beacon measurement notifications

Three environ variables to setup:

- ADV_SVC_UUID: General/Configuration GATT service UUID advertised even if
  the device is not connected
- SVC_UUID: GATT service to use to enable notifications.
- MSRMT_UUID: GATT characteristic from the SVC_UUID service to trigger
  notifications.

Author: Sylvain Pineau
Author Date: 2018-06-19 13:27:16 UTC

manage_compiz_plugin: Use dconf instead of gsettings

dconf is more snappy-friendly and does not require additional GIO tweaks.

Fixes: lp:1775523

Author: Sylvain Pineau
Author Date: 2018-06-11 12:36:34 UTC

disk_read_performance_test: Make the threshold configurable

Default 15MB/sec is sometimes too high for IOT systems.

Author: Sylvain Pineau
Author Date: 2018-06-06 07:20:32 UTC

Make ethernet hotplug tests cert blockers in networking-cert-manual test plan

Author: Sylvain Pineau
Author Date: 2018-05-23 06:55:25 UTC

wireless: Use executable resource in monitor_wireless_connection.* jobs

executable.name == 'iperf'

Author: Sylvain Pineau
Author Date: 2018-05-22 11:33:11 UTC

bin:disk_info: Add support for encrypted drives

Author: Sylvain Pineau
Author Date: 2018-05-17 15:11:34 UTC

units:mediacard.pxu: Add __on_ubuntucore__ jinja2 condition blocks

`journalctl -u snap.udisks2.udisksd` works only on UC

Author: Sylvain Pineau
Author Date: 2018-05-17 13:37:14 UTC

units:disks: Ensure no bad chars in test summaries

Example:

{
    "bus": "mmc",
    "category": "DISK",
    "driver": "mmcblk",
    "name": "mmcblk0",
    "path": "/devices/pci0000:00/0000:00:1c.0/mmc_host/mmc0/mmc0:0001",
    "product": "HAG2e\u0005",
    "product_slug": "HAG2e_"
},

Author: Sylvain Pineau
Author Date: 2018-05-16 09:18:44 UTC

graphics: Look for Xorg logs in $HOME on systems where X is running as non root

Author: Sylvain Pineau
Author Date: 2018-05-16 07:14:48 UTC

bin: Enforce versions with gi.require_version in python3 scripts

Fixes lp:1552609

Author: Sylvain Pineau
Author Date: 2018-05-16 06:19:37 UTC

bin:cycle_vts: Add support for gdm virtual terminals

Fixes: lp:1766816

Author: Sylvain Pineau
Author Date: 2018-05-04 12:19:25 UTC

pm_test: Unset LD_LIBRARY_PATH, PYTHONPATH and PYTHONHOME to start system terminal

gnome-terminal is using a python3 starter script that has to load the system
wide modules/library to work properly.
That's not the case in pm_test is started from a checkbox snap where all those
env var point to paths inside the snap.

This patch unset them to ensure gnome-terminal (via x-terminal-emulator) starts
with the right env.

For the record the error was:
ImportError: module encoding not found

Author: Sylvain Pineau
Author Date: 2018-05-02 08:30:24 UTC

pm_test: Run repawn command using raw string literal

Author: Sylvain Pineau
Author Date: 2018-04-30 12:41:47 UTC

touchscreen/x-touch-tap: Fix qmlscene invocation and disable unity only on 16.04

Fixes: lp:1766766

Author: Sylvain Pineau
Author Date: 2018-04-26 08:14:23 UTC

disk_stress_ng: Also consider software raid to identify the partition to use

$ sudo ./disk_stress_ng md0 --base-time 240 --really-run
/dev/md0 is a block device
md0 5760746520576 raid0 /raid
Found largest partition: "/dev/md0"
Test will use /dev/md0, mounted at "/raid", using "ext4"

Author: Sylvain Pineau
Author Date: 2018-04-11 14:07:06 UTC

submission:raw_devices_dmi_json: Fix syntax to stay compatible with jq 1.3

Fixes lp:1762546

Author: Sylvain Pineau
Author Date: 2018-04-03 10:58:08 UTC

pm_test: Add support for GDM autologin

It does so using ConfigParser to preserve the WaylandEnable settings.

Author: Sylvain Pineau
Author Date: 2018-04-02 06:23:06 UTC

monitor: Add dim test for after suspend

Fixes lp:1757082

Author: Sylvain Pineau
Author Date: 2018-04-01 08:42:09 UTC

monitor: Move USB Type C monitor tests to blocker test plans

Author: Sylvain Pineau
Author Date: 2018-03-15 17:15:16 UTC

wireless: Drop requirements on wireless_sta_protocol to run 802.11n tests

Author: Sylvain Pineau
Author Date: 2018-02-22 16:34:11 UTC

brightness_test: Fix script to adjust brightness on all interfaces