lp:~checkbox-dev/checkbox

Author: Zhongning Li
Author Date: 2025-01-20 03:28:16 UTC

test: increase coverage

Author: hanhsuan
Author Date: 2025-01-17 07:52:12 UTC

[checkbox-ce-oem] Enhance serial test to be more stable (Bugfix) (#1682)

1. enhance the server mode could handle binary data without crashing
2. clean up garbage in the serial port before testing

Author: Zhongning Li
Author Date: 2025-01-17 06:12:03 UTC

style: formatting

Author: HanhsuanLee
Author Date: 2025-01-17 06:06:24 UTC

draft

Author: Yujin.Wu
Author Date: 2024-11-20 09:48:03 UTC

Automated the wake-on-LAN S3 tests (New)

please refer to wake-on-LAN-automatic-tests.md for more details

Co-authored-by: hanhsuan <32028620+hanhsuan@users.noreply.github.com>

Author: StanleyHuang
Author Date: 2025-01-10 02:00:33 UTC

fix flake8 issue

fix flake8 issue

Author: Fernando Bravo Hernández
Author Date: 2025-01-08 11:50:34 UTC

Making the test not fail if no config is found

Author: Zhongning Li
Author Date: 2025-01-03 02:43:02 UTC

fix: comments still says unity

Author: Dirk Su
Author Date: 2025-01-02 07:47:00 UTC

Add Emerald Rapids model (Bugfix) (#1666)

Add Emerald Rapids model

Author: Zhongning Li
Author Date: 2024-12-23 15:42:51 UTC

fix: add timeout for lsusb and lspci

Author: Massimiliano Girardi
Author Date: 2024-12-19 14:06:17 UTC

Add units to the extended tutorial

Author: Zhongning Li
Author Date: 2024-12-17 07:46:22 UTC

style: formatting

Author: Pierre Equoy
Author Date: 2024-12-11 16:12:08 UTC

Add documentation about the __result file

Author: Abdullah
Author Date: 2024-11-28 09:16:58 UTC

reboot machine in testflinger job and re-run DSS validations

Author: Abdullah
Author Date: 2024-12-06 15:26:22 UTC

exit with code 1 when forced to print help message

this is to catch situations where the script is called with unsupported
arguments.

Author: Abdullah
Author Date: 2024-11-28 09:16:58 UTC

reboot machine in testflinger job and re-run DSS validations

Author: Fernando Bravo
Author Date: 2024-12-03 14:30:11 UTC

Revert "Umount the device first during mount_usb_storage() (#1587) (BugFix) (…"

This reverts commit d0c208ed43e4541ef321f0d02a53f751dd8e0608.

Author: Fernando Bravo Hernández
Author Date: 2024-11-27 17:02:17 UTC

Proposed changes for SRU refactor

Author: Massimiliano Girardi
Author Date: 2024-11-21 13:14:58 UTC

Adopt new global plug and remove manual unconfinement

This new global interface will make the snap completely unconfined
so there is no reason to ask apparmor to drop confinement (and doing so
will raise a denied error)

Author: Massimiliano Girardi
Author Date: 2024-11-11 16:19:01 UTC

Add print explanation

Author: Massimiliano Girardi
Author Date: 2024-11-07 13:08:57 UTC

Downgrade ubuntu version for 18 and 20

Author: Vincent Liao
Author Date: 2024-10-31 16:16:19 UTC

Add checkbox-mir to plugs and wrapper_local

Author: PeiYao Chang
Author Date: 2024-10-31 15:29:48 UTC

Init hdmi rx

Author: Massimiliano Girardi
Author Date: 2024-10-17 14:07:15 UTC

Remove as the new workflow doesn't neede these files

Author: Fernando Bravo Hernández
Author Date: 2024-10-09 15:15:41 UTC

Removed unused tests

Author: StanleyHuang
Author Date: 2024-10-08 08:10:49 UTC

fix pep8 error

fix pep8 error

Author: Michael Reed
Author Date: 2024-10-03 15:30:02 UTC

Merge branch 'main' into sriov_test1

Author: mauriciocoder
Author Date: 2024-10-01 20:17:02 UTC

Simplify Image Capture Logic in _still_image_helper (New)

Author: PeiYao Chang
Author Date: 2024-09-03 06:56:21 UTC

Reduce the length of _name fields to under 80 characters

Author: Zhongning Li
Author Date: 2024-08-30 02:37:39 UTC

fix: missing shebang header

Author: Yujin.Wu
Author Date: 2024-08-29 07:43:22 UTC

Fix kill process issue in timeout.py

Author: Massimiliano Girardi
Author Date: 2024-08-20 13:42:29 UTC

Revert "New match feature (new) (#1422)"

This reverts commit b672f33e7ffa83bf16c5889acedefa9e28b4d188.

Author: Vincent Liao
Author Date: 2024-08-20 08:19:36 UTC

Test commit

Author: Pedro Avalos
Author Date: 2024-08-09 16:09:53 UTC

Add `device_rescan` tests

Author: Massimiliano Girardi
Author Date: 2024-08-02 09:30:02 UTC

Dump fwts version in parts meta info

Author: Paolo Gentili
Author Date: 2024-08-01 13:50:20 UTC

Fix: skip a resolution check in case the HW supposedly does not support it

Author: Massimiliano Girardi
Author Date: 2024-07-25 16:03:14 UTC

New debian validation pipeline (infra) (#1369)

* New debian validation pipeline

* Fix dependency problem to checkbox-support

---------

Co-authored-by: Paolo Gentili <paolo.gentili@canonical.com>

Author: boukeas
Author Date: 2024-07-22 09:03:25 UTC

fix: use quotes when using matrix values for environment variables

Author: Rick Wu
Author Date: 2024-07-17 07:10:52 UTC

Add rpmsg auto test into main ce-oem test plan

Author: StanleyHuang
Author Date: 2024-07-15 03:24:21 UTC

Update the readme files

update the readme files

Author: eugene-yujinwu
Author Date: 2024-07-04 21:33:37 UTC

Improve power-management/lid_close_suspend_open test case (Bugfix) (#1093)

* Fix some issues related with the test case power-management/lid_close_suspend_open (bugfix) (#1080)

- Make sure the test is executed at the appropriate time (i.e. not right after resuming the device)
- Fix the typo in the test order number
- Remove functionally similar test cases power-management/lid from the test plan
- Adjust the place of test case to avoid running it just after the suspend case

* Add test power-management/lid back per Clair's comments

* Check the last suspend within the time of HoldoffTimeoutUSec as the review advised.

* Change the script per the new comments from Hanhsuan

* change the lid_close_suspend_open.sh per Stanley's advice

Co-authored-by: stanley31huang <stanley.huang@canonical.com>

* Fix the error in ShellcheckTests

* Fix a wait time calculation issue and improve the PR per Pierre's comments

Co-authored-by: Pierre Equoy <pierre.equoy@canonical.com>

---------

Co-authored-by: stanley31huang <stanley.huang@canonical.com>
Co-authored-by: Pierre Equoy <pierre.equoy@canonical.com>

Author: Yujin.Wu
Author Date: 2024-03-20 09:54:24 UTC

Fix some issues related with the test case power-management/lid_close_suspend_open (bugfix) (#1080)

- Include a note to ensure the test is executed at the appropriate time
- Fix the typo in the test order number
- Remove functionally similar test cases power-management/lid from the test plan
- Adjust the place of test case to avoid running it just after the suspend case

Add test power-management/lid back per Clair's comments
Check the last suspend within the time of HoldoffTimeoutUSec as the review advised.
Change the script per the new comments from Hanhsuan
change the lid_close_suspend_open.sh per Stanley's advice

Co-authored-by: stanley31huang <stanley.huang@canonical.com>

Author: Fernando Bravo Hernández
Author Date: 2024-06-24 07:58:21 UTC

Make it pass for all snaps containing "core" and added debug in fail case

Author: Vincent Liao
Author Date: 2024-06-21 10:08:39 UTC

Fix any()

Author: boukeas
Author Date: 2024-06-14 13:31:46 UTC

Clean up and some documentation

Author: Bin Li
Author Date: 2024-04-03 16:04:23 UTC

Add unittest

Author: Fernando Bravo Hernández
Author Date: 2024-06-06 16:04:52 UTC

Applied suggestion in bluetooth

Author: Massimiliano Girardi
Author Date: 2024-05-29 10:34:41 UTC

Backported setup.py

This was done to get a 'working' version in the beta ppa

Author: boukeas
Author Date: 2024-05-23 14:59:49 UTC

CERTTF-327 Test workflow with `poll: True`

Author: Michael Reed
Author Date: 2024-05-13 12:23:54 UTC

Initial version of testing SRIOV on Intel Netork Devices

Author: Maciej Kisielewski
Author Date: 2024-05-06 12:51:18 UTC

mock clearing of edid

Author: Maciej Kisielewski
Author Date: 2024-05-01 14:51:47 UTC

make debsums job require non-core os

Author: Varun Valada
Author Date: 2024-04-23 20:41:17 UTC

Update kernel taint test to accept NVIDIA drivers

Author: Pierre Equoy
Author Date: 2024-04-18 00:53:11 UTC

Add template_id description in schema definition

Author: Mengmeng Tang
Author Date: 2024-04-08 06:33:25 UTC

Merge branch 'main' into 1295-change-regex-to-template-id

Author: Massimiliano Girardi
Author Date: 2024-04-05 15:39:06 UTC

Re-introduce submit_job and remove exit bodge

Author: Vincent Liao
Author Date: 2024-04-04 07:49:15 UTC

Fix core check

Author: Vincent Liao
Author Date: 2024-04-01 08:57:13 UTC

Add workflow for checkbox-ce-oem edge build

Author: StanleyHuang
Author Date: 2024-04-01 01:51:36 UTC

retrieve firmware by debian and snap fwupd

implement a script to be able to retrieve frimware information by debian
fwupd and snap fwupd

Author: Massimiliano Girardi
Author Date: 2024-03-20 17:11:58 UTC

Metabox scenario to test this

Author: Pierre Equoy
Author Date: 2024-03-11 09:42:30 UTC

Add unit test for ListTestplan.register_arguments()

Author: Massimiliano Girardi
Author Date: 2024-02-29 16:32:46 UTC

Port the test to remote

Minor: Add test plan that dumps env var
Minor: Use env vars instead of manifest for config chains

Author: Pierre Equoy
Author Date: 2024-02-22 14:02:05 UTC

Cleanup Test Plan Unit reference page

Author: Fernando Bravo Hernández
Author Date: 2024-02-09 11:51:36 UTC

renamed tests and modified

Author: eugene-yujinwu
Author Date: 2024-01-25 13:50:27 UTC

Fix the wrong category issue for the camera 5986:118c (BugFix) (#964)

Fix the wrong category issue for the camera 5986:118c (BugFix) (LP:#2051091)

Author: Maciej Kisielewski
Author Date: 2024-01-11 22:53:31 UTC

fix pep8 issues

Author: dann frazier
Author Date: 2023-08-25 15:41:50 UTC

virtualization/verify_lxd_vm requires lxd versions only available as snaps

lxd virtual machine support was added in 4.0, but there are no debs for
lxd >= 4 in the Ubuntu ecosystem. bionic systems deploy with an old
3.x lxd deb, so testing with that installed results in a false alarm.

DEBUG:root:Attempting to initialize LXD
DEBUG:root:Command lxd init --auto:
DEBUG:root: Command returned no output
DEBUG:root:Launching Virtual Machine
DEBUG:root:No local image available, attempting to import from default remote.
ERROR:root:Command lxc init ubuntu:18.04 testbed --vm returned a code of 1
ERROR:root: STDOUT:
ERROR:root: STDERR: Error: unknown flag: --vm

Fixes #684

Author: Mengmeng Tang
Author Date: 2023-12-20 12:17:34 UTC

add syntax highlighting

Author: Mengmeng Tang
Author Date: 2023-12-20 07:20:02 UTC

doc: update spelling check to en_GB

Author: Mengmeng Tang
Author Date: 2023-12-12 06:29:42 UTC

add mermaid css for accessbility

Author: Maciej Kisielewski
Author Date: 2023-12-01 15:10:29 UTC

update the url to the stable PPA

Author: Maciej Kisielewski
Author Date: 2023-11-28 11:56:35 UTC

concrete git steps to move HEAD

Author: Fernando Bravo
Author Date: 2023-11-15 12:08:17 UTC

Added camera quality test using brisque (New) (#803)

* Add brisque algorithm to checkbox_support

Added modified version of the brisque algorithm in
chechkbox_support/vendor.

The algorithm is implemented in:
https://github.com/rehanguha/brisque

Vendorized also python-libsvm to fix imports in snap

* Add camera quality test

New camera quality test using brisque algorithm included in
"camera-cert-automated"

* Added tests to image quality test

Included some automated tests to the image quality test to increase
the coverage

* Add packaging meta data units to depend on opencv and libsvm python bindings

Note: Only for 22.04 (until the syntax allows >= 22.04)

* Removed the requirement of fswebcam in camera

* Added opencv and libsvm to provider base in snap

* Added blas and lapack to LD_LIBRARY_PATH

* Added a timeout to camera quality test

* Added documentation for camera tests

* Fixed formatting of python files

* Updated brisque score to take an image as input

* Refactored camera_quality_test

- Moved get_score_from_device to a separate function
- Moved evaluation to a separate function
- Added check for stable brisque score
- Argument parsing managed by main function
- Added return typings

* Fix comments on test_camera_quality.py

Removed the slow_score function and replaced it with a TIMEOUT of
0 to test that there are at least two iterations in slow
calculations

---------

Co-authored-by: Sylvain Pineau <sylvain.pineau@canonical.com>

Author: Pierre Equoy
Author Date: 2023-11-07 02:05:35 UTC

Apply black on cpuid.py

Author: Maciej Kisielewski
Author Date: 2023-10-30 13:20:35 UTC

mention enrollment of GPG keys in CONTRIBUTING doc

Signed-off-by: Maciej Kisielewski <maciej.kisielewski@canonical.com>

Author: Pierre Equoy
Author Date: 2023-10-20 07:04:13 UTC

Fix tests to support Python 3.5

assert_called() was introduced in 3.6... 😭

Author: Maciej Kisielewski
Author Date: 2023-10-26 09:44:22 UTC

move toxing to self-hosted runners

Signed-off-by: Maciej Kisielewski <maciej.kisielewski@canonical.com>

Author: Matias Piipari
Author Date: 2023-10-23 21:23:18 UTC

Use just Wandalen/wretryaction (Infra)

Use just Wandalen/wretryaction since it handles both necessary cases.

Author: Pierre Equoy
Author Date: 2023-08-23 03:25:52 UTC

Add daily process to tag edge releases

edge_tag.py generates an edge release tag based on the latest release
tag and the number of commits since, and pushes it.

For instance, if the last release is "v2.9.1", and there have been 6 new
commits since, the script will compute tag "v2.9.2-edge+6", tag the
latest commit in HEAD with it, and push the tags.

Fix CHECKBOX-807

Author: Maciej Kisielewski
Author Date: 2023-07-27 19:08:19 UTC

sort the cpu families in cpuid.py

Author: Nancy Chen
Author Date: 2023-07-26 03:21:46 UTC

modify AutomaticLogin value

Author: Maciej Kisielewski
Author Date: 2023-06-28 11:46:18 UTC

make tox run on py 3.11

Author: Maciej Kisielewski
Author Date: 2023-06-27 13:16:09 UTC

WIP

Author: Michael Reed
Author Date: 2023-06-14 19:54:10 UTC

Set cpu to 1 for virtual machines when number of cpu's are over 288

Author: Sylvain Pineau
Author Date: 2023-05-22 15:16:36 UTC

Fix the AudioPlayback scenario to not depend on the base provider

The Audio scenario ran the com.canonical.certification::audio/playback_auto
job from the base provider.

The new metabox provider job is using a lighter version of the
gst_pipeline_test.py script and does not depend on the udev resource.

Author: Sylvain Pineau
Author Date: 2023-05-12 10:59:16 UTC

Add pytest command examples to the documentation

Author: Pierre Equoy
Author Date: 2023-03-14 06:37:39 UTC

Add section about version bump in Debian release process readme

Author: Sylvain Pineau
Author Date: 2023-01-31 15:23:12 UTC

Stop listing partitions if they contain the OS (root mountpoint / and /boot)

Use the udev parser special function find_pkname_is_root_mountpoint() to
filter out partitions if the corresponding media is actually the from where
the OS is running from ("/" and "/boot").

Author: Sylvain Pineau
Author Date: 2023-01-31 08:20:27 UTC

Bump acpica-tools part tag to R10_20_22

Author: Rod Smith
Author Date: 2023-01-30 18:39:58 UTC

Remove APSTE support test for Server Certification

Author: Sylvain Pineau
Author Date: 2023-01-30 17:55:01 UTC

Add AX SSID/PSK info for both WPA and WPA3 standards to checkbox-snap config_vars

Author: Sylvain Pineau
Author Date: 2023-01-27 08:11:13 UTC

Fix: starting with snapd 2.59, systemctl calls all turn into no-ops (chroot env)

Workaround for https://bugs.launchpad.net/snapd/+bug/2003955
Setting SYSTEMD_IGNORE_CHROOT=1 helps to select the correct restart strategy.

Ref: https://systemd.io/ENVIRONMENT/

Author: Sylvain Pineau
Author Date: 2023-01-30 14:00:37 UTC

Remove IPDT tests from certification test plans

Author: Rod Smith
Author Date: 2023-01-26 18:53:33 UTC

Remove: mediacard/sd-preinserted-server

Author: Sylvain Pineau
Author Date: 2023-01-24 16:43:20 UTC

Fix Morris Doctest (compliance with python3.11)

Author: Michael Reed
Author Date: 2023-01-19 15:56:46 UTC

Adding additional support for Sapphire Rapids cpu's 0x806f8

Author: Sylvain Pineau
Author Date: 2023-01-13 09:50:04 UTC

Remove mention of checkbox-provider-certification-client in the install steps

Author: Michael Reed
Author Date: 2023-01-03 17:50:12 UTC

Adding an additional CPUID for Ice Lake in the CPUID script

Author: Pierre Equoy
Author Date: 2022-12-29 08:55:40 UTC

Point IoT 22.04 server test plans to the appropriate uc22 nested parts

Author: Pierre Equoy
Author Date: 2022-12-26 08:23:46 UTC

Remove display resource job

This job was not reliable since it was based on heuristics that often
failed, especially on 22.04.

Replaced by manual manifest entries that are more accurate.